Skip to content

A Deep Reinforcement Learning Challenge on Forex Portfolio Management

License

Notifications You must be signed in to change notification settings

kayuksel/forex-rl-challenge

Repository files navigation

FX Reinforcement Learning Playground

This repository contains an open challenge for a Portfolio Balancing AI in Forex.

The state of the FX market is represented via 512 features in X_train and X_test.

These 512 features summarizes the price-actions of 10+1 assets in past 10 days.

Hourly log returns of assets during train & test periods are in y_train and y_test.

Why use my features as environment summary? because they're performing well!

Participation into the Forex RL Challenge

example.py contains an implementation, which balances a long-short FX portfolio.

Up to 2x leverage is allowed. Your objective is to outperform following risk metrics.

Please send me your saved model so that I can test it on a blind set for the contest.

I will list results from challengers here by sorting them using the industry-standard

risk measures including (but not limited to) the Calmar, Sortino, Omega ratio(s), etc.

Test results of example_cpu.py available here:

Max. Drawdown: 7.74% Sortino Ratio: 9.30x

Sharpe Ratio: 3.35x Stability: 90.31%

Tail Ratio: 3.67x Value at Risk: -0.94%

Daily Portfolio Balances

Annual Cumulative Return

Weekly Portfolio Log Return

How you can get rich out of this?

If you obtain successful results and you want to use your RL model for live-trading,

you can contact me for subscribing to a real-time feed of the environment summary.

Your objective results here can also attract business opportunities such as job offers.

If you are interested in academics:

Are you an academician? Use FX RL challenge to experiment with it in your publication.

You won't need to worry about the right feature extraction, as I already did that for you.

Fixed input for challengers will allow a clear benchmarking of RL methods developed.

Below is a survey paper about reinforcement learning applications in financial markets.

https://www.statistik.rw.fau.de/files/2018/10/12-2018.pdf

Sponsorships and Hackhathons

Please, contact me if you would like to sponsor the FX RL challenge; or organize a local

meetup, workshop or Hackathon where RL practitioners can participate to this challenge.

Bonus: Example Implementation

PyTorch implementation of Multi-processed training of a shared model where batches

are divided across processes. Looking for a person to contribute a TensorFlow version.

Multi-threaded implementation of Augmented Random Search method is also available!

Run the GPU version and then post-train with the CPU version (ARS) to get best results.

Bonus: Autoencoder Interpretation

PyTorch implementation of Variational Autoencoder (VAE) provided in the repository

demonstrates that features has great ability of capturing the right direction for the

majority of the extreme movements of the AUD (left) and NZD (right) assets, which

is the key to the success of the portfolio balancing policy that has been converged.

About

A Deep Reinforcement Learning Challenge on Forex Portfolio Management

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages