Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AgileRL curriculum learning and self-play tutorial #1124

Merged
merged 29 commits into from
Nov 14, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
56ef21f
Create self-play tutorial
nicku-a Sep 19, 2023
7e2680e
Remove wandb log files
nicku-a Sep 19, 2023
a04ef25
Formatting changes
nicku-a Sep 19, 2023
aa10c96
Alternating player turns changes
nicku-a Oct 3, 2023
a0c2ddf
DQN curriculum and self play tut
nicku-a Oct 20, 2023
df31a9e
Docstrings
nicku-a Oct 20, 2023
c2c05f3
Tutorial update
nicku-a Oct 23, 2023
e6e0177
Introduction of extra lesson
nicku-a Oct 26, 2023
4b9ad3e
Final DQN tutorial code changes
nicku-a Oct 27, 2023
ec97dde
Self-opposition gif
nicku-a Oct 27, 2023
9bae20c
Include DQN in index
nicku-a Oct 27, 2023
013e3bf
Upload connect four gif
nicku-a Oct 27, 2023
63c58e6
Upload trained model weights
nicku-a Oct 27, 2023
fd3054d
Add referernce to trained model weights
nicku-a Oct 27, 2023
1a21614
Make tutorial code sections collapsible
nicku-a Oct 27, 2023
512062f
Update lesson range
nicku-a Oct 27, 2023
46c0210
Optional WandB tracking
nicku-a Oct 27, 2023
ce8a190
Update AgileRL version and tutorials
nicku-a Nov 10, 2023
0712b2b
Save continuous actions to buffer for MADDPG and MATD3
nicku-a Nov 10, 2023
666184f
Fix pytest version as md docs has minor issues with new versions
elliottower Nov 13, 2023
44df235
Ignore tutorials in documentation testing (done in tutorial tests)
elliottower Nov 13, 2023
0f54f5f
Revert hard coded pytest version
elliottower Nov 13, 2023
c29a908
Add docs/tutorials to ignore
elliottower Nov 13, 2023
213b5fd
Test updating gh action for tutorials
elliottower Nov 13, 2023
a67209c
Merge branch 'master' into master
elliottower Nov 13, 2023
8d13bd0
AgileRL multi agent and version updates
nicku-a Nov 14, 2023
2786e31
Merge branch 'master' of https://github.com/nicku-a/PettingZoo
nicku-a Nov 14, 2023
9b64931
Use latest version of AgileRL
nicku-a Nov 14, 2023
7f45fd0
Slight changes to initial print statements to re-trigger tests
nicku-a Nov 14, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/docs-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -35,4 +35,4 @@ jobs:
run: python docs/_scripts/gen_envs_mds.py
- name: Documentation test
run: |
xvfb-run -s "-screen 0 1024x768x24" pytest docs --markdown-docs -m markdown-docs --splits 10 --group ${{ matrix.group }}
xvfb-run -s "-screen 0 1024x768x24" pytest docs --markdown-docs -m markdown-docs --ignore=tutorials --ignore=docs/tutorials --splits 10 --group ${{ matrix.group }}
2 changes: 1 addition & 1 deletion .github/workflows/linux-tutorials-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ jobs:
fail-fast: false
matrix:
python-version: ['3.8', '3.9', '3.10', '3.11']
tutorial: [Tianshou, CustomEnvironment, CleanRL, SB3/kaz, SB3/waterworld, SB3/connect_four, SB3/test] # TODO: add back AgileRL once issue is fixed on their end
tutorial: [Tianshou, CustomEnvironment, CleanRL, SB3/kaz, SB3/waterworld, SB3/connect_four, SB3/test, AgileRL] # TODO: add back Ray once next release after 2.6.2
steps:
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
Expand Down
1,253 changes: 1,253 additions & 0 deletions docs/tutorials/agilerl/DQN.md

Large diffs are not rendered by default.

Binary file added docs/tutorials/agilerl/connect_four_self_opp.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 2 additions & 0 deletions docs/tutorials/agilerl/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@

These tutorials provide an introductory guide to using [AgileRL](https://github.com/AgileRL/AgileRL) with PettingZoo. AgileRL's multi-agent algorithms make use of the PettingZoo parallel API and allow users to train multiple-agents in parallel in both competitive and co-operative environments. This tutorial includes the following:

* [DQN](DQN.md): _Train a DQN agent to play Connect Four through curriculum learning and self-play_
* [MADDPG](MADDPG.md): _Train an MADDPG agent to play multi-agent atari games_
* [MATD3](MATD3.md): _Train an MATD3 agent to play multi-particle-environment games_

Expand All @@ -28,6 +29,7 @@ For more information about AgileRL and what else the library has to offer, check
:hidden:
:caption: AgileRL

DQN
MADDPG
MATD3
```
Loading