Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] Fix h5py dependency in olddeps #2513

Merged
merged 2 commits into from
Oct 22, 2024
Merged

[CI] Fix h5py dependency in olddeps #2513

merged 2 commits into from
Oct 22, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Oct 22, 2024 •
edited
Loading

Stack from ghstack (oldest at bottom):

@vmoens
Update
9be6bdf 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 22, 2024
@vmoens
[CI] Fix h5py dependency in olddeps
dccd1f1 
ghstack-source-id: c81cf42597ba3ce9470986f49b32ead675c10fbe
Pull Request resolved: #2513
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Oct 22, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2513

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 4 Unrelated Failures

As of commit d0287be with merge base 1431ae5 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 22, 2024
@vmoens
Update
d0287be 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 22, 2024
@vmoens
[CI] Fix h5py dependency in olddeps
e6886d9 
ghstack-source-id: 87936dc1f6a55f89e9a1b2fe99e5c2cd12ae579b
Pull Request resolved: #2513
@vmoens vmoens added Tests Incomplete or broken unit tests CI Has to do with CI setup (e.g. wheels & builds, tests...) labels Oct 22, 2024
@vmoens vmoens merged commit d0287be into gh/vmoens/35/base Oct 22, 2024
69 of 72 checks passed
vmoens added a commit that referenced this pull request Oct 22, 2024
@vmoens
[CI] Fix h5py dependency in olddeps
5244a90 
ghstack-source-id: 87936dc1f6a55f89e9a1b2fe99e5c2cd12ae579b
Pull Request resolved: #2513
@vmoens vmoens deleted the gh/vmoens/35/head branch October 22, 2024 20:12
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 143. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}1$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_simple 0.4143s 0.4125s 2.4239 Ops/s 2.3999 Ops/s $\color{#35bf28}+1.00\%$
test_transformed 0.6950s 0.6058s 1.6507 Ops/s 1.6801 Ops/s $\color{#d91a1a}-1.75\%$
test_serial 1.4446s 1.3629s 0.7338 Ops/s 0.7345 Ops/s $\color{#d91a1a}-0.10\%$
test_parallel 1.4121s 1.3328s 0.7503 Ops/s 0.7403 Ops/s $\color{#35bf28}+1.34\%$
test_step_mdp_speed[True-True-True-True-True] 0.1885ms 28.2889μs 35.3495 KOps/s 34.8574 KOps/s $\color{#35bf28}+1.41\%$
test_step_mdp_speed[True-True-True-True-False] 47.2980μs 16.8341μs 59.4033 KOps/s 58.8942 KOps/s $\color{#35bf28}+0.86\%$
test_step_mdp_speed[True-True-True-False-True] 57.7980μs 15.7590μs 63.4560 KOps/s 62.6980 KOps/s $\color{#35bf28}+1.21\%$
test_step_mdp_speed[True-True-True-False-False] 57.1760μs 9.2818μs 107.7376 KOps/s 106.5878 KOps/s $\color{#35bf28}+1.08\%$
test_step_mdp_speed[True-True-False-True-True] 86.9820μs 30.4168μs 32.8766 KOps/s 32.2059 KOps/s $\color{#35bf28}+2.08\%$
test_step_mdp_speed[True-True-False-True-False] 72.6300μs 18.9511μs 52.7673 KOps/s 51.7421 KOps/s $\color{#35bf28}+1.98\%$
test_step_mdp_speed[True-True-False-False-True] 52.2670μs 17.6433μs 56.6788 KOps/s 53.7831 KOps/s $\textbf{\color{#35bf28}+5.38\%}$
test_step_mdp_speed[True-True-False-False-False] 70.0270μs 11.2068μs 89.2314 KOps/s 85.6917 KOps/s $\color{#35bf28}+4.13\%$
test_step_mdp_speed[True-False-True-True-True] 95.4180μs 32.6097μs 30.6657 KOps/s 30.0409 KOps/s $\color{#35bf28}+2.08\%$
test_step_mdp_speed[True-False-True-True-False] 50.1430μs 21.1403μs 47.3031 KOps/s 46.6276 KOps/s $\color{#35bf28}+1.45\%$
test_step_mdp_speed[True-False-True-False-True] 95.8620μs 18.0664μs 55.3513 KOps/s 55.2970 KOps/s $\color{#35bf28}+0.10\%$
test_step_mdp_speed[True-False-True-False-False] 41.9270μs 11.4651μs 87.2214 KOps/s 86.1979 KOps/s $\color{#35bf28}+1.19\%$
test_step_mdp_speed[True-False-False-True-True] 90.4350μs 34.6244μs 28.8814 KOps/s 28.5271 KOps/s $\color{#35bf28}+1.24\%$
test_step_mdp_speed[True-False-False-True-False] 77.1530μs 23.3873μs 42.7582 KOps/s 42.9216 KOps/s $\color{#d91a1a}-0.38\%$
test_step_mdp_speed[True-False-False-False-True] 54.0510μs 19.9888μs 50.0279 KOps/s 49.1533 KOps/s $\color{#35bf28}+1.78\%$
test_step_mdp_speed[True-False-False-False-False] 54.0100μs 13.3231μs 75.0578 KOps/s 74.3592 KOps/s $\color{#35bf28}+0.94\%$
test_step_mdp_speed[False-True-True-True-True] 98.0160μs 32.3669μs 30.8957 KOps/s 30.0660 KOps/s $\color{#35bf28}+2.76\%$
test_step_mdp_speed[False-True-True-True-False] 82.9440μs 21.0786μs 47.4414 KOps/s 47.3126 KOps/s $\color{#35bf28}+0.27\%$
test_step_mdp_speed[False-True-True-False-True] 62.8370μs 21.3306μs 46.8811 KOps/s 45.1867 KOps/s $\color{#35bf28}+3.75\%$
test_step_mdp_speed[False-True-True-False-False] 46.8670μs 13.0388μs 76.6940 KOps/s 76.0257 KOps/s $\color{#35bf28}+0.88\%$
test_step_mdp_speed[False-True-False-True-True] 87.0130μs 34.6185μs 28.8863 KOps/s 28.5610 KOps/s $\color{#35bf28}+1.14\%$
test_step_mdp_speed[False-True-False-True-False] 57.9880μs 22.8869μs 43.6930 KOps/s 42.5197 KOps/s $\color{#35bf28}+2.76\%$
test_step_mdp_speed[False-True-False-False-True] 2.5479ms 23.0604μs 43.3644 KOps/s 42.9206 KOps/s $\color{#35bf28}+1.03\%$
test_step_mdp_speed[False-True-False-False-False] 45.8650μs 15.0577μs 66.4113 KOps/s 64.7488 KOps/s $\color{#35bf28}+2.57\%$
test_step_mdp_speed[False-False-True-True-True] 87.0320μs 37.2174μs 26.8691 KOps/s 26.3956 KOps/s $\color{#35bf28}+1.79\%$
test_step_mdp_speed[False-False-True-True-False] 62.7270μs 25.2842μs 39.5504 KOps/s 39.0359 KOps/s $\color{#35bf28}+1.32\%$
test_step_mdp_speed[False-False-True-False-True] 81.2810μs 23.1118μs 43.2680 KOps/s 42.5069 KOps/s $\color{#35bf28}+1.79\%$
test_step_mdp_speed[False-False-True-False-False] 48.1700μs 15.2264μs 65.6754 KOps/s 65.8384 KOps/s $\color{#d91a1a}-0.25\%$
test_step_mdp_speed[False-False-False-True-True] 95.1680μs 38.6283μs 25.8877 KOps/s 25.5238 KOps/s $\color{#35bf28}+1.43\%$
test_step_mdp_speed[False-False-False-True-False] 82.5440μs 27.0620μs 36.9521 KOps/s 36.7976 KOps/s $\color{#35bf28}+0.42\%$
test_step_mdp_speed[False-False-False-False-True] 64.1200μs 24.6016μs 40.6478 KOps/s 39.9939 KOps/s $\color{#35bf28}+1.64\%$
test_step_mdp_speed[False-False-False-False-False] 74.5990μs 17.0019μs 58.8171 KOps/s 58.6699 KOps/s $\color{#35bf28}+0.25\%$
test_values[generalized_advantage_estimate-True-True] 10.2742ms 9.6895ms 103.2044 Ops/s 103.3443 Ops/s $\color{#d91a1a}-0.14\%$
test_values[vec_generalized_advantage_estimate-True-True] 36.5287ms 33.5799ms 29.7798 Ops/s 28.9518 Ops/s $\color{#35bf28}+2.86\%$
test_values[td0_return_estimate-False-False] 0.2157ms 0.1689ms 5.9212 KOps/s 5.8785 KOps/s $\color{#35bf28}+0.73\%$
test_values[td1_return_estimate-False-False] 28.0836ms 24.4327ms 40.9287 Ops/s 40.4142 Ops/s $\color{#35bf28}+1.27\%$
test_values[vec_td1_return_estimate-False-False] 36.3210ms 33.6902ms 29.6822 Ops/s 29.2331 Ops/s $\color{#35bf28}+1.54\%$
test_values[td_lambda_return_estimate-True-False] 39.0149ms 35.2420ms 28.3752 Ops/s 28.3649 Ops/s $\color{#35bf28}+0.04\%$
test_values[vec_td_lambda_return_estimate-True-False] 35.8469ms 33.7259ms 29.6508 Ops/s 29.2795 Ops/s $\color{#35bf28}+1.27\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 11.1220ms 8.4975ms 117.6813 Ops/s 118.7219 Ops/s $\color{#d91a1a}-0.88\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.4091ms 1.9132ms 522.6905 Ops/s 504.4293 Ops/s $\color{#35bf28}+3.62\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4805ms 0.3592ms 2.7842 KOps/s 2.8072 KOps/s $\color{#d91a1a}-0.82\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 46.8695ms 44.1546ms 22.6477 Ops/s 21.6869 Ops/s $\color{#35bf28}+4.43\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 4.0727ms 3.0501ms 327.8592 Ops/s 326.8039 Ops/s $\color{#35bf28}+0.32\%$
test_dqn_speed[False-None] 5.8738ms 1.3711ms 729.3345 Ops/s 716.9945 Ops/s $\color{#35bf28}+1.72\%$
test_dqn_speed[False-backward] 1.8885ms 1.8400ms 543.4868 Ops/s 536.6859 Ops/s $\color{#35bf28}+1.27\%$
test_dqn_speed[True-None] 0.6682ms 0.4642ms 2.1542 KOps/s 2.1263 KOps/s $\color{#35bf28}+1.31\%$
test_dqn_speed[True-backward] 1.0932ms 0.9330ms 1.0718 KOps/s 1.1126 KOps/s $\color{#d91a1a}-3.67\%$
test_dqn_speed[reduce-overhead-None] 0.6301ms 0.4706ms 2.1249 KOps/s 2.0933 KOps/s $\color{#35bf28}+1.51\%$
test_dqn_speed[reduce-overhead-backward] 0.9878ms 0.8962ms 1.1158 KOps/s 1.1245 KOps/s $\color{#d91a1a}-0.78\%$
test_ddpg_speed[False-None] 3.6186ms 2.8572ms 349.9938 Ops/s 347.5607 Ops/s $\color{#35bf28}+0.70\%$
test_ddpg_speed[False-backward] 4.1517ms 3.9851ms 250.9364 Ops/s 248.5271 Ops/s $\color{#35bf28}+0.97\%$
test_ddpg_speed[True-None] 1.1493ms 1.0088ms 991.2724 Ops/s 980.3733 Ops/s $\color{#35bf28}+1.11\%$
test_ddpg_speed[True-backward] 1.9789ms 1.9071ms 524.3498 Ops/s 527.8485 Ops/s $\color{#d91a1a}-0.66\%$
test_ddpg_speed[reduce-overhead-None] 1.5312ms 1.0461ms 955.8927 Ops/s 987.8985 Ops/s $\color{#d91a1a}-3.24\%$
test_ddpg_speed[reduce-overhead-backward] 1.9980ms 1.9159ms 521.9489 Ops/s 518.4176 Ops/s $\color{#35bf28}+0.68\%$
test_sac_speed[False-None] 9.6503ms 8.1119ms 123.2761 Ops/s 123.0095 Ops/s $\color{#35bf28}+0.22\%$
test_sac_speed[False-backward] 12.3424ms 10.8900ms 91.8275 Ops/s 91.7658 Ops/s $\color{#35bf28}+0.07\%$
test_sac_speed[True-None] 2.3349ms 1.8571ms 538.4774 Ops/s 535.0740 Ops/s $\color{#35bf28}+0.64\%$
test_sac_speed[True-backward] 3.8553ms 3.5925ms 278.3590 Ops/s 265.5576 Ops/s $\color{#35bf28}+4.82\%$
test_sac_speed[reduce-overhead-None] 2.2660ms 1.8593ms 537.8247 Ops/s 532.1723 Ops/s $\color{#35bf28}+1.06\%$
test_sac_speed[reduce-overhead-backward] 3.6881ms 3.5591ms 280.9729 Ops/s 282.4807 Ops/s $\color{#d91a1a}-0.53\%$
test_redq_speed[False-None] 14.6833ms 12.8680ms 77.7123 Ops/s 76.8482 Ops/s $\color{#35bf28}+1.12\%$
test_redq_speed[False-backward] 24.7374ms 22.3663ms 44.7102 Ops/s 44.6944 Ops/s $\color{#35bf28}+0.04\%$
test_redq_speed[True-None] 5.6216ms 4.6896ms 213.2387 Ops/s 211.3582 Ops/s $\color{#35bf28}+0.89\%$
test_redq_speed[True-backward] 12.8591ms 12.2386ms 81.7086 Ops/s 78.1895 Ops/s $\color{#35bf28}+4.50\%$
test_redq_speed[reduce-overhead-None] 5.7403ms 4.7266ms 211.5708 Ops/s 215.8535 Ops/s $\color{#d91a1a}-1.98\%$
test_redq_speed[reduce-overhead-backward] 13.5238ms 12.1978ms 81.9818 Ops/s 81.4547 Ops/s $\color{#35bf28}+0.65\%$
test_redq_deprec_speed[False-None] 15.2991ms 12.9575ms 77.1751 Ops/s 76.2524 Ops/s $\color{#35bf28}+1.21\%$
test_redq_deprec_speed[False-backward] 20.3829ms 18.5242ms 53.9836 Ops/s 53.3383 Ops/s $\color{#35bf28}+1.21\%$
test_redq_deprec_speed[True-None] 5.4109ms 3.6106ms 276.9627 Ops/s 276.9104 Ops/s $\color{#35bf28}+0.02\%$
test_redq_deprec_speed[True-backward] 9.2268ms 8.0214ms 124.6660 Ops/s 119.6325 Ops/s $\color{#35bf28}+4.21\%$
test_redq_deprec_speed[reduce-overhead-None] 4.9276ms 3.7201ms 268.8134 Ops/s 276.6412 Ops/s $\color{#d91a1a}-2.83\%$
test_redq_deprec_speed[reduce-overhead-backward] 8.6874ms 8.2328ms 121.4648 Ops/s 122.7496 Ops/s $\color{#d91a1a}-1.05\%$
test_td3_speed[False-None] 8.2184ms 7.9556ms 125.6968 Ops/s 124.8668 Ops/s $\color{#35bf28}+0.66\%$
test_td3_speed[False-backward] 11.3218ms 10.3489ms 96.6286 Ops/s 95.8914 Ops/s $\color{#35bf28}+0.77\%$
test_td3_speed[True-None] 1.9906ms 1.7495ms 571.5950 Ops/s 570.1773 Ops/s $\color{#35bf28}+0.25\%$
test_td3_speed[True-backward] 4.0739ms 3.3773ms 296.0976 Ops/s 291.0315 Ops/s $\color{#35bf28}+1.74\%$
test_td3_speed[reduce-overhead-None] 1.9745ms 1.7473ms 572.3242 Ops/s 567.1632 Ops/s $\color{#35bf28}+0.91\%$
test_td3_speed[reduce-overhead-backward] 3.6034ms 3.4108ms 293.1896 Ops/s 297.3433 Ops/s $\color{#d91a1a}-1.40\%$
test_cql_speed[False-None] 39.3499ms 35.9833ms 27.7906 Ops/s 27.4635 Ops/s $\color{#35bf28}+1.19\%$
test_cql_speed[False-backward] 59.5515ms 46.4687ms 21.5199 Ops/s 21.1415 Ops/s $\color{#35bf28}+1.79\%$
test_cql_speed[True-None] 17.4777ms 15.6979ms 63.7027 Ops/s 62.8315 Ops/s $\color{#35bf28}+1.39\%$
test_cql_speed[True-backward] 23.7987ms 22.4958ms 44.4527 Ops/s 43.8148 Ops/s $\color{#35bf28}+1.46\%$
test_cql_speed[reduce-overhead-None] 17.0266ms 15.7165ms 63.6275 Ops/s 62.6224 Ops/s $\color{#35bf28}+1.60\%$
test_cql_speed[reduce-overhead-backward] 23.6869ms 22.4202ms 44.6027 Ops/s 43.9578 Ops/s $\color{#35bf28}+1.47\%$
test_a2c_speed[False-None] 9.4942ms 7.1658ms 139.5525 Ops/s 135.7436 Ops/s $\color{#35bf28}+2.81\%$
test_a2c_speed[False-backward] 15.0599ms 14.2269ms 70.2895 Ops/s 67.3527 Ops/s $\color{#35bf28}+4.36\%$
test_a2c_speed[True-None] 3.7320ms 3.3000ms 303.0300 Ops/s 297.5949 Ops/s $\color{#35bf28}+1.83\%$
test_a2c_speed[True-backward] 10.4863ms 9.8036ms 102.0032 Ops/s 101.1093 Ops/s $\color{#35bf28}+0.88\%$
test_a2c_speed[reduce-overhead-None] 3.8516ms 3.3141ms 301.7431 Ops/s 293.4531 Ops/s $\color{#35bf28}+2.82\%$
test_a2c_speed[reduce-overhead-backward] 10.6781ms 9.8054ms 101.9842 Ops/s 100.9195 Ops/s $\color{#35bf28}+1.06\%$
test_ppo_speed[False-None] 9.2465ms 7.4127ms 134.9041 Ops/s 130.9069 Ops/s $\color{#35bf28}+3.05\%$
test_ppo_speed[False-backward] 15.3847ms 14.5432ms 68.7606 Ops/s 66.0896 Ops/s $\color{#35bf28}+4.04\%$
test_ppo_speed[True-None] 4.4151ms 3.7134ms 269.2934 Ops/s 266.3512 Ops/s $\color{#35bf28}+1.10\%$
test_ppo_speed[True-backward] 9.9361ms 9.5967ms 104.2020 Ops/s 102.7926 Ops/s $\color{#35bf28}+1.37\%$
test_ppo_speed[reduce-overhead-None] 4.8917ms 3.7150ms 269.1772 Ops/s 264.7688 Ops/s $\color{#35bf28}+1.66\%$
test_ppo_speed[reduce-overhead-backward] 10.6237ms 9.6453ms 103.6772 Ops/s 101.5237 Ops/s $\color{#35bf28}+2.12\%$
test_reinforce_speed[False-None] 8.2564ms 6.4816ms 154.2823 Ops/s 151.9794 Ops/s $\color{#35bf28}+1.52\%$
test_reinforce_speed[False-backward] 10.5706ms 9.6885ms 103.2155 Ops/s 100.5565 Ops/s $\color{#35bf28}+2.64\%$
test_reinforce_speed[True-None] 3.2256ms 2.6340ms 379.6576 Ops/s 368.7139 Ops/s $\color{#35bf28}+2.97\%$
test_reinforce_speed[True-backward] 9.4134ms 8.6730ms 115.2999 Ops/s 112.7253 Ops/s $\color{#35bf28}+2.28\%$
test_reinforce_speed[reduce-overhead-None] 3.6077ms 2.7230ms 367.2428 Ops/s 369.9039 Ops/s $\color{#d91a1a}-0.72\%$
test_reinforce_speed[reduce-overhead-backward] 9.2706ms 8.5870ms 116.4547 Ops/s 112.8886 Ops/s $\color{#35bf28}+3.16\%$
test_iql_speed[False-None] 33.1888ms 31.9994ms 31.2506 Ops/s 30.2788 Ops/s $\color{#35bf28}+3.21\%$
test_iql_speed[False-backward] 46.6819ms 45.1588ms 22.1441 Ops/s 21.6706 Ops/s $\color{#35bf28}+2.18\%$
test_iql_speed[True-None] 11.5770ms 10.7337ms 93.1648 Ops/s 91.8268 Ops/s $\color{#35bf28}+1.46\%$
test_iql_speed[True-backward] 23.0987ms 22.0276ms 45.3975 Ops/s 43.5172 Ops/s $\color{#35bf28}+4.32\%$
test_iql_speed[reduce-overhead-None] 11.3749ms 10.6583ms 93.8235 Ops/s 91.0473 Ops/s $\color{#35bf28}+3.05\%$
test_iql_speed[reduce-overhead-backward] 23.0289ms 21.8885ms 45.6861 Ops/s 44.1983 Ops/s $\color{#35bf28}+3.37\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.2687ms 4.9421ms 202.3446 Ops/s 197.3726 Ops/s $\color{#35bf28}+2.52\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 2.1040ms 0.4830ms 2.0705 KOps/s 2.0483 KOps/s $\color{#35bf28}+1.08\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6711ms 0.4549ms 2.1985 KOps/s 2.1383 KOps/s $\color{#35bf28}+2.82\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.9636ms 4.7809ms 209.1673 Ops/s 202.8887 Ops/s $\color{#35bf28}+3.09\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.1140ms 0.4746ms 2.1070 KOps/s 2.0713 KOps/s $\color{#35bf28}+1.72\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6833ms 0.4547ms 2.1994 KOps/s 2.2030 KOps/s $\color{#d91a1a}-0.16\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.9093ms 1.5908ms 628.6130 Ops/s 620.9010 Ops/s $\color{#35bf28}+1.24\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.8009ms 1.5359ms 651.0645 Ops/s 640.4634 Ops/s $\color{#35bf28}+1.66\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.2283ms 4.8930ms 204.3741 Ops/s 199.1827 Ops/s $\color{#35bf28}+2.61\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9786ms 0.6474ms 1.5445 KOps/s 1.5851 KOps/s $\color{#d91a1a}-2.56\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8032ms 0.5893ms 1.6970 KOps/s 1.6553 KOps/s $\color{#35bf28}+2.52\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.4777ms 4.7722ms 209.5487 Ops/s 207.0909 Ops/s $\color{#35bf28}+1.19\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.7835ms 0.4841ms 2.0659 KOps/s 2.0263 KOps/s $\color{#35bf28}+1.95\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7397ms 0.4634ms 2.1580 KOps/s 2.1867 KOps/s $\color{#d91a1a}-1.31\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 7.0174ms 4.7386ms 211.0328 Ops/s 208.5969 Ops/s $\color{#35bf28}+1.17\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.4725ms 0.4785ms 2.0897 KOps/s 2.0437 KOps/s $\color{#35bf28}+2.25\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7108ms 0.4508ms 2.2181 KOps/s 2.1374 KOps/s $\color{#35bf28}+3.78\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.0375ms 5.0603ms 197.6172 Ops/s 200.2335 Ops/s $\color{#d91a1a}-1.31\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8405ms 0.6165ms 1.6220 KOps/s 1.5985 KOps/s $\color{#35bf28}+1.47\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 8.3933ms 0.6069ms 1.6478 KOps/s 1.6326 KOps/s $\color{#35bf28}+0.93\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 5.4613ms 4.2067ms 237.7181 Ops/s 244.9403 Ops/s $\color{#d91a1a}-2.95\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 7.6190ms 2.3533ms 424.9374 Ops/s 439.8227 Ops/s $\color{#d91a1a}-3.38\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 6.3452ms 1.3525ms 739.3713 Ops/s 740.0317 Ops/s $\color{#d91a1a}-0.09\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.4163s 12.4962ms 80.0242 Ops/s 32.9729 Ops/s $\textbf{\color{#35bf28}+142.70\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 7.1685ms 2.2673ms 441.0481 Ops/s 423.2544 Ops/s $\color{#35bf28}+4.20\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 4.1078ms 1.2692ms 787.8778 Ops/s 744.1687 Ops/s $\textbf{\color{#35bf28}+5.87\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 6.0417ms 4.3601ms 229.3520 Ops/s 222.0499 Ops/s $\color{#35bf28}+3.29\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 9.8744ms 2.5951ms 385.3361 Ops/s 406.3096 Ops/s $\textbf{\color{#d91a1a}-5.16\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.1846ms 1.4184ms 705.0124 Ops/s 665.7115 Ops/s $\textbf{\color{#35bf28}+5.90\%}$

@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 143. Improved: $\large\color{#35bf28}20$. Worsened: $\large\color{#d91a1a}7$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_simple 0.7468s 0.7423s 1.3472 Ops/s 1.3095 Ops/s $\color{#35bf28}+2.88\%$
test_transformed 1.0885s 1.0188s 0.9816 Ops/s 1.0112 Ops/s $\color{#d91a1a}-2.93\%$
test_serial 2.2567s 2.1784s 0.4591 Ops/s 0.4550 Ops/s $\color{#35bf28}+0.88\%$
test_parallel 2.0774s 2.0074s 0.4981 Ops/s 0.4938 Ops/s $\color{#35bf28}+0.88\%$
test_step_mdp_speed[True-True-True-True-True] 0.2304ms 38.3369μs 26.0846 KOps/s 25.9736 KOps/s $\color{#35bf28}+0.43\%$
test_step_mdp_speed[True-True-True-True-False] 54.1910μs 22.7449μs 43.9659 KOps/s 44.5175 KOps/s $\color{#d91a1a}-1.24\%$
test_step_mdp_speed[True-True-True-False-True] 47.5910μs 20.7233μs 48.2548 KOps/s 48.4619 KOps/s $\color{#d91a1a}-0.43\%$
test_step_mdp_speed[True-True-True-False-False] 77.9310μs 12.3666μs 80.8629 KOps/s 82.1332 KOps/s $\color{#d91a1a}-1.55\%$
test_step_mdp_speed[True-True-False-True-True] 71.5610μs 41.1861μs 24.2801 KOps/s 25.0308 KOps/s $\color{#d91a1a}-3.00\%$
test_step_mdp_speed[True-True-False-True-False] 55.7210μs 24.8519μs 40.2384 KOps/s 40.8226 KOps/s $\color{#d91a1a}-1.43\%$
test_step_mdp_speed[True-True-False-False-True] 51.0210μs 23.5737μs 42.4202 KOps/s 44.5479 KOps/s $\color{#d91a1a}-4.78\%$
test_step_mdp_speed[True-True-False-False-False] 43.2910μs 15.0266μs 66.5485 KOps/s 68.2878 KOps/s $\color{#d91a1a}-2.55\%$
test_step_mdp_speed[True-False-True-True-True] 84.9620μs 43.6072μs 22.9320 KOps/s 22.8805 KOps/s $\color{#35bf28}+0.22\%$
test_step_mdp_speed[True-False-True-True-False] 0.1035ms 27.6016μs 36.2298 KOps/s 36.4057 KOps/s $\color{#d91a1a}-0.48\%$
test_step_mdp_speed[True-False-True-False-True] 77.0510μs 23.7027μs 42.1893 KOps/s 43.0179 KOps/s $\color{#d91a1a}-1.93\%$
test_step_mdp_speed[True-False-True-False-False] 54.8410μs 14.9232μs 67.0095 KOps/s 68.1995 KOps/s $\color{#d91a1a}-1.74\%$
test_step_mdp_speed[True-False-False-True-True] 87.1020μs 46.6522μs 21.4352 KOps/s 21.7814 KOps/s $\color{#d91a1a}-1.59\%$
test_step_mdp_speed[True-False-False-True-False] 89.4510μs 30.0764μs 33.2487 KOps/s 33.5144 KOps/s $\color{#d91a1a}-0.79\%$
test_step_mdp_speed[True-False-False-False-True] 66.8310μs 25.5703μs 39.1079 KOps/s 39.2833 KOps/s $\color{#d91a1a}-0.45\%$
test_step_mdp_speed[True-False-False-False-False] 61.1310μs 17.4641μs 57.2602 KOps/s 58.1283 KOps/s $\color{#d91a1a}-1.49\%$
test_step_mdp_speed[False-True-True-True-True] 81.5020μs 43.9857μs 22.7347 KOps/s 23.0792 KOps/s $\color{#d91a1a}-1.49\%$
test_step_mdp_speed[False-True-True-True-False] 61.2710μs 27.9452μs 35.7843 KOps/s 36.3276 KOps/s $\color{#d91a1a}-1.50\%$
test_step_mdp_speed[False-True-True-False-True] 54.1410μs 28.2169μs 35.4397 KOps/s 35.2751 KOps/s $\color{#35bf28}+0.47\%$
test_step_mdp_speed[False-True-True-False-False] 42.9610μs 17.3173μs 57.7459 KOps/s 57.2252 KOps/s $\color{#35bf28}+0.91\%$
test_step_mdp_speed[False-True-False-True-True] 85.2610μs 46.5361μs 21.4887 KOps/s 21.6678 KOps/s $\color{#d91a1a}-0.83\%$
test_step_mdp_speed[False-True-False-True-False] 61.4910μs 29.9388μs 33.4014 KOps/s 33.2018 KOps/s $\color{#35bf28}+0.60\%$
test_step_mdp_speed[False-True-False-False-True] 3.2088ms 31.1735μs 32.0786 KOps/s 33.1491 KOps/s $\color{#d91a1a}-3.23\%$
test_step_mdp_speed[False-True-False-False-False] 52.4200μs 19.7883μs 50.5349 KOps/s 51.3170 KOps/s $\color{#d91a1a}-1.52\%$
test_step_mdp_speed[False-False-True-True-True] 84.3820μs 49.0423μs 20.3906 KOps/s 20.4514 KOps/s $\color{#d91a1a}-0.30\%$
test_step_mdp_speed[False-False-True-True-False] 61.6520μs 33.1460μs 30.1696 KOps/s 30.3253 KOps/s $\color{#d91a1a}-0.51\%$
test_step_mdp_speed[False-False-True-False-True] 59.6610μs 30.6697μs 32.6055 KOps/s 32.2648 KOps/s $\color{#35bf28}+1.06\%$
test_step_mdp_speed[False-False-True-False-False] 44.8300μs 19.8108μs 50.4776 KOps/s 50.2692 KOps/s $\color{#35bf28}+0.41\%$
test_step_mdp_speed[False-False-False-True-True] 0.1064ms 51.5187μs 19.4104 KOps/s 19.5713 KOps/s $\color{#d91a1a}-0.82\%$
test_step_mdp_speed[False-False-False-True-False] 72.0310μs 35.9771μs 27.7954 KOps/s 28.0251 KOps/s $\color{#d91a1a}-0.82\%$
test_step_mdp_speed[False-False-False-False-True] 86.5310μs 32.8058μs 30.4824 KOps/s 30.1927 KOps/s $\color{#35bf28}+0.96\%$
test_step_mdp_speed[False-False-False-False-False] 54.4510μs 22.0517μs 45.3480 KOps/s 44.9335 KOps/s $\color{#35bf28}+0.92\%$
test_values[generalized_advantage_estimate-True-True] 25.2182ms 24.8033ms 40.3173 Ops/s 39.5894 Ops/s $\color{#35bf28}+1.84\%$
test_values[vec_generalized_advantage_estimate-True-True] 0.1010s 2.9178ms 342.7194 Ops/s 342.8874 Ops/s $\color{#d91a1a}-0.05\%$
test_values[td0_return_estimate-False-False] 88.1920μs 66.9030μs 14.9470 KOps/s 14.5614 KOps/s $\color{#35bf28}+2.65\%$
test_values[td1_return_estimate-False-False] 56.1797ms 55.1735ms 18.1247 Ops/s 17.9589 Ops/s $\color{#35bf28}+0.92\%$
test_values[vec_td1_return_estimate-False-False] 1.3146ms 1.0863ms 920.5244 Ops/s 919.4684 Ops/s $\color{#35bf28}+0.11\%$
test_values[td_lambda_return_estimate-True-False] 89.8574ms 88.0863ms 11.3525 Ops/s 11.2167 Ops/s $\color{#35bf28}+1.21\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.3393ms 1.0815ms 924.6445 Ops/s 924.0037 Ops/s $\color{#35bf28}+0.07\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 26.4117ms 24.6923ms 40.4985 Ops/s 40.4941 Ops/s $\color{#35bf28}+0.01\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.2429ms 0.7691ms 1.3002 KOps/s 1.3180 KOps/s $\color{#d91a1a}-1.35\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7937ms 0.6731ms 1.4856 KOps/s 1.4828 KOps/s $\color{#35bf28}+0.19\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5141ms 1.4722ms 679.2525 Ops/s 677.9663 Ops/s $\color{#35bf28}+0.19\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.7482ms 0.6837ms 1.4625 KOps/s 1.4574 KOps/s $\color{#35bf28}+0.35\%$
test_dqn_speed[False-None] 6.5762ms 1.3411ms 745.6662 Ops/s 743.8742 Ops/s $\color{#35bf28}+0.24\%$
test_dqn_speed[False-backward] 1.9214ms 1.8748ms 533.3915 Ops/s 531.8401 Ops/s $\color{#35bf28}+0.29\%$
test_dqn_speed[True-None] 0.8971ms 0.5513ms 1.8140 KOps/s 1.6825 KOps/s $\textbf{\color{#35bf28}+7.81\%}$
test_dqn_speed[True-backward] 1.0464ms 1.0036ms 996.3832 Ops/s 891.2839 Ops/s $\textbf{\color{#35bf28}+11.79\%}$
test_dqn_speed[reduce-overhead-None] 0.7936ms 0.5579ms 1.7925 KOps/s 1.7268 KOps/s $\color{#35bf28}+3.81\%$
test_dqn_speed[reduce-overhead-backward] 1.1048ms 1.0142ms 986.0335 Ops/s 978.6899 Ops/s $\color{#35bf28}+0.75\%$
test_ddpg_speed[False-None] 2.9547ms 2.7174ms 367.9985 Ops/s 305.9483 Ops/s $\textbf{\color{#35bf28}+20.28\%}$
test_ddpg_speed[False-backward] 4.0710ms 3.9415ms 253.7081 Ops/s 253.0868 Ops/s $\color{#35bf28}+0.25\%$
test_ddpg_speed[True-None] 1.6059ms 1.2296ms 813.2540 Ops/s 797.8267 Ops/s $\color{#35bf28}+1.93\%$
test_ddpg_speed[True-backward] 2.2993ms 2.2239ms 449.6683 Ops/s 414.5771 Ops/s $\textbf{\color{#35bf28}+8.46\%}$
test_ddpg_speed[reduce-overhead-None] 1.3818ms 1.2388ms 807.2005 Ops/s 793.1651 Ops/s $\color{#35bf28}+1.77\%$
test_ddpg_speed[reduce-overhead-backward] 2.2567ms 2.2044ms 453.6302 Ops/s 449.0210 Ops/s $\color{#35bf28}+1.03\%$
test_sac_speed[False-None] 8.4605ms 7.7164ms 129.5945 Ops/s 129.3392 Ops/s $\color{#35bf28}+0.20\%$
test_sac_speed[False-backward] 11.3509ms 10.9462ms 91.3560 Ops/s 91.3683 Ops/s $\color{#d91a1a}-0.01\%$
test_sac_speed[True-None] 2.3366ms 2.0242ms 494.0296 Ops/s 491.0677 Ops/s $\color{#35bf28}+0.60\%$
test_sac_speed[True-backward] 4.0383ms 3.9441ms 253.5456 Ops/s 248.6381 Ops/s $\color{#35bf28}+1.97\%$
test_sac_speed[reduce-overhead-None] 2.4220ms 2.0348ms 491.4396 Ops/s 487.3295 Ops/s $\color{#35bf28}+0.84\%$
test_sac_speed[reduce-overhead-backward] 4.0374ms 3.9202ms 255.0871 Ops/s 252.3855 Ops/s $\color{#35bf28}+1.07\%$
test_redq_speed[False-None] 16.3906ms 11.7654ms 84.9948 Ops/s 71.2754 Ops/s $\textbf{\color{#35bf28}+19.25\%}$
test_redq_speed[False-backward] 17.8252ms 17.2162ms 58.0847 Ops/s 59.1388 Ops/s $\color{#d91a1a}-1.78\%$
test_redq_speed[True-None] 3.8725ms 3.5895ms 278.5901 Ops/s 283.5501 Ops/s $\color{#d91a1a}-1.75\%$
test_redq_speed[True-backward] 8.8159ms 8.5437ms 117.0448 Ops/s 120.5906 Ops/s $\color{#d91a1a}-2.94\%$
test_redq_speed[reduce-overhead-None] 3.8034ms 3.5438ms 282.1808 Ops/s 286.1941 Ops/s $\color{#d91a1a}-1.40\%$
test_redq_speed[reduce-overhead-backward] 8.7697ms 8.4636ms 118.1532 Ops/s 119.0875 Ops/s $\color{#d91a1a}-0.78\%$
test_redq_deprec_speed[False-None] 10.9820ms 10.5662ms 94.6417 Ops/s 90.0577 Ops/s $\textbf{\color{#35bf28}+5.09\%}$
test_redq_deprec_speed[False-backward] 15.7912ms 15.3304ms 65.2297 Ops/s 61.6330 Ops/s $\textbf{\color{#35bf28}+5.84\%}$
test_redq_deprec_speed[True-None] 3.5385ms 3.2402ms 308.6272 Ops/s 291.8086 Ops/s $\textbf{\color{#35bf28}+5.76\%}$
test_redq_deprec_speed[True-backward] 7.2770ms 7.0716ms 141.4106 Ops/s 117.8145 Ops/s $\textbf{\color{#35bf28}+20.03\%}$
test_redq_deprec_speed[reduce-overhead-None] 4.9873ms 3.2462ms 308.0530 Ops/s 291.0344 Ops/s $\textbf{\color{#35bf28}+5.85\%}$
test_redq_deprec_speed[reduce-overhead-backward] 7.4476ms 7.1291ms 140.2708 Ops/s 126.7501 Ops/s $\textbf{\color{#35bf28}+10.67\%}$
test_td3_speed[False-None] 7.8384ms 7.6048ms 131.4960 Ops/s 128.9897 Ops/s $\color{#35bf28}+1.94\%$
test_td3_speed[False-backward] 10.8033ms 10.4534ms 95.6625 Ops/s 94.1627 Ops/s $\color{#35bf28}+1.59\%$
test_td3_speed[True-None] 1.9407ms 1.8953ms 527.6335 Ops/s 520.5300 Ops/s $\color{#35bf28}+1.36\%$
test_td3_speed[True-backward] 3.8451ms 3.7034ms 270.0251 Ops/s 264.3618 Ops/s $\color{#35bf28}+2.14\%$
test_td3_speed[reduce-overhead-None] 1.9392ms 1.8980ms 526.8581 Ops/s 515.8791 Ops/s $\color{#35bf28}+2.13\%$
test_td3_speed[reduce-overhead-backward] 3.8084ms 3.6976ms 270.4421 Ops/s 269.0668 Ops/s $\color{#35bf28}+0.51\%$
test_cql_speed[False-None] 29.0558ms 25.3449ms 39.4557 Ops/s 40.5424 Ops/s $\color{#d91a1a}-2.68\%$
test_cql_speed[False-backward] 38.0895ms 34.4206ms 29.0524 Ops/s 22.0309 Ops/s $\textbf{\color{#35bf28}+31.87\%}$
test_cql_speed[True-None] 11.2727ms 10.9525ms 91.3037 Ops/s 91.0316 Ops/s $\color{#35bf28}+0.30\%$
test_cql_speed[True-backward] 17.0709ms 16.6223ms 60.1603 Ops/s 60.9166 Ops/s $\color{#d91a1a}-1.24\%$
test_cql_speed[reduce-overhead-None] 11.3442ms 10.9743ms 91.1217 Ops/s 93.0646 Ops/s $\color{#d91a1a}-2.09\%$
test_cql_speed[reduce-overhead-backward] 16.9998ms 16.6088ms 60.2090 Ops/s 61.3069 Ops/s $\color{#d91a1a}-1.79\%$
test_a2c_speed[False-None] 5.7924ms 5.3868ms 185.6389 Ops/s 187.8445 Ops/s $\color{#d91a1a}-1.17\%$
test_a2c_speed[False-backward] 12.0935ms 11.7376ms 85.1961 Ops/s 85.8035 Ops/s $\color{#d91a1a}-0.71\%$
test_a2c_speed[True-None] 3.7372ms 3.0162ms 331.5404 Ops/s 325.7329 Ops/s $\color{#35bf28}+1.78\%$
test_a2c_speed[True-backward] 8.8542ms 8.5650ms 116.7542 Ops/s 114.3851 Ops/s $\color{#35bf28}+2.07\%$
test_a2c_speed[reduce-overhead-None] 3.4392ms 3.0553ms 327.3023 Ops/s 327.1623 Ops/s $\color{#35bf28}+0.04\%$
test_a2c_speed[reduce-overhead-backward] 8.6965ms 8.4314ms 118.6048 Ops/s 118.1440 Ops/s $\color{#35bf28}+0.39\%$
test_ppo_speed[False-None] 6.0710ms 5.7714ms 173.2679 Ops/s 174.3694 Ops/s $\color{#d91a1a}-0.63\%$
test_ppo_speed[False-backward] 12.7141ms 12.3644ms 80.8777 Ops/s 82.8586 Ops/s $\color{#d91a1a}-2.39\%$
test_ppo_speed[True-None] 3.9187ms 3.4677ms 288.3743 Ops/s 281.8346 Ops/s $\color{#35bf28}+2.32\%$
test_ppo_speed[True-backward] 8.6002ms 8.2660ms 120.9772 Ops/s 120.8107 Ops/s $\color{#35bf28}+0.14\%$
test_ppo_speed[reduce-overhead-None] 3.6250ms 3.4570ms 289.2703 Ops/s 288.1129 Ops/s $\color{#35bf28}+0.40\%$
test_ppo_speed[reduce-overhead-backward] 8.3943ms 8.1822ms 122.2171 Ops/s 120.4970 Ops/s $\color{#35bf28}+1.43\%$
test_reinforce_speed[False-None] 4.7798ms 4.4002ms 227.2638 Ops/s 223.4686 Ops/s $\color{#35bf28}+1.70\%$
test_reinforce_speed[False-backward] 7.7699ms 7.3072ms 136.8520 Ops/s 138.3999 Ops/s $\color{#d91a1a}-1.12\%$
test_reinforce_speed[True-None] 2.6356ms 2.2483ms 444.7730 Ops/s 452.5189 Ops/s $\color{#d91a1a}-1.71\%$
test_reinforce_speed[True-backward] 7.2719ms 7.0471ms 141.9023 Ops/s 132.4433 Ops/s $\textbf{\color{#35bf28}+7.14\%}$
test_reinforce_speed[reduce-overhead-None] 2.9240ms 2.2777ms 439.0432 Ops/s 433.0259 Ops/s $\color{#35bf28}+1.39\%$
test_reinforce_speed[reduce-overhead-backward] 7.4564ms 7.0234ms 142.3804 Ops/s 138.3850 Ops/s $\color{#35bf28}+2.89\%$
test_iql_speed[False-None] 20.6010ms 19.0303ms 52.5479 Ops/s 49.4780 Ops/s $\textbf{\color{#35bf28}+6.20\%}$
test_iql_speed[False-backward] 30.2625ms 29.5405ms 33.8518 Ops/s 32.1515 Ops/s $\textbf{\color{#35bf28}+5.29\%}$
test_iql_speed[True-None] 7.0764ms 6.6976ms 149.3075 Ops/s 143.8046 Ops/s $\color{#35bf28}+3.83\%$
test_iql_speed[True-backward] 15.8267ms 15.4904ms 64.5562 Ops/s 61.8702 Ops/s $\color{#35bf28}+4.34\%$
test_iql_speed[reduce-overhead-None] 7.0986ms 6.7444ms 148.2716 Ops/s 146.7318 Ops/s $\color{#35bf28}+1.05\%$
test_iql_speed[reduce-overhead-backward] 16.0653ms 15.4294ms 64.8113 Ops/s 63.8456 Ops/s $\color{#35bf28}+1.51\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.5918ms 6.4165ms 155.8479 Ops/s 156.6499 Ops/s $\color{#d91a1a}-0.51\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.2017ms 0.2915ms 3.4301 KOps/s 3.3164 KOps/s $\color{#35bf28}+3.43\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6053ms 0.3033ms 3.2971 KOps/s 3.3715 KOps/s $\color{#d91a1a}-2.21\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.5661ms 6.2398ms 160.2618 Ops/s 163.0065 Ops/s $\color{#d91a1a}-1.68\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.9119ms 0.2410ms 4.1502 KOps/s 3.2027 KOps/s $\textbf{\color{#35bf28}+29.59\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5318ms 0.2961ms 3.3775 KOps/s 3.5797 KOps/s $\textbf{\color{#d91a1a}-5.65\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.5736ms 1.2383ms 807.5432 Ops/s 761.5019 Ops/s $\textbf{\color{#35bf28}+6.05\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.4314ms 1.1865ms 842.8317 Ops/s 804.7607 Ops/s $\color{#35bf28}+4.73\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.4556ms 6.3480ms 157.5304 Ops/s 158.7842 Ops/s $\color{#d91a1a}-0.79\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.0602ms 0.4423ms 2.2609 KOps/s 2.3428 KOps/s $\color{#d91a1a}-3.50\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7466ms 0.4267ms 2.3433 KOps/s 2.4469 KOps/s $\color{#d91a1a}-4.23\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 10.1580ms 6.5242ms 153.2755 Ops/s 164.3815 Ops/s $\textbf{\color{#d91a1a}-6.76\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.4204s 0.7156ms 1.3973 KOps/s 2.6469 KOps/s $\textbf{\color{#d91a1a}-47.21\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.4063ms 0.2176ms 4.5960 KOps/s 4.4378 KOps/s $\color{#35bf28}+3.57\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.3780ms 6.1642ms 162.2269 Ops/s 166.0974 Ops/s $\color{#d91a1a}-2.33\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8032ms 0.2377ms 4.2062 KOps/s 3.4926 KOps/s $\textbf{\color{#35bf28}+20.43\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5896ms 0.2157ms 4.6360 KOps/s 3.5712 KOps/s $\textbf{\color{#35bf28}+29.81\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.4673ms 6.3637ms 157.1422 Ops/s 156.3222 Ops/s $\color{#35bf28}+0.52\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7891ms 0.3802ms 2.6304 KOps/s 2.5303 KOps/s $\color{#35bf28}+3.95\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.5920ms 0.3612ms 2.7683 KOps/s 2.6331 KOps/s $\textbf{\color{#35bf28}+5.13\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 7.0510ms 5.3352ms 187.4355 Ops/s 185.9011 Ops/s $\color{#35bf28}+0.83\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 10.6097ms 2.3192ms 431.1837 Ops/s 482.9094 Ops/s $\textbf{\color{#d91a1a}-10.71\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.5717ms 1.2347ms 809.8988 Ops/s 827.0766 Ops/s $\color{#d91a1a}-2.08\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.4138s 13.9217ms 71.8305 Ops/s 186.2507 Ops/s $\textbf{\color{#d91a1a}-61.43\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 7.2529ms 1.9876ms 503.1110 Ops/s 489.6229 Ops/s $\color{#35bf28}+2.75\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 8.2228ms 1.2273ms 814.7713 Ops/s 891.4350 Ops/s $\textbf{\color{#d91a1a}-8.60\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.3825s 13.0380ms 76.6988 Ops/s 176.4490 Ops/s $\textbf{\color{#d91a1a}-56.53\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 10.6851ms 2.0936ms 477.6503 Ops/s 462.5416 Ops/s $\color{#35bf28}+3.27\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.5257ms 1.3587ms 735.9725 Ops/s 700.9286 Ops/s $\color{#35bf28}+5.00\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Tests Incomplete or broken unit tests
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot