Skip to content
bench

docs: fix links #100

Sign in to view logs

docs: fix links

docs: fix links #100

Triggered via pull request September 17, 2024 19:57
@isahers1isahers1
synchronize #1748
isaac/fixlinks
Status Success
Total duration 45m 15s
Artifacts –

bench.yml

on: pull_request
benchmark
45m 6s
benchmark
Fit to window
Zoom out
Zoom in

Annotations

1 warning and 2 notices
benchmark
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/cache@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Benchmark results: README.md#L1
......................................... fanout_to_subgraph_10x: Mean +- std dev: 55.8 ms +- 1.1 ms ......................................... fanout_to_subgraph_10x_sync: Mean +- std dev: 50.4 ms +- 3.1 ms ......................................... fanout_to_subgraph_10x_checkpoint: Mean +- std dev: 74.2 ms +- 1.5 ms ......................................... fanout_to_subgraph_10x_checkpoint_sync: Mean +- std dev: 77.0 ms +- 0.7 ms ......................................... fanout_to_subgraph_100x: Mean +- std dev: 530 ms +- 11 ms ......................................... fanout_to_subgraph_100x_sync: Mean +- std dev: 470 ms +- 6 ms ......................................... fanout_to_subgraph_100x_checkpoint: Mean +- std dev: 735 ms +- 23 ms ......................................... fanout_to_subgraph_100x_checkpoint_sync: Mean +- std dev: 741 ms +- 9 ms ......................................... react_agent_10x: Mean +- std dev: 38.1 ms +- 0.7 ms ......................................... react_agent_10x_sync: Mean +- std dev: 29.3 ms +- 0.2 ms ......................................... react_agent_10x_checkpoint: Mean +- std dev: 51.9 ms +- 1.7 ms ......................................... react_agent_10x_checkpoint_sync: Mean +- std dev: 38.6 ms +- 0.7 ms ......................................... react_agent_100x: Mean +- std dev: 410 ms +- 16 ms ......................................... react_agent_100x_sync: Mean +- std dev: 336 ms +- 15 ms ......................................... react_agent_100x_checkpoint: Mean +- std dev: 976 ms +- 21 ms ......................................... react_agent_100x_checkpoint_sync: Mean +- std dev: 888 ms +- 22 ms ......................................... wide_state_25x300: Mean +- std dev: 19.9 ms +- 0.3 ms ......................................... wide_state_25x300_sync: Mean +- std dev: 12.0 ms +- 0.2 ms ......................................... wide_state_25x300_checkpoint: Mean +- std dev: 243 ms +- 7 ms ......................................... wide_state_25x300_checkpoint_sync: Mean +- std dev: 233 ms +- 7 ms ......................................... wide_state_15x600: Mean +- std dev: 22.8 ms +- 0.3 ms ......................................... wide_state_15x600_sync: Mean +- std dev: 13.7 ms +- 0.1 ms ......................................... wide_state_15x600_checkpoint: Mean +- std dev: 419 ms +- 16 ms ......................................... wide_state_15x600_checkpoint_sync: Mean +- std dev: 409 ms +- 13 ms ......................................... wide_state_9x1200: Mean +- std dev: 22.8 ms +- 0.3 ms ......................................... wide_state_9x1200_sync: Mean +- std dev: 13.8 ms +- 0.2 ms ......................................... wide_state_9x1200_checkpoint: Mean +- std dev: 270 ms +- 8 ms ......................................... wide_state_9x1200_checkpoint_sync: Mean +- std dev: 265 ms +- 12 ms
Comparison against main: README.md#L1
+----------------------------------------+---------+-----------------------+ | Benchmark | main | changes | +========================================+=========+=======================+ | fanout_to_subgraph_100x | 545 ms | 530 ms: 1.03x faster | +----------------------------------------+---------+-----------------------+ | fanout_to_subgraph_100x_checkpoint | 755 ms | 735 ms: 1.03x faster | +----------------------------------------+---------+-----------------------+ | react_agent_100x | 416 ms | 410 ms: 1.01x faster | +----------------------------------------+---------+-----------------------+ | wide_state_25x300_checkpoint_sync | 235 ms | 233 ms: 1.01x faster | +----------------------------------------+---------+-----------------------+ | fanout_to_subgraph_10x | 56.3 ms | 55.8 ms: 1.01x faster | +----------------------------------------+---------+-----------------------+ | fanout_to_subgraph_10x_checkpoint_sync | 77.7 ms | 77.0 ms: 1.01x faster | +----------------------------------------+---------+-----------------------+ | react_agent_10x_checkpoint_sync | 38.9 ms | 38.6 ms: 1.01x faster | +----------------------------------------+---------+-----------------------+ | fanout_to_subgraph_10x_checkpoint | 74.8 ms | 74.2 ms: 1.01x faster | +----------------------------------------+---------+-----------------------+ | wide_state_25x300_sync | 12.0 ms | 12.0 ms: 1.01x faster | +----------------------------------------+---------+-----------------------+ | wide_state_15x600_sync | 13.8 ms | 13.7 ms: 1.00x faster | +----------------------------------------+---------+-----------------------+ | react_agent_10x_sync | 29.4 ms | 29.3 ms: 1.00x faster | +----------------------------------------+---------+-----------------------+ | wide_state_15x600 | 22.9 ms | 22.8 ms: 1.00x faster | +----------------------------------------+---------+-----------------------+ | wide_state_25x300 | 19.7 ms | 19.9 ms: 1.01x slower | +----------------------------------------+---------+-----------------------+ | wide_state_9x1200_checkpoint_sync | 262 ms | 265 ms: 1.01x slower | +----------------------------------------+---------+-----------------------+ | react_agent_10x_checkpoint | 51.2 ms | 51.9 ms: 1.01x slower | +----------------------------------------+---------+-----------------------+ | wide_state_15x600_checkpoint | 414 ms | 419 ms: 1.01x slower | +----------------------------------------+---------+-----------------------+ | react_agent_100x_checkpoint_sync | 870 ms | 888 ms: 1.02x slower | +----------------------------------------+---------+-----------------------+ | Geometric mean | (ref) | 1.00x faster | +----------------------------------------+---------+-----------------------+ Benchmark hidden because not significant (11): fanout_to_subgraph_10x_sync, react_agent_100x_sync, wide_state_25x300_checkpoint, react_agent_100x_checkpoint, react_agent_10x, wide_state_9x1200, fanout_to_subgraph_100x_sync, wide_state_9x1200_sync, fanout_to_subgraph_100x_checkpoint_sync, wide_state_9x1200_checkpoint, wide_state_15x600_checkpoint_sync