Update RopeFusion for qwen, gpt-j models to support new pattern SDPA to PA conversion #16368
Job | Run time |
---|---|
25s | |
51m 29s | |
2m 34s | |
10m 22s | |
5m 4s | |
14m 47s | |
4m 32s | |
4m 24s | |
5m 4s | |
42m 19s | |
3m 16s | |
7m 8s | |
7m 45s | |
27m 9s | |
19m 33s | |
1s | |
3h 25m 52s |
Job | Run time |
---|---|
25s | |
51m 29s | |
2m 34s | |
10m 22s | |
5m 4s | |
14m 47s | |
4m 32s | |
4m 24s | |
5m 4s | |
42m 19s | |
3m 16s | |
7m 8s | |
7m 45s | |
27m 9s | |
19m 33s | |
1s | |
3h 25m 52s |