Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[enhance](nereids) add eliminate order by key by uniform #46225

Open
wants to merge 19 commits into
base: master
Choose a base branch
from
Open

[enhance](nereids) add eliminate order by key by uniform #46225

wants to merge 19 commits into from

Conversation

feiniaofeiafei
Copy link
Contributor

@feiniaofeiafei feiniaofeiafei commented Dec 31, 2024 •
edited
Loading

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:
select a,b,c from test where a=1 order by a
->
select a,b,c from test where a=1

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@feiniaofeiafei feiniaofeiafei force-pushed the order_by_key_eliminate_by_uniform branch from 068fbed to bfad26c Compare December 31, 2024 12:31
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32281 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bfad26cc257f8f516650de417d4c4713ed750d2f, data reload: false

------ Round 1 ----------------------------------
q1	17573	6842	6047	6047
q2	2049	308	178	178
q3	10427	1212	728	728
q4	10208	870	439	439
q5	7521	2176	1975	1975
q6	208	178	145	145
q7	892	763	606	606
q8	9243	1362	1151	1151
q9	5262	4874	4953	4874
q10	6738	2307	1835	1835
q11	470	278	262	262
q12	345	357	221	221
q13	17778	3577	2924	2924
q14	230	228	209	209
q15	551	505	510	505
q16	631	617	598	598
q17	560	840	323	323
q18	6968	6405	6311	6311
q19	2133	952	550	550
q20	309	308	182	182
q21	2842	2165	1909	1909
q22	366	335	309	309
Total cold run time: 103304 ms
Total hot run time: 32281 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6292	6248	6223	6223
q2	238	326	233	233
q3	2248	2650	2259	2259
q4	1435	1846	1392	1392
q5	4361	4747	4764	4747
q6	186	175	142	142
q7	2078	1951	1840	1840
q8	2639	2838	2668	2668
q9	7354	7272	7344	7272
q10	3088	3398	2870	2870
q11	571	515	518	515
q12	657	757	621	621
q13	3367	3747	3139	3139
q14	307	299	286	286
q15	567	509	508	508
q16	671	663	656	656
q17	1212	1735	1251	1251
q18	7676	7483	7350	7350
q19	823	1180	1068	1068
q20	2032	2029	1834	1834
q21	5660	5314	4890	4890
q22	597	623	566	566
Total cold run time: 54059 ms
Total hot run time: 52330 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197216 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bfad26cc257f8f516650de417d4c4713ed750d2f, data reload: false

query1	1321	975	913	913
query2	6358	2429	2377	2377
query3	11122	4535	4894	4535
query4	32987	23767	23598	23598
query5	3756	581	425	425
query6	271	198	201	198
query7	3994	511	319	319
query8	308	261	240	240
query9	9358	2738	2734	2734
query10	442	324	243	243
query11	18029	15304	15753	15304
query12	165	108	103	103
query13	1668	522	405	405
query14	11518	6904	7678	6904
query15	247	217	192	192
query16	7947	639	512	512
query17	1541	763	600	600
query18	2072	400	308	308
query19	192	187	159	159
query20	132	115	111	111
query21	206	122	109	109
query22	4752	4602	4516	4516
query23	34784	33479	34068	33479
query24	6486	2304	2376	2304
query25	482	454	393	393
query26	740	275	168	168
query27	2225	459	341	341
query28	5494	2503	2510	2503
query29	649	552	416	416
query30	217	190	154	154
query31	1020	924	833	833
query32	96	62	57	57
query33	535	358	292	292
query34	794	853	534	534
query35	793	850	761	761
query36	1054	1061	960	960
query37	118	106	78	78
query38	4331	4129	4275	4129
query39	1496	1471	1472	1471
query40	212	125	107	107
query41	47	46	42	42
query42	118	108	105	105
query43	531	547	509	509
query44	1318	845	817	817
query45	180	176	181	176
query46	881	1067	658	658
query47	2019	2008	1964	1964
query48	395	417	320	320
query49	717	488	388	388
query50	647	684	399	399
query51	7279	7233	7199	7199
query52	103	105	97	97
query53	229	250	185	185
query54	493	521	413	413
query55	82	91	78	78
query56	261	263	253	253
query57	1277	1248	1166	1166
query58	269	219	234	219
query59	3395	3531	3271	3271
query60	283	278	265	265
query61	130	153	112	112
query62	837	810	761	761
query63	228	204	194	194
query64	3589	1031	649	649
query65	3328	3275	3266	3266
query66	711	421	312	312
query67	16479	15678	15531	15531
query68	8579	760	527	527
query69	483	295	249	249
query70	1192	1140	1167	1140
query71	443	284	256	256
query72	6222	3938	3849	3849
query73	667	773	364	364
query74	10121	9419	9355	9355
query75	4032	3139	2643	2643
query76	3624	1203	830	830
query77	744	376	279	279
query78	10029	10203	9353	9353
query79	3462	921	588	588
query80	748	618	442	442
query81	500	283	234	234
query82	643	159	116	116
query83	191	163	148	148
query84	272	87	77	77
query85	761	358	303	303
query86	359	322	308	308
query87	4586	4426	4583	4426
query88	4243	2231	2223	2223
query89	425	340	288	288
query90	1835	195	189	189
query91	183	141	105	105
query92	62	59	52	52
query93	1310	897	527	527
query94	638	416	309	309
query95	332	274	256	256
query96	491	626	293	293
query97	2741	2833	2689	2689
query98	220	199	202	199
query99	1706	1594	1465	1465
Total cold run time: 297582 ms
Total hot run time: 197216 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.76 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bfad26cc257f8f516650de417d4c4713ed750d2f, data reload: false

query1	0.03	0.03	0.04
query2	0.07	0.03	0.04
query3	0.24	0.08	0.07
query4	1.62	0.10	0.10
query5	0.43	0.42	0.40
query6	1.15	0.66	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.58	0.50	0.50
query10	0.55	0.56	0.55
query11	0.14	0.10	0.10
query12	0.14	0.11	0.12
query13	0.61	0.61	0.60
query14	2.74	2.78	2.88
query15	0.91	0.83	0.83
query16	0.37	0.39	0.38
query17	1.08	1.05	1.08
query18	0.22	0.20	0.20
query19	1.94	1.80	1.95
query20	0.01	0.01	0.01
query21	15.39	0.95	0.60
query22	0.75	0.78	0.63
query23	15.36	1.47	0.56
query24	2.93	1.20	1.74
query25	0.16	0.14	0.21
query26	0.29	0.14	0.14
query27	0.05	0.04	0.05
query28	14.42	1.51	1.06
query29	12.60	3.92	3.25
query30	0.25	0.09	0.07
query31	2.82	0.60	0.38
query32	3.23	0.53	0.46
query33	3.07	3.18	3.18
query34	16.75	5.20	4.56
query35	4.49	4.45	4.60
query36	0.65	0.49	0.49
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.14	0.13
query41	0.09	0.02	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.61 s
Total hot run time: 31.76 s

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@feiniaofeiafei feiniaofeiafei force-pushed the order_by_key_eliminate_by_uniform branch from bfad26c to a0a2765 Compare January 16, 2025 04:18
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32622 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a0a2765f5455eda1751e12fd6f901ee1893dff5a, data reload: false

------ Round 1 ----------------------------------
q1	17659	5660	5354	5354
q2	2046	304	183	183
q3	10529	1301	741	741
q4	10267	979	535	535
q5	8558	2403	2216	2216
q6	201	166	135	135
q7	912	751	628	628
q8	9255	1398	1177	1177
q9	6039	5047	4979	4979
q10	6871	2365	1902	1902
q11	482	290	274	274
q12	354	372	230	230
q13	17777	3753	3128	3128
q14	244	236	210	210
q15	516	473	482	473
q16	625	620	588	588
q17	597	881	331	331
q18	7143	6537	6372	6372
q19	1499	960	564	564
q20	330	344	201	201
q21	3002	2333	2074	2074
q22	377	339	327	327
Total cold run time: 105283 ms
Total hot run time: 32622 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5552	5526	5568	5526
q2	243	343	236	236
q3	2279	2694	2323	2323
q4	1458	1896	1406	1406
q5	4338	4779	4885	4779
q6	171	164	130	130
q7	2095	2032	1863	1863
q8	2657	2866	2735	2735
q9	7280	7317	7237	7237
q10	3042	3257	2777	2777
q11	580	528	507	507
q12	687	784	592	592
q13	3561	3901	3333	3333
q14	273	296	282	282
q15	514	490	467	467
q16	650	697	636	636
q17	1266	1745	1292	1292
q18	7732	7497	7275	7275
q19	864	1176	1080	1080
q20	1956	2049	1903	1903
q21	5778	5453	5010	5010
q22	587	605	561	561
Total cold run time: 53563 ms
Total hot run time: 51950 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187486 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a0a2765f5455eda1751e12fd6f901ee1893dff5a, data reload: false

query1	977	382	380	380
query2	6541	2032	2008	2008
query3	6787	215	229	215
query4	33898	23312	22880	22880
query5	4421	619	479	479
query6	293	205	186	186
query7	4601	496	308	308
query8	303	249	238	238
query9	9630	2684	2681	2681
query10	453	323	251	251
query11	17835	15236	14891	14891
query12	159	110	108	108
query13	1706	518	416	416
query14	9462	6467	7742	6467
query15	263	196	193	193
query16	8537	646	458	458
query17	1666	727	555	555
query18	2090	392	292	292
query19	226	177	180	177
query20	116	108	107	107
query21	208	123	103	103
query22	4219	4411	4319	4319
query23	34104	32861	33181	32861
query24	6694	2325	2338	2325
query25	506	460	379	379
query26	1180	276	151	151
query27	2051	463	332	332
query28	5320	2483	2426	2426
query29	721	544	420	420
query30	228	190	158	158
query31	962	908	805	805
query32	93	63	58	58
query33	544	346	307	307
query34	759	836	499	499
query35	811	814	756	756
query36	1023	1010	950	950
query37	152	105	75	75
query38	4146	4122	4080	4080
query39	1461	1422	1414	1414
query40	204	117	102	102
query41	55	55	52	52
query42	125	107	103	103
query43	508	530	483	483
query44	1338	822	817	817
query45	183	181	164	164
query46	870	1041	641	641
query47	1867	1851	1775	1775
query48	387	401	327	327
query49	790	487	398	398
query50	650	658	404	404
query51	6899	6895	6876	6876
query52	104	106	93	93
query53	225	252	195	195
query54	490	500	398	398
query55	84	88	81	81
query56	261	288	263	263
query57	1170	1146	1061	1061
query58	248	225	237	225
query59	3022	3107	2828	2828
query60	277	312	257	257
query61	121	121	126	121
query62	804	751	662	662
query63	230	191	186	186
query64	4209	1008	655	655
query65	3254	3169	3189	3169
query66	1082	431	312	312
query67	16016	15900	15435	15435
query68	4319	824	537	537
query69	486	293	256	256
query70	1230	1181	1160	1160
query71	394	284	259	259
query72	5860	3911	3970	3911
query73	666	762	360	360
query74	10262	8967	8993	8967
query75	3156	3198	2688	2688
query76	3158	1147	768	768
query77	506	387	275	275
query78	10063	9930	9450	9450
query79	3037	807	602	602
query80	1696	527	446	446
query81	576	272	244	244
query82	369	155	122	122
query83	272	172	150	150
query84	239	95	78	78
query85	783	343	300	300
query86	480	317	307	307
query87	4566	4675	4461	4461
query88	4539	2207	2155	2155
query89	396	358	295	295
query90	1835	187	189	187
query91	143	147	108	108
query92	73	59	57	57
query93	2795	890	532	532
query94	751	407	305	305
query95	386	269	254	254
query96	506	616	284	284
query97	2767	2915	2721	2721
query98	237	196	193	193
query99	1297	1386	1263	1263
Total cold run time: 288462 ms
Total hot run time: 187486 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.49 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a0a2765f5455eda1751e12fd6f901ee1893dff5a, data reload: false

query1	0.04	0.04	0.06
query2	0.07	0.03	0.03
query3	0.24	0.07	0.07
query4	1.60	0.10	0.10
query5	0.44	0.39	0.40
query6	1.14	0.66	0.65
query7	0.02	0.01	0.02
query8	0.04	0.04	0.04
query9	0.57	0.52	0.52
query10	0.59	0.58	0.57
query11	0.15	0.11	0.11
query12	0.14	0.11	0.12
query13	0.62	0.60	0.59
query14	2.84	2.78	2.73
query15	0.90	0.84	0.83
query16	0.38	0.36	0.37
query17	0.96	1.05	1.04
query18	0.23	0.21	0.22
query19	1.88	1.89	1.98
query20	0.01	0.02	0.01
query21	15.35	0.92	0.58
query22	0.76	0.80	0.69
query23	15.31	1.40	0.54
query24	2.86	0.47	2.25
query25	0.28	0.13	0.26
query26	0.25	0.14	0.14
query27	0.05	0.07	0.04
query28	13.83	0.98	0.44
query29	12.62	4.02	3.29
query30	0.25	0.10	0.06
query31	2.82	0.60	0.39
query32	3.22	0.55	0.46
query33	3.00	3.05	3.13
query34	16.76	5.15	4.58
query35	4.60	4.56	4.59
query36	0.66	0.50	0.48
query37	0.09	0.06	0.07
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.16	0.13	0.12
query41	0.08	0.02	0.02
query42	0.03	0.03	0.02
query43	0.03	0.02	0.02
Total cold run time: 105.95 s
Total hot run time: 30.49 s

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32241 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 270fdcdb5c947b9cdacc0fc7997f177454236a83, data reload: false

------ Round 1 ----------------------------------
q1	17587	5541	5405	5405
q2	2058	292	174	174
q3	10452	1215	743	743
q4	10388	967	516	516
q5	9302	2349	2142	2142
q6	199	168	135	135
q7	904	751	603	603
q8	9251	1384	1180	1180
q9	5203	4971	4868	4868
q10	6866	2326	1888	1888
q11	473	272	257	257
q12	344	356	216	216
q13	17780	3721	3092	3092
q14	225	233	213	213
q15	515	474	474	474
q16	627	630	588	588
q17	565	839	325	325
q18	6839	6423	6565	6423
q19	3289	951	524	524
q20	291	313	197	197
q21	2778	2142	1971	1971
q22	369	338	307	307
Total cold run time: 106305 ms
Total hot run time: 32241 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5621	5488	5486	5486
q2	241	325	236	236
q3	2233	2664	2352	2352
q4	1459	1816	1390	1390
q5	4300	4752	4786	4752
q6	170	166	129	129
q7	2051	1992	1817	1817
q8	2635	2840	2689	2689
q9	7348	7251	7303	7251
q10	3047	3288	2703	2703
q11	568	520	484	484
q12	753	772	638	638
q13	3489	3921	3362	3362
q14	300	289	267	267
q15	519	477	471	471
q16	656	680	651	651
q17	1250	1737	1296	1296
q18	7733	7458	7299	7299
q19	814	931	1158	931
q20	1984	2046	1894	1894
q21	5693	5208	5104	5104
q22	608	625	568	568
Total cold run time: 53472 ms
Total hot run time: 51770 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193877 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 270fdcdb5c947b9cdacc0fc7997f177454236a83, data reload: false

query1	1324	951	951	951
query2	6413	2017	2033	2017
query3	11051	4594	4651	4594
query4	33036	23269	23197	23197
query5	3508	617	449	449
query6	272	183	196	183
query7	3979	484	298	298
query8	286	233	212	212
query9	9424	2668	2633	2633
query10	449	308	243	243
query11	17616	15161	14905	14905
query12	140	109	104	104
query13	1566	543	390	390
query14	8639	7061	6443	6443
query15	226	203	191	191
query16	7941	662	517	517
query17	1626	765	606	606
query18	2142	433	344	344
query19	228	196	173	173
query20	133	129	126	126
query21	212	130	106	106
query22	4461	4456	4309	4309
query23	34522	33502	33675	33502
query24	6354	2316	2257	2257
query25	512	455	400	400
query26	813	278	159	159
query27	2111	446	338	338
query28	5951	2485	2508	2485
query29	639	552	430	430
query30	213	191	179	179
query31	919	881	826	826
query32	74	57	60	57
query33	498	371	285	285
query34	757	857	506	506
query35	792	843	769	769
query36	1039	1045	985	985
query37	122	112	79	79
query38	4358	4273	4350	4273
query39	1493	1435	1407	1407
query40	211	118	98	98
query41	51	49	48	48
query42	117	102	111	102
query43	518	518	480	480
query44	1369	837	825	825
query45	184	177	167	167
query46	877	1057	641	641
query47	1927	1929	1872	1872
query48	397	417	333	333
query49	727	532	406	406
query50	685	677	402	402
query51	7130	7001	7013	7001
query52	103	114	91	91
query53	225	261	183	183
query54	501	495	417	417
query55	83	80	84	80
query56	256	273	250	250
query57	1240	1195	1149	1149
query58	254	242	272	242
query59	3083	3234	3015	3015
query60	286	274	255	255
query61	119	113	116	113
query62	779	731	701	701
query63	227	185	191	185
query64	3384	1069	680	680
query65	3282	3140	3150	3140
query66	795	399	291	291
query67	15823	15800	15487	15487
query68	3844	834	519	519
query69	476	291	264	264
query70	1143	1159	1155	1155
query71	394	280	257	257
query72	6195	3835	3772	3772
query73	652	757	361	361
query74	10136	9128	9136	9128
query75	3205	3168	2657	2657
query76	3029	1186	761	761
query77	481	364	270	270
query78	10052	9973	9235	9235
query79	4096	794	580	580
query80	720	525	424	424
query81	504	277	243	243
query82	691	158	125	125
query83	183	174	154	154
query84	247	137	72	72
query85	768	351	301	301
query86	398	330	307	307
query87	4514	4431	4364	4364
query88	4956	2166	2156	2156
query89	402	325	289	289
query90	1791	188	181	181
query91	131	130	106	106
query92	64	56	51	51
query93	2719	878	518	518
query94	689	392	305	305
query95	333	261	254	254
query96	493	618	288	288
query97	2794	2860	2745	2745
query98	225	205	195	195
query99	1414	1367	1258	1258
Total cold run time: 288211 ms
Total hot run time: 193877 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.09 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 270fdcdb5c947b9cdacc0fc7997f177454236a83, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.04	0.03
query3	0.24	0.07	0.07
query4	1.62	0.11	0.11
query5	0.43	0.40	0.39
query6	1.14	0.64	0.65
query7	0.02	0.01	0.01
query8	0.04	0.04	0.02
query9	0.57	0.50	0.50
query10	0.55	0.56	0.54
query11	0.13	0.10	0.10
query12	0.14	0.11	0.12
query13	0.61	0.60	0.61
query14	2.84	2.72	2.71
query15	0.88	0.82	0.82
query16	0.38	0.38	0.37
query17	1.06	1.07	1.04
query18	0.22	0.21	0.21
query19	1.90	1.86	1.94
query20	0.02	0.01	0.01
query21	15.36	0.91	0.61
query22	0.75	0.82	0.61
query23	15.32	1.43	0.58
query24	2.94	1.56	1.30
query25	0.21	0.11	0.09
query26	0.26	0.14	0.14
query27	0.04	0.08	0.05
query28	13.90	1.04	0.43
query29	12.58	3.95	3.32
query30	0.24	0.09	0.07
query31	2.83	0.61	0.39
query32	3.22	0.55	0.46
query33	2.98	3.08	3.01
query34	16.67	5.17	4.53
query35	4.56	4.60	4.54
query36	0.64	0.51	0.50
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.03
query40	0.17	0.14	0.12
query41	0.07	0.02	0.02
query42	0.04	0.03	0.02
query43	0.03	0.04	0.02
Total cold run time: 105.86 s
Total hot run time: 31.09 s

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32247 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6ed5949adee5e86570b1993a54d78e623323bff7, data reload: false

------ Round 1 ----------------------------------
q1	17572	5450	5417	5417
q2	2052	307	180	180
q3	10456	1229	724	724
q4	10213	965	525	525
q5	7520	2390	2151	2151
q6	211	168	132	132
q7	913	735	596	596
q8	9223	1318	1088	1088
q9	5203	4918	4858	4858
q10	6825	2304	1913	1913
q11	481	277	262	262
q12	344	358	221	221
q13	17781	3708	3151	3151
q14	229	231	217	217
q15	508	470	477	470
q16	628	603	599	599
q17	571	853	328	328
q18	6907	6438	6606	6438
q19	1681	956	532	532
q20	308	320	193	193
q21	2954	2169	1949	1949
q22	374	330	303	303
Total cold run time: 102954 ms
Total hot run time: 32247 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5518	5482	5541	5482
q2	249	332	243	243
q3	2248	2659	2345	2345
q4	1425	1863	1378	1378
q5	4271	4692	4648	4648
q6	169	158	125	125
q7	2031	1998	1800	1800
q8	2628	2782	2680	2680
q9	7447	7277	7408	7277
q10	3062	3289	2840	2840
q11	581	512	515	512
q12	634	738	574	574
q13	3521	3904	3240	3240
q14	275	302	281	281
q15	528	475	460	460
q16	656	703	646	646
q17	1223	1734	1281	1281
q18	7734	7352	7472	7352
q19	812	1210	1088	1088
q20	2004	2035	1866	1866
q21	5766	5240	4996	4996
q22	631	643	577	577
Total cold run time: 53413 ms
Total hot run time: 51691 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193999 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6ed5949adee5e86570b1993a54d78e623323bff7, data reload: false

query1	1329	960	944	944
query2	6483	1997	2015	1997
query3	11122	4718	4487	4487
query4	32830	23392	22936	22936
query5	3665	600	476	476
query6	287	201	205	201
query7	3976	489	298	298
query8	300	232	224	224
query9	9245	2626	2634	2626
query10	452	303	241	241
query11	18186	15213	15090	15090
query12	163	111	112	111
query13	1553	533	418	418
query14	10080	6959	6927	6927
query15	263	234	180	180
query16	7896	654	516	516
query17	1583	763	603	603
query18	2135	434	311	311
query19	204	192	170	170
query20	131	136	120	120
query21	213	129	106	106
query22	4654	4550	4420	4420
query23	34478	33814	33440	33440
query24	6829	2390	2350	2350
query25	479	460	421	421
query26	862	278	154	154
query27	2199	462	329	329
query28	5532	2474	2481	2474
query29	648	553	419	419
query30	252	195	155	155
query31	948	881	809	809
query32	77	63	59	59
query33	478	352	310	310
query34	779	895	509	509
query35	806	828	740	740
query36	1045	1063	929	929
query37	122	96	75	75
query38	4366	4342	4270	4270
query39	1518	1455	1453	1453
query40	214	116	105	105
query41	51	52	54	52
query42	115	103	115	103
query43	514	535	478	478
query44	1409	828	819	819
query45	181	173	170	170
query46	855	1041	641	641
query47	1894	1901	1849	1849
query48	393	423	348	348
query49	739	494	416	416
query50	646	662	392	392
query51	7040	7093	6977	6977
query52	103	106	94	94
query53	222	249	186	186
query54	504	499	437	437
query55	82	81	78	78
query56	265	267	250	250
query57	1222	1195	1131	1131
query58	249	243	238	238
query59	3147	3151	3096	3096
query60	281	272	290	272
query61	148	118	114	114
query62	768	730	696	696
query63	231	192	189	189
query64	3396	987	625	625
query65	3277	3189	3149	3149
query66	783	423	297	297
query67	16069	15602	15362	15362
query68	5858	811	511	511
query69	495	286	314	286
query70	1175	1141	1148	1141
query71	386	286	250	250
query72	5821	3851	3841	3841
query73	636	761	357	357
query74	10103	9216	8893	8893
query75	3174	3156	2635	2635
query76	3132	1167	770	770
query77	471	352	279	279
query78	9882	10040	9303	9303
query79	3174	812	581	581
query80	662	537	443	443
query81	508	278	237	237
query82	569	149	121	121
query83	185	167	150	150
query84	238	101	77	77
query85	770	372	292	292
query86	398	335	303	303
query87	4498	4500	4325	4325
query88	4704	2169	2147	2147
query89	412	330	296	296
query90	1791	191	187	187
query91	133	147	114	114
query92	67	56	50	50
query93	2124	871	522	522
query94	687	409	304	304
query95	331	268	257	257
query96	496	610	280	280
query97	2823	2889	2736	2736
query98	217	210	194	194
query99	1304	1379	1255	1255
Total cold run time: 290190 ms
Total hot run time: 193999 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.22 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6ed5949adee5e86570b1993a54d78e623323bff7, data reload: false

query1	0.03	0.05	0.03
query2	0.07	0.04	0.03
query3	0.23	0.08	0.07
query4	1.61	0.11	0.10
query5	0.43	0.42	0.39
query6	1.15	0.65	0.66
query7	0.02	0.01	0.02
query8	0.03	0.03	0.03
query9	0.59	0.51	0.50
query10	0.55	0.57	0.57
query11	0.14	0.10	0.10
query12	0.14	0.11	0.10
query13	0.62	0.60	0.60
query14	2.73	2.80	2.75
query15	0.90	0.83	0.84
query16	0.40	0.37	0.38
query17	0.99	1.06	1.08
query18	0.23	0.21	0.21
query19	1.94	1.87	1.93
query20	0.02	0.01	0.01
query21	15.36	0.94	0.59
query22	0.75	0.79	0.87
query23	15.09	1.50	0.62
query24	2.85	1.72	1.21
query25	0.17	0.18	0.05
query26	0.22	0.14	0.13
query27	0.06	0.05	0.04
query28	14.19	1.02	0.44
query29	12.56	3.94	3.27
query30	0.25	0.10	0.07
query31	2.82	0.59	0.38
query32	3.22	0.55	0.46
query33	2.99	3.11	3.04
query34	16.69	5.18	4.56
query35	4.56	4.60	4.50
query36	0.65	0.50	0.48
query37	0.10	0.06	0.06
query38	0.04	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.14	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.75 s
Total hot run time: 31.22 s

@feiniaofeiafei
Copy link
Contributor Author

run buildall

1 similar comment
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@feiniaofeiafei feiniaofeiafei force-pushed the order_by_key_eliminate_by_uniform branch from 1c14f74 to bb5ff7c Compare January 22, 2025 04:09
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32467 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bb5ff7c9afe5ca518fb4472ca590d2bc29cd9ab7, data reload: false

------ Round 1 ----------------------------------
q1	17605	5455	5366	5366
q2	2048	296	168	168
q3	10432	1256	700	700
q4	10217	962	548	548
q5	7546	2374	2195	2195
q6	192	172	136	136
q7	902	769	606	606
q8	9228	1359	1178	1178
q9	5362	4972	4968	4968
q10	6844	2346	1901	1901
q11	501	275	266	266
q12	353	361	221	221
q13	17784	3689	3129	3129
q14	250	232	214	214
q15	516	467	459	459
q16	619	615	584	584
q17	557	869	323	323
q18	7083	6495	6514	6495
q19	1201	951	523	523
q20	324	324	194	194
q21	3063	2199	1976	1976
q22	378	340	317	317
Total cold run time: 103005 ms
Total hot run time: 32467 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5444	5444	5467	5444
q2	239	328	247	247
q3	2258	2691	2284	2284
q4	1444	1842	1421	1421
q5	4393	4733	4639	4639
q6	163	157	127	127
q7	2095	2057	1855	1855
q8	2694	2809	2645	2645
q9	7266	7247	7360	7247
q10	2988	3505	2833	2833
q11	592	536	494	494
q12	666	755	605	605
q13	3527	3872	3212	3212
q14	295	298	287	287
q15	533	474	462	462
q16	671	676	669	669
q17	1211	1739	1279	1279
q18	7668	7452	7323	7323
q19	786	1020	1126	1020
q20	2006	2016	1875	1875
q21	5712	5328	5061	5061
q22	614	661	567	567
Total cold run time: 53265 ms
Total hot run time: 51596 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186738 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bb5ff7c9afe5ca518fb4472ca590d2bc29cd9ab7, data reload: false

query1	965	396	372	372
query2	6517	1961	1950	1950
query3	6791	224	223	223
query4	33904	23469	23083	23083
query5	4385	623	495	495
query6	286	190	170	170
query7	4608	482	301	301
query8	281	228	217	217
query9	9379	2578	2572	2572
query10	485	303	233	233
query11	17854	15238	14876	14876
query12	156	107	101	101
query13	1636	504	423	423
query14	9997	6385	6501	6385
query15	211	203	187	187
query16	7798	596	475	475
query17	1571	716	541	541
query18	1972	401	296	296
query19	200	183	151	151
query20	118	110	110	110
query21	218	124	103	103
query22	4350	4291	4394	4291
query23	33924	33142	33849	33142
query24	6598	2210	2214	2210
query25	463	433	380	380
query26	1056	248	152	152
query27	2106	475	329	329
query28	5371	2402	2429	2402
query29	523	523	439	439
query30	233	188	150	150
query31	1092	849	808	808
query32	81	62	59	59
query33	544	341	310	310
query34	739	856	492	492
query35	857	838	754	754
query36	997	1020	935	935
query37	119	94	79	79
query38	4136	4196	4102	4102
query39	1452	1374	1404	1374
query40	210	114	102	102
query41	53	55	49	49
query42	121	103	101	101
query43	505	512	475	475
query44	1315	805	798	798
query45	178	186	165	165
query46	851	1032	637	637
query47	1874	1861	1813	1813
query48	388	394	298	298
query49	776	510	435	435
query50	629	695	384	384
query51	6967	6894	6957	6894
query52	103	126	92	92
query53	226	247	184	184
query54	481	488	412	412
query55	82	82	80	80
query56	255	269	242	242
query57	1135	1156	1094	1094
query58	253	233	243	233
query59	2986	3002	2885	2885
query60	303	284	254	254
query61	122	120	125	120
query62	811	714	674	674
query63	221	191	191	191
query64	4308	1004	723	723
query65	3284	3160	3160	3160
query66	1076	440	318	318
query67	15781	15678	15440	15440
query68	4297	823	542	542
query69	463	359	262	262
query70	1197	1156	1080	1080
query71	381	276	254	254
query72	5778	3778	3850	3778
query73	632	745	376	376
query74	9929	9037	8623	8623
query75	3179	3155	2693	2693
query76	3210	1169	776	776
query77	472	379	288	288
query78	9973	10002	9268	9268
query79	3610	801	573	573
query80	722	528	436	436
query81	518	292	240	240
query82	623	159	124	124
query83	172	168	155	155
query84	246	109	76	76
query85	782	364	300	300
query86	396	325	304	304
query87	4458	4366	4445	4366
query88	4849	2201	2134	2134
query89	396	338	299	299
query90	1807	191	192	191
query91	130	139	106	106
query92	70	55	55	55
query93	2361	868	521	521
query94	703	391	263	263
query95	354	262	261	261
query96	500	616	283	283
query97	2789	2869	2731	2731
query98	231	201	191	191
query99	1330	1390	1264	1264
Total cold run time: 285825 ms
Total hot run time: 186738 ms

@feiniaofeiafei feiniaofeiafei force-pushed the order_by_key_eliminate_by_uniform branch 2 times, most recently from c265d55 to f6a714a Compare January 22, 2025 09:16
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@feiniaofeiafei feiniaofeiafei force-pushed the order_by_key_eliminate_by_uniform branch from f6a714a to d097626 Compare January 22, 2025 09:43
@feiniaofeiafei
Copy link
Contributor Author

run p0

1 similar comment
@feiniaofeiafei
Copy link
Contributor Author

run p0

@feiniaofeiafei feiniaofeiafei force-pushed the order_by_key_eliminate_by_uniform branch 2 times, most recently from 080ef94 to dfb7165 Compare January 24, 2025 12:15
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32166 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dfb716597d43b46b8b6d924813d981544c3ad709, data reload: false

------ Round 1 ----------------------------------
q1	17577	5516	5469	5469
q2	2044	309	190	190
q3	10386	1217	749	749
q4	10217	973	536	536
q5	7574	2362	2184	2184
q6	190	168	134	134
q7	903	772	605	605
q8	9255	1359	1119	1119
q9	5259	4817	4974	4817
q10	6863	2315	1872	1872
q11	481	277	248	248
q12	334	360	223	223
q13	17766	3704	3088	3088
q14	230	226	212	212
q15	505	469	474	469
q16	630	628	593	593
q17	567	851	319	319
q18	6834	6374	6392	6374
q19	2122	953	530	530
q20	306	317	185	185
q21	2767	2164	1939	1939
q22	365	335	311	311
Total cold run time: 103175 ms
Total hot run time: 32166 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5581	5537	5517	5517
q2	233	327	236	236
q3	2255	2754	2373	2373
q4	1447	1858	1351	1351
q5	4302	4680	4648	4648
q6	167	157	126	126
q7	2058	1905	1827	1827
q8	2685	2847	2689	2689
q9	7251	7232	7251	7232
q10	3011	3293	2799	2799
q11	576	499	492	492
q12	651	730	583	583
q13	3468	3996	3264	3264
q14	279	304	273	273
q15	538	479	483	479
q16	653	686	656	656
q17	1260	1737	1277	1277
q18	7813	7340	7292	7292
q19	812	1119	1041	1041
q20	1988	2040	1912	1912
q21	5809	5108	4884	4884
q22	627	640	599	599
Total cold run time: 53464 ms
Total hot run time: 51550 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191183 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dfb716597d43b46b8b6d924813d981544c3ad709, data reload: false

query1	1333	955	940	940
query2	6188	2130	2157	2130
query3	11131	4670	4555	4555
query4	32368	23711	22939	22939
query5	4825	636	438	438
query6	292	207	192	192
query7	4000	505	305	305
query8	306	243	227	227
query9	9497	2618	2567	2567
query10	493	324	249	249
query11	17905	15138	15254	15138
query12	165	106	106	106
query13	1575	538	403	403
query14	10936	6332	7021	6332
query15	249	207	197	197
query16	7745	666	496	496
query17	1544	748	598	598
query18	2047	428	344	344
query19	238	194	180	180
query20	137	117	117	117
query21	215	126	110	110
query22	4399	4646	4285	4285
query23	34327	33586	33251	33251
query24	6511	2231	2482	2231
query25	461	497	387	387
query26	791	274	168	168
query27	1983	465	347	347
query28	5708	2461	2463	2461
query29	589	556	416	416
query30	225	187	161	161
query31	976	891	830	830
query32	71	65	59	59
query33	519	352	325	325
query34	750	870	530	530
query35	792	853	766	766
query36	1005	1056	977	977
query37	128	102	87	87
query38	4375	4389	4328	4328
query39	1472	1490	1446	1446
query40	213	115	103	103
query41	53	52	51	51
query42	125	103	102	102
query43	540	549	522	522
query44	1339	820	840	820
query45	181	174	172	172
query46	857	1045	648	648
query47	1872	1915	1867	1867
query48	397	416	319	319
query49	723	498	431	431
query50	645	685	393	393
query51	4297	4283	4248	4248
query52	108	108	96	96
query53	234	262	187	187
query54	498	521	419	419
query55	82	86	83	83
query56	260	271	240	240
query57	1192	1203	1143	1143
query58	255	247	221	221
query59	3390	3501	3115	3115
query60	296	269	265	265
query61	139	131	122	122
query62	794	718	657	657
query63	236	199	199	199
query64	3091	1028	700	700
query65	3297	3283	3450	3283
query66	818	393	294	294
query67	16314	15605	15397	15397
query68	7474	803	524	524
query69	480	298	260	260
query70	1220	1153	1141	1141
query71	378	294	257	257
query72	5117	3934	3869	3869
query73	660	750	358	358
query74	10068	9030	8938	8938
query75	3204	3130	2693	2693
query76	3101	1166	742	742
query77	444	361	285	285
query78	10046	9959	9389	9389
query79	3806	812	572	572
query80	663	527	437	437
query81	489	282	232	232
query82	640	149	120	120
query83	161	169	146	146
query84	248	99	70	70
query85	802	374	301	301
query86	382	321	306	306
query87	4483	4414	4413	4413
query88	4911	2195	2173	2173
query89	402	336	287	287
query90	1785	190	190	190
query91	135	139	150	139
query92	68	57	57	57
query93	2287	881	530	530
query94	713	412	310	310
query95	336	274	257	257
query96	496	594	289	289
query97	2804	2859	2750	2750
query98	237	197	195	195
query99	1283	1365	1238	1238
Total cold run time: 289840 ms
Total hot run time: 191183 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.25 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dfb716597d43b46b8b6d924813d981544c3ad709, data reload: false

query1	0.04	0.04	0.05
query2	0.06	0.04	0.03
query3	0.25	0.07	0.06
query4	1.62	0.10	0.10
query5	0.44	0.41	0.38
query6	1.16	0.65	0.67
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.60	0.49	0.50
query10	0.55	0.55	0.55
query11	0.14	0.10	0.11
query12	0.14	0.12	0.11
query13	0.60	0.60	0.60
query14	2.71	2.72	2.73
query15	0.88	0.81	0.84
query16	0.39	0.38	0.39
query17	1.04	1.02	0.96
query18	0.23	0.20	0.21
query19	1.97	1.87	1.98
query20	0.01	0.01	0.01
query21	15.37	0.90	0.58
query22	0.76	0.77	0.72
query23	15.25	1.39	0.62
query24	3.21	0.48	1.56
query25	0.22	0.19	0.15
query26	0.27	0.14	0.14
query27	0.05	0.05	0.05
query28	13.72	1.01	0.44
query29	12.63	3.93	3.26
query30	0.25	0.09	0.06
query31	2.83	0.59	0.39
query32	3.22	0.56	0.47
query33	3.00	2.99	3.02
query34	16.65	5.30	4.52
query35	4.63	4.51	4.52
query36	0.64	0.51	0.47
query37	0.08	0.06	0.06
query38	0.04	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.13	0.12
query41	0.09	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 106.08 s
Total hot run time: 30.25 s

@feiniaofeiafei feiniaofeiafei force-pushed the order_by_key_eliminate_by_uniform branch from dfb7165 to d56d3b5 Compare January 26, 2025 09:56
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@feiniaofeiafei feiniaofeiafei force-pushed the order_by_key_eliminate_by_uniform branch from a2ec66e to 3619167 Compare January 27, 2025 06:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@feiniaofeiafei @hello-stephen @doris-robot