Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[improve](cloud-mow)Add delete bitmap metrics #47028

Open
wants to merge 14 commits into
base: master
Choose a base branch
from
Open

[improve](cloud-mow)Add delete bitmap metrics #47028

wants to merge 14 commits into from

Conversation

hust-hhb
Copy link
Contributor

Count the max delete bitmap of tablet and base rowset, adn put them to be metrics.

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@hust-hhb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32389 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 095e15695b8bbefeb0d815e858ba5e09cd296da6, data reload: false

------ Round 1 ----------------------------------
q1	17588	5496	5432	5432
q2	2053	289	170	170
q3	10848	1266	760	760
q4	10211	1004	551	551
q5	7547	2409	2183	2183
q6	197	170	136	136
q7	922	770	616	616
q8	9252	1376	1177	1177
q9	5195	4886	4854	4854
q10	6838	2358	1879	1879
q11	489	266	246	246
q12	349	362	217	217
q13	17762	3731	3165	3165
q14	235	241	212	212
q15	526	487	480	480
q16	644	632	588	588
q17	575	876	316	316
q18	7150	6525	6363	6363
q19	3058	958	543	543
q20	306	325	190	190
q21	2981	2175	2008	2008
q22	373	356	303	303
Total cold run time: 105099 ms
Total hot run time: 32389 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5640	5506	5482	5482
q2	240	336	245	245
q3	2297	2694	2358	2358
q4	1372	1801	1364	1364
q5	4388	4793	4821	4793
q6	168	160	128	128
q7	2098	2031	1857	1857
q8	2661	2820	2745	2745
q9	7271	7212	7310	7212
q10	2997	3292	2708	2708
q11	566	511	481	481
q12	701	795	635	635
q13	3651	3963	3288	3288
q14	292	320	279	279
q15	522	469	455	455
q16	654	705	657	657
q17	1249	1759	1295	1295
q18	7785	7410	7310	7310
q19	799	1091	1111	1091
q20	2018	2088	1912	1912
q21	5741	5261	5020	5020
q22	606	598	573	573
Total cold run time: 53716 ms
Total hot run time: 51888 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193878 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 095e15695b8bbefeb0d815e858ba5e09cd296da6, data reload: false

query1	1342	958	947	947
query2	6115	1981	1997	1981
query3	10989	4485	4347	4347
query4	61424	33480	23239	23239
query5	5490	635	478	478
query6	350	207	215	207
query7	4977	488	291	291
query8	301	226	215	215
query9	6299	2673	2656	2656
query10	417	310	237	237
query11	15381	15199	15677	15199
query12	165	120	109	109
query13	1069	538	417	417
query14	11661	7409	6482	6482
query15	232	205	190	190
query16	7154	619	490	490
query17	1071	728	554	554
query18	1397	387	335	335
query19	196	181	150	150
query20	115	113	108	108
query21	211	120	106	106
query22	4428	4651	4339	4339
query23	34032	33504	33491	33491
query24	5578	2337	2356	2337
query25	510	499	467	467
query26	642	275	153	153
query27	1587	477	341	341
query28	3896	2485	2444	2444
query29	528	547	415	415
query30	211	190	157	157
query31	912	888	815	815
query32	66	61	58	58
query33	417	370	295	295
query34	755	837	502	502
query35	792	832	769	769
query36	1040	1060	970	970
query37	116	96	83	83
query38	4337	4332	4224	4224
query39	1698	1455	1466	1455
query40	209	116	102	102
query41	51	51	51	51
query42	123	107	105	105
query43	511	520	487	487
query44	1329	823	815	815
query45	184	178	166	166
query46	890	1073	669	669
query47	1953	1944	1839	1839
query48	395	415	328	328
query49	689	489	411	411
query50	664	668	405	405
query51	7144	6995	7061	6995
query52	110	102	92	92
query53	231	248	187	187
query54	509	521	428	428
query55	78	81	82	81
query56	279	260	274	260
query57	1204	1211	1151	1151
query58	252	254	234	234
query59	2975	3056	2859	2859
query60	285	264	254	254
query61	113	116	118	116
query62	705	706	645	645
query63	229	189	185	185
query64	1327	1013	736	736
query65	3266	3146	3189	3146
query66	691	386	299	299
query67	15794	15576	15289	15289
query68	4976	836	536	536
query69	510	291	257	257
query70	1163	1131	1146	1131
query71	423	306	287	287
query72	6104	3881	3804	3804
query73	792	758	372	372
query74	10131	9026	8933	8933
query75	3205	3157	2662	2662
query76	3779	1150	769	769
query77	500	381	292	292
query78	10164	9951	9446	9446
query79	4360	787	583	583
query80	1673	543	447	447
query81	553	293	235	235
query82	607	164	126	126
query83	273	180	150	150
query84	283	190	76	76
query85	788	349	295	295
query86	460	318	310	310
query87	4516	4516	4380	4380
query88	4744	2196	2248	2196
query89	399	323	286	286
query90	1577	189	192	189
query91	136	136	112	112
query92	63	55	50	50
query93	2871	862	545	545
query94	821	384	293	293
query95	330	267	259	259
query96	494	607	283	283
query97	2809	2863	2740	2740
query98	232	200	194	194
query99	1301	1353	1252	1252
Total cold run time: 311128 ms
Total hot run time: 193878 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 41.01% (10687/26061)
Line Coverage: 31.51% (90293/286544)
Region Coverage: 30.67% (46263/150828)
Branch Coverage: 26.83% (23447/87386)
Coverage Report: http://coverage.selectdb-in.cc/coverage/095e15695b8bbefeb0d815e858ba5e09cd296da6_095e15695b8bbefeb0d815e858ba5e09cd296da6/report/index.html

@doris-robot
Copy link

ClickBench: Total hot run time: 30.71 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 095e15695b8bbefeb0d815e858ba5e09cd296da6, data reload: false

query1	0.04	0.05	0.03
query2	0.07	0.04	0.03
query3	0.23	0.07	0.07
query4	1.62	0.10	0.10
query5	0.41	0.41	0.41
query6	1.16	0.66	0.66
query7	0.03	0.01	0.01
query8	0.04	0.03	0.03
query9	0.59	0.51	0.51
query10	0.55	0.57	0.56
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.62	0.60
query14	2.72	2.81	2.87
query15	0.90	0.83	0.82
query16	0.37	0.38	0.39
query17	1.07	1.07	1.09
query18	0.23	0.21	0.21
query19	1.91	2.01	1.78
query20	0.01	0.01	0.02
query21	15.36	0.88	0.57
query22	0.75	0.76	0.54
query23	15.46	1.39	0.57
query24	3.37	1.39	1.02
query25	0.27	0.09	0.15
query26	0.24	0.14	0.13
query27	0.05	0.05	0.05
query28	14.04	1.00	0.42
query29	12.55	3.95	3.28
query30	0.25	0.10	0.06
query31	2.81	0.60	0.38
query32	3.23	0.55	0.46
query33	3.02	3.05	3.05
query34	16.63	5.13	4.52
query35	4.50	4.50	4.55
query36	0.84	0.48	0.49
query37	0.10	0.07	0.06
query38	0.06	0.03	0.03
query39	0.04	0.02	0.03
query40	0.17	0.12	0.14
query41	0.08	0.02	0.02
query42	0.04	0.02	0.03
query43	0.03	0.02	0.03
Total cold run time: 106.73 s
Total hot run time: 30.71 s

@hust-hhb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32515 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 45a178d4c6cb2dabefe6dc75d75599bb366edb42, data reload: false

------ Round 1 ----------------------------------
q1	17610	5633	5456	5456
q2	2050	323	178	178
q3	10486	1236	747	747
q4	10262	971	520	520
q5	8300	2393	2174	2174
q6	198	167	136	136
q7	925	759	613	613
q8	9221	1372	1152	1152
q9	5317	4912	4925	4912
q10	6854	2333	1876	1876
q11	467	274	255	255
q12	342	350	232	232
q13	17767	3723	3151	3151
q14	237	228	212	212
q15	512	472	478	472
q16	634	622	605	605
q17	571	870	330	330
q18	7005	6487	6437	6437
q19	2134	973	544	544
q20	320	321	197	197
q21	2824	2233	2013	2013
q22	377	340	303	303
Total cold run time: 104413 ms
Total hot run time: 32515 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5617	5492	5551	5492
q2	239	330	232	232
q3	2290	2635	2339	2339
q4	1405	1884	1359	1359
q5	4328	4808	4755	4755
q6	173	161	125	125
q7	2096	1953	1834	1834
q8	2655	2848	2714	2714
q9	7323	7235	7311	7235
q10	3040	3293	2726	2726
q11	564	517	481	481
q12	642	737	601	601
q13	3526	3922	3301	3301
q14	278	313	266	266
q15	531	486	466	466
q16	660	683	648	648
q17	1245	1729	1257	1257
q18	7810	7576	7323	7323
q19	795	1152	1091	1091
q20	2035	2037	1874	1874
q21	5853	5131	5018	5018
q22	616	614	551	551
Total cold run time: 53721 ms
Total hot run time: 51688 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195104 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 45a178d4c6cb2dabefe6dc75d75599bb366edb42, data reload: false

query1	1322	993	933	933
query2	6274	2054	2053	2053
query3	11100	4652	4690	4652
query4	32642	23233	23353	23233
query5	3654	618	454	454
query6	283	202	184	184
query7	3991	475	301	301
query8	298	246	232	232
query9	9044	2560	2564	2560
query10	489	306	256	256
query11	17774	15278	15113	15113
query12	168	108	105	105
query13	1575	532	389	389
query14	9465	7512	7469	7469
query15	244	211	196	196
query16	8480	672	517	517
query17	1623	764	557	557
query18	2164	407	315	315
query19	223	191	186	186
query20	135	134	119	119
query21	210	124	116	116
query22	4513	4363	4337	4337
query23	34374	33505	33416	33416
query24	6536	2339	2318	2318
query25	506	464	390	390
query26	784	269	166	166
query27	2122	484	332	332
query28	5183	2467	2464	2464
query29	659	600	422	422
query30	209	196	154	154
query31	931	892	818	818
query32	91	63	54	54
query33	521	354	291	291
query34	749	867	505	505
query35	788	860	786	786
query36	1045	1046	984	984
query37	117	98	81	81
query38	4218	4377	4297	4297
query39	1500	1449	1432	1432
query40	214	114	103	103
query41	51	54	50	50
query42	127	105	108	105
query43	530	532	492	492
query44	1309	819	827	819
query45	183	177	169	169
query46	868	1059	641	641
query47	1884	1887	1842	1842
query48	380	403	327	327
query49	757	480	404	404
query50	656	691	400	400
query51	7241	7168	7007	7007
query52	103	97	90	90
query53	225	258	180	180
query54	494	489	419	419
query55	81	80	83	80
query56	277	264	246	246
query57	1228	1214	1121	1121
query58	246	230	231	230
query59	3167	3214	3138	3138
query60	286	264	262	262
query61	140	131	171	131
query62	814	728	683	683
query63	232	186	185	185
query64	3254	1052	681	681
query65	3282	3159	3161	3159
query66	774	395	294	294
query67	16271	15500	15645	15500
query68	5328	820	530	530
query69	509	292	259	259
query70	1156	1133	1065	1065
query71	398	276	254	254
query72	5982	3865	3865	3865
query73	641	757	352	352
query74	10238	9091	8919	8919
query75	3181	3137	2639	2639
query76	3062	1143	771	771
query77	472	370	274	274
query78	10124	10095	9362	9362
query79	3050	777	584	584
query80	687	511	441	441
query81	512	284	241	241
query82	375	153	125	125
query83	173	161	160	160
query84	236	94	72	72
query85	785	356	354	354
query86	385	313	293	293
query87	4409	4515	4338	4338
query88	4901	2121	2099	2099
query89	390	317	291	291
query90	1840	185	193	185
query91	136	146	106	106
query92	65	57	53	53
query93	2442	871	530	530
query94	652	408	265	265
query95	332	261	243	243
query96	484	670	288	288
query97	2771	2793	2734	2734
query98	226	200	199	199
query99	1296	1353	1268	1268
Total cold run time: 288316 ms
Total hot run time: 195104 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.9 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 45a178d4c6cb2dabefe6dc75d75599bb366edb42, data reload: false

query1	0.04	0.03	0.04
query2	0.07	0.03	0.04
query3	0.23	0.07	0.07
query4	1.63	0.10	0.11
query5	0.42	0.44	0.39
query6	1.15	0.64	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.60	0.51	0.50
query10	0.56	0.55	0.56
query11	0.15	0.11	0.10
query12	0.14	0.11	0.11
query13	0.60	0.60	0.61
query14	2.84	2.82	2.73
query15	0.91	0.82	0.83
query16	0.37	0.37	0.39
query17	1.02	1.01	1.02
query18	0.23	0.21	0.20
query19	1.89	1.87	2.02
query20	0.02	0.01	0.02
query21	15.37	0.93	0.56
query22	0.76	0.71	0.73
query23	15.33	1.51	0.56
query24	3.04	1.41	1.07
query25	0.11	0.16	0.11
query26	0.37	0.16	0.13
query27	0.05	0.04	0.04
query28	14.02	0.99	0.43
query29	12.55	4.02	3.32
query30	0.25	0.09	0.06
query31	2.82	0.59	0.39
query32	3.23	0.56	0.46
query33	2.98	3.03	3.02
query34	16.31	5.16	4.52
query35	4.61	4.60	4.55
query36	0.63	0.50	0.49
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.03
query40	0.17	0.13	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.84 s
Total hot run time: 30.9 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 41.01% (10689/26065)
Line Coverage: 31.50% (90308/286697)
Region Coverage: 30.68% (46281/150855)
Branch Coverage: 26.83% (23450/87408)
Coverage Report: http://coverage.selectdb-in.cc/coverage/45a178d4c6cb2dabefe6dc75d75599bb366edb42_45a178d4c6cb2dabefe6dc75d75599bb366edb42/report/index.html

@hust-hhb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32477 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 590c2c4852d83ef64bbb3f1bb9cf377676acd9c9, data reload: false

------ Round 1 ----------------------------------
q1	17607	5575	5370	5370
q2	2057	331	179	179
q3	10459	1297	745	745
q4	10225	1009	548	548
q5	7719	2454	2195	2195
q6	204	172	138	138
q7	920	755	627	627
q8	9239	1383	1215	1215
q9	5236	4961	4874	4874
q10	6847	2341	1899	1899
q11	465	289	268	268
q12	350	356	221	221
q13	17762	3715	3087	3087
q14	242	228	209	209
q15	509	493	453	453
q16	627	622	572	572
q17	574	878	335	335
q18	7430	6629	6485	6485
q19	3416	950	541	541
q20	308	321	191	191
q21	2822	2204	2016	2016
q22	370	339	309	309
Total cold run time: 105388 ms
Total hot run time: 32477 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5588	5473	5469	5469
q2	241	346	239	239
q3	2241	2701	2352	2352
q4	1455	1840	1351	1351
q5	4386	4815	4883	4815
q6	181	163	134	134
q7	2093	2009	1867	1867
q8	2665	2827	2713	2713
q9	7237	7190	7264	7190
q10	2986	3252	2792	2792
q11	600	528	503	503
q12	697	826	653	653
q13	3513	3925	3284	3284
q14	274	290	269	269
q15	521	482	486	482
q16	665	676	647	647
q17	1239	1749	1270	1270
q18	7740	7489	7217	7217
q19	802	1149	1118	1118
q20	1985	2081	1932	1932
q21	5924	5289	4924	4924
q22	613	601	596	596
Total cold run time: 53646 ms
Total hot run time: 51817 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187704 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 590c2c4852d83ef64bbb3f1bb9cf377676acd9c9, data reload: false

query1	978	409	370	370
query2	6529	2052	1988	1988
query3	6792	227	211	211
query4	33942	23591	23325	23325
query5	4376	622	451	451
query6	299	229	206	206
query7	4609	518	307	307
query8	290	244	242	242
query9	9629	2721	2698	2698
query10	495	327	258	258
query11	17879	15386	14992	14992
query12	160	109	109	109
query13	1666	539	407	407
query14	10486	6683	7075	6683
query15	246	198	189	189
query16	8010	623	447	447
query17	1607	729	550	550
query18	2068	413	299	299
query19	221	172	155	155
query20	113	106	107	106
query21	213	129	100	100
query22	4175	4441	4096	4096
query23	34228	32860	32947	32860
query24	6503	2324	2252	2252
query25	482	456	384	384
query26	1215	275	158	158
query27	1964	464	333	333
query28	4876	2449	2424	2424
query29	706	541	411	411
query30	234	180	158	158
query31	918	877	789	789
query32	74	65	59	59
query33	515	370	300	300
query34	738	856	507	507
query35	800	862	738	738
query36	1011	1049	955	955
query37	121	105	83	83
query38	4290	4069	4077	4069
query39	1429	1386	1439	1386
query40	216	117	100	100
query41	52	51	53	51
query42	117	107	107	107
query43	511	522	489	489
query44	1400	813	806	806
query45	184	169	169	169
query46	859	1048	641	641
query47	1794	1813	1757	1757
query48	381	422	314	314
query49	783	501	407	407
query50	644	669	407	407
query51	6929	6758	6716	6716
query52	102	102	91	91
query53	223	255	184	184
query54	503	493	437	437
query55	81	80	79	79
query56	260	263	262	262
query57	1193	1175	1131	1131
query58	243	232	239	232
query59	2957	2993	2951	2951
query60	272	272	259	259
query61	116	113	117	113
query62	822	710	650	650
query63	233	192	191	191
query64	4331	1027	650	650
query65	3271	3187	3137	3137
query66	1061	440	308	308
query67	15932	15532	15528	15528
query68	4331	854	548	548
query69	452	292	271	271
query70	1226	1144	1163	1144
query71	386	298	254	254
query72	5885	3852	3819	3819
query73	654	769	365	365
query74	10329	9152	8926	8926
query75	3162	3202	2685	2685
query76	3197	1224	796	796
query77	590	375	286	286
query78	10025	10066	9384	9384
query79	2639	833	610	610
query80	1673	550	449	449
query81	581	278	247	247
query82	353	155	126	126
query83	261	217	154	154
query84	249	98	73	73
query85	773	345	302	302
query86	475	326	300	300
query87	4476	4460	4359	4359
query88	3763	2222	2188	2188
query89	402	331	289	289
query90	1771	195	194	194
query91	129	137	109	109
query92	64	63	55	55
query93	1305	883	539	539
query94	695	418	299	299
query95	339	272	254	254
query96	497	626	283	283
query97	2799	2876	2732	2732
query98	226	199	196	196
query99	1293	1345	1246	1246
Total cold run time: 285357 ms
Total hot run time: 187704 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.99 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 590c2c4852d83ef64bbb3f1bb9cf377676acd9c9, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.07
query4	1.62	0.10	0.10
query5	0.44	0.43	0.41
query6	1.17	0.65	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.58	0.49	0.52
query10	0.54	0.56	0.54
query11	0.14	0.10	0.10
query12	0.13	0.11	0.11
query13	0.62	0.61	0.60
query14	2.75	2.82	2.86
query15	0.90	0.84	0.83
query16	0.37	0.38	0.37
query17	1.08	1.07	1.08
query18	0.23	0.21	0.21
query19	1.99	1.88	2.01
query20	0.02	0.01	0.01
query21	15.38	0.92	0.59
query22	0.76	0.85	0.70
query23	15.25	1.36	0.56
query24	3.02	1.93	1.00
query25	0.19	0.10	0.12
query26	0.34	0.14	0.14
query27	0.06	0.06	0.06
query28	13.78	0.99	0.43
query29	12.59	3.89	3.26
query30	0.25	0.10	0.06
query31	2.82	0.61	0.40
query32	3.23	0.56	0.47
query33	2.99	3.08	3.12
query34	16.86	5.17	4.51
query35	4.54	4.53	4.49
query36	0.65	0.48	0.48
query37	0.09	0.05	0.06
query38	0.04	0.04	0.03
query39	0.04	0.03	0.02
query40	0.17	0.14	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.2 s
Total hot run time: 30.99 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 41.51% (10821/26068)
Line Coverage: 31.91% (91451/286600)
Region Coverage: 31.06% (46843/150817)
Branch Coverage: 27.15% (23722/87374)
Coverage Report: http://coverage.selectdb-in.cc/coverage/590c2c4852d83ef64bbb3f1bb9cf377676acd9c9_590c2c4852d83ef64bbb3f1bb9cf377676acd9c9/report/index.html

@dataroaring dataroaring reopened this Jan 26, 2025
@dataroaring
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32019 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 53b0069b09a56d4bfc772dd30ab10db70f72643a, data reload: false

------ Round 1 ----------------------------------
q1	17595	5478	5315	5315
q2	2040	289	169	169
q3	10524	1190	745	745
q4	10220	943	525	525
q5	7600	2382	2122	2122
q6	184	167	131	131
q7	895	757	593	593
q8	9217	1322	1134	1134
q9	5284	4863	4833	4833
q10	6878	2324	1886	1886
q11	471	270	253	253
q12	343	353	223	223
q13	17762	3659	3050	3050
q14	228	233	215	215
q15	514	463	451	451
q16	635	631	604	604
q17	542	855	325	325
q18	6961	6450	6500	6450
q19	1839	948	531	531
q20	306	317	187	187
q21	2806	2180	1965	1965
q22	369	331	312	312
Total cold run time: 103213 ms
Total hot run time: 32019 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5564	5585	5351	5351
q2	250	333	244	244
q3	2336	2700	2366	2366
q4	1458	1875	1428	1428
q5	4292	4728	4664	4664
q6	168	160	127	127
q7	2014	2013	1809	1809
q8	2645	2785	2717	2717
q9	7354	7201	7254	7201
q10	3061	3296	2803	2803
q11	588	514	506	506
q12	617	736	583	583
q13	3517	3979	3302	3302
q14	291	299	275	275
q15	535	482	459	459
q16	655	710	650	650
q17	1228	1695	1255	1255
q18	7567	7530	7429	7429
q19	788	1125	1071	1071
q20	2020	2021	1880	1880
q21	5755	5157	4939	4939
q22	617	581	571	571
Total cold run time: 53320 ms
Total hot run time: 51630 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191573 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 53b0069b09a56d4bfc772dd30ab10db70f72643a, data reload: false

query1	1310	947	943	943
query2	6167	2016	2016	2016
query3	11098	4620	4602	4602
query4	61543	28805	23353	23353
query5	5413	593	442	442
query6	430	191	180	180
query7	5491	499	301	301
query8	334	261	229	229
query9	8027	2586	2582	2582
query10	439	313	251	251
query11	17348	15038	15355	15038
query12	168	115	112	112
query13	1411	536	426	426
query14	11270	6670	7115	6670
query15	212	200	193	193
query16	7515	677	442	442
query17	1139	759	596	596
query18	1992	429	332	332
query19	211	193	163	163
query20	121	109	114	109
query21	208	123	106	106
query22	4756	4696	4658	4658
query23	34079	33919	33383	33383
query24	5548	2329	2367	2329
query25	472	462	410	410
query26	676	278	151	151
query27	1863	459	331	331
query28	4209	2509	2435	2435
query29	533	587	414	414
query30	218	189	154	154
query31	943	895	767	767
query32	67	59	55	55
query33	455	364	292	292
query34	771	867	517	517
query35	836	832	764	764
query36	1041	1070	988	988
query37	123	104	76	76
query38	4480	4224	4310	4224
query39	1497	1444	1475	1444
query40	202	121	103	103
query41	51	54	49	49
query42	121	103	104	103
query43	524	535	495	495
query44	1411	828	835	828
query45	183	176	171	171
query46	879	1071	658	658
query47	1934	1943	1821	1821
query48	383	401	324	324
query49	707	489	406	406
query50	670	681	390	390
query51	4318	4337	4199	4199
query52	103	101	93	93
query53	236	250	193	193
query54	472	494	410	410
query55	89	78	87	78
query56	258	267	252	252
query57	1205	1209	1236	1209
query58	254	233	225	225
query59	3143	3289	3130	3130
query60	280	259	243	243
query61	122	117	117	117
query62	694	724	646	646
query63	214	184	183	183
query64	1687	1058	636	636
query65	3251	3184	3199	3184
query66	651	387	296	296
query67	16058	15795	15478	15478
query68	4990	817	544	544
query69	480	302	251	251
query70	1226	1159	1121	1121
query71	418	279	260	260
query72	6028	3891	3776	3776
query73	800	749	356	356
query74	9393	8832	8884	8832
query75	3221	3154	2667	2667
query76	3824	1179	770	770
query77	476	341	262	262
query78	10159	10169	9282	9282
query79	2967	803	600	600
query80	1621	513	434	434
query81	545	273	247	247
query82	346	143	117	117
query83	265	173	222	173
query84	289	102	70	70
query85	768	349	298	298
query86	430	323	314	314
query87	4420	4440	4429	4429
query88	3325	2201	2141	2141
query89	394	323	294	294
query90	1584	189	189	189
query91	133	130	112	112
query92	60	57	53	53
query93	1799	870	530	530
query94	691	390	296	296
query95	327	253	333	253
query96	479	602	291	291
query97	2825	2875	2753	2753
query98	215	195	191	191
query99	1303	1378	1269	1269
Total cold run time: 310315 ms
Total hot run time: 191573 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.55 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 53b0069b09a56d4bfc772dd30ab10db70f72643a, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.03	0.03
query3	0.24	0.06	0.06
query4	1.63	0.11	0.11
query5	0.42	0.41	0.40
query6	1.14	0.65	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.59	0.51	0.51
query10	0.55	0.55	0.56
query11	0.14	0.10	0.11
query12	0.15	0.11	0.11
query13	0.61	0.60	0.60
query14	2.72	2.76	2.88
query15	0.88	0.83	0.82
query16	0.40	0.39	0.38
query17	1.02	1.06	1.09
query18	0.22	0.21	0.22
query19	1.91	1.87	2.05
query20	0.01	0.01	0.01
query21	15.36	0.91	0.58
query22	0.74	0.79	0.67
query23	15.30	1.40	0.63
query24	2.61	0.63	1.82
query25	0.22	0.07	0.09
query26	0.28	0.14	0.14
query27	0.06	0.05	0.05
query28	13.87	1.02	0.42
query29	12.57	3.97	3.28
query30	0.26	0.08	0.06
query31	2.83	0.61	0.38
query32	3.23	0.55	0.47
query33	3.08	3.02	3.01
query34	16.63	5.16	4.54
query35	4.64	4.54	4.54
query36	0.62	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.17	0.13	0.12
query41	0.08	0.02	0.02
query42	0.03	0.03	0.02
query43	0.03	0.02	0.02
Total cold run time: 105.6 s
Total hot run time: 30.55 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 42.04% (10968/26089)
Line Coverage: 32.30% (92693/286934)
Region Coverage: 31.47% (47536/151065)
Branch Coverage: 27.51% (24076/87522)
Coverage Report: http://coverage.selectdb-in.cc/coverage/53b0069b09a56d4bfc772dd30ab10db70f72643a_53b0069b09a56d4bfc772dd30ab10db70f72643a/report/index.html

@hust-hhb
Copy link
Contributor Author

run buildall

@hust-hhb
Copy link
Contributor Author

run buildall

gavinchou
gavinchou reviewed Jan 26, 2025
View reviewed changes
be/src/common/config.h Outdated Show resolved Hide resolved
@doris-robot
Copy link

TPC-H: Total hot run time: 32349 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit af557c3a493a53519ab0a94160b1ecd01bb174ad, data reload: false

------ Round 1 ----------------------------------
q1	17573	5657	5370	5370
q2	2039	312	166	166
q3	10420	1241	739	739
q4	10216	984	539	539
q5	7519	2388	2161	2161
q6	197	165	133	133
q7	938	760	615	615
q8	9237	1343	1197	1197
q9	5331	5018	4861	4861
q10	6820	2373	1900	1900
q11	457	276	255	255
q12	344	356	211	211
q13	17800	3702	3106	3106
q14	245	234	210	210
q15	528	474	480	474
q16	631	608	587	587
q17	583	866	330	330
q18	7156	6589	6464	6464
q19	1971	960	535	535
q20	310	316	188	188
q21	2850	2182	2006	2006
q22	367	337	302	302
Total cold run time: 103532 ms
Total hot run time: 32349 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5568	5472	5464	5464
q2	234	328	238	238
q3	2271	2687	2341	2341
q4	1381	1836	1390	1390
q5	4344	4743	4699	4699
q6	165	160	134	134
q7	2042	1936	1848	1848
q8	2626	2838	2732	2732
q9	7350	7213	7319	7213
q10	3080	3279	2803	2803
q11	575	511	482	482
q12	628	750	571	571
q13	3519	3953	3342	3342
q14	285	303	281	281
q15	525	470	470	470
q16	638	685	659	659
q17	1241	1744	1269	1269
q18	7742	7425	7470	7425
q19	832	1023	1163	1023
q20	1988	2048	1852	1852
q21	5820	5254	4828	4828
q22	616	594	589	589
Total cold run time: 53470 ms
Total hot run time: 51653 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192115 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit af557c3a493a53519ab0a94160b1ecd01bb174ad, data reload: false

query1	1347	940	936	936
query2	6333	2167	2096	2096
query3	10980	4602	4310	4310
query4	32571	23270	23157	23157
query5	3741	636	478	478
query6	280	202	185	185
query7	3988	499	308	308
query8	310	243	225	225
query9	9706	2644	2633	2633
query10	471	302	250	250
query11	17819	15233	14998	14998
query12	165	107	107	107
query13	1555	519	388	388
query14	10316	6912	7483	6912
query15	240	200	191	191
query16	7926	596	470	470
query17	1598	766	616	616
query18	2160	398	323	323
query19	220	186	181	181
query20	127	116	108	108
query21	211	125	106	106
query22	4556	4413	4432	4413
query23	34354	33506	33518	33506
query24	6680	2404	2380	2380
query25	510	454	414	414
query26	1016	278	161	161
query27	2178	483	333	333
query28	5618	2528	2496	2496
query29	721	609	480	480
query30	238	200	159	159
query31	968	893	817	817
query32	74	65	61	61
query33	527	390	319	319
query34	768	887	509	509
query35	833	844	781	781
query36	1033	1041	992	992
query37	125	106	87	87
query38	4413	4291	4290	4290
query39	1522	1481	1469	1469
query40	223	117	106	106
query41	56	54	55	54
query42	131	113	121	113
query43	547	568	524	524
query44	1392	858	853	853
query45	189	179	184	179
query46	913	1060	665	665
query47	1873	1897	1841	1841
query48	392	414	317	317
query49	736	506	411	411
query50	636	668	429	429
query51	4273	4359	4331	4331
query52	106	108	101	101
query53	234	264	193	193
query54	506	525	423	423
query55	85	79	81	79
query56	263	266	259	259
query57	1195	1182	1134	1134
query58	268	257	234	234
query59	3189	3216	3153	3153
query60	277	286	275	275
query61	124	124	147	124
query62	771	734	671	671
query63	236	189	193	189
query64	4126	1033	687	687
query65	3345	3263	3328	3263
query66	1248	448	299	299
query67	16269	15510	15365	15365
query68	6172	825	529	529
query69	477	292	271	271
query70	1212	1084	1148	1084
query71	381	283	256	256
query72	5944	3903	3782	3782
query73	643	759	353	353
query74	10151	8819	9023	8819
query75	3205	3159	2679	2679
query76	3106	1174	783	783
query77	448	352	282	282
query78	10054	10268	9310	9310
query79	2154	840	606	606
query80	696	512	437	437
query81	500	278	237	237
query82	212	146	122	122
query83	170	168	152	152
query84	233	99	75	75
query85	745	357	374	357
query86	389	310	297	297
query87	4385	4611	4444	4444
query88	3878	2155	2119	2119
query89	395	335	283	283
query90	1887	187	188	187
query91	134	136	107	107
query92	62	53	53	53
query93	2047	875	533	533
query94	651	405	299	299
query95	342	267	255	255
query96	484	612	291	291
query97	2781	2902	2751	2751
query98	212	202	202	202
query99	1282	1392	1243	1243
Total cold run time: 287233 ms
Total hot run time: 192115 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.91 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit af557c3a493a53519ab0a94160b1ecd01bb174ad, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.04	0.03
query3	0.24	0.07	0.07
query4	1.62	0.10	0.10
query5	0.43	0.40	0.40
query6	1.15	0.67	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.61	0.49	0.49
query10	0.54	0.57	0.56
query11	0.14	0.10	0.11
query12	0.14	0.11	0.11
query13	0.62	0.61	0.61
query14	2.74	2.72	2.74
query15	0.89	0.85	0.84
query16	0.39	0.37	0.38
query17	1.06	1.06	1.09
query18	0.23	0.22	0.20
query19	1.95	1.87	1.99
query20	0.01	0.01	0.01
query21	15.39	0.97	0.59
query22	0.76	0.84	0.69
query23	15.18	1.42	0.52
query24	2.76	0.99	0.97
query25	0.16	0.16	0.15
query26	0.31	0.16	0.14
query27	0.07	0.04	0.04
query28	13.23	1.01	0.43
query29	12.63	4.05	3.32
query30	0.26	0.09	0.07
query31	2.83	0.62	0.39
query32	3.23	0.55	0.46
query33	2.99	3.06	3.05
query34	16.63	5.20	4.48
query35	4.58	4.52	4.52
query36	0.64	0.52	0.50
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.03	0.02
query40	0.17	0.15	0.12
query41	0.07	0.03	0.02
query42	0.04	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.07 s
Total hot run time: 30.91 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 42.05% (10971/26089)
Line Coverage: 32.32% (92748/286954)
Region Coverage: 31.48% (47551/151069)
Branch Coverage: 27.52% (24085/87526)
Coverage Report: http://coverage.selectdb-in.cc/coverage/af557c3a493a53519ab0a94160b1ecd01bb174ad_af557c3a493a53519ab0a94160b1ecd01bb174ad/report/index.html

@hust-hhb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32471 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8bfc61d1df469b433b836196de74ea0f18df3a77, data reload: false

------ Round 1 ----------------------------------
q1	17625	5560	5362	5362
q2	2141	329	175	175
q3	10517	1249	761	761
q4	10216	978	533	533
q5	7584	2435	2169	2169
q6	194	171	134	134
q7	914	759	621	621
q8	9256	1403	1196	1196
q9	5262	4909	4974	4909
q10	6830	2338	1874	1874
q11	490	261	260	260
q12	355	366	222	222
q13	17779	3695	3111	3111
q14	244	227	208	208
q15	532	488	466	466
q16	646	618	574	574
q17	572	881	332	332
q18	7125	6623	6467	6467
q19	2013	981	569	569
q20	315	326	188	188
q21	3061	2227	2035	2035
q22	367	335	305	305
Total cold run time: 104038 ms
Total hot run time: 32471 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5584	5455	5499	5455
q2	234	324	228	228
q3	2281	2600	2295	2295
q4	1429	1835	1409	1409
q5	4338	4754	4701	4701
q6	172	162	127	127
q7	2061	2014	1815	1815
q8	2627	2859	2711	2711
q9	7279	7318	7330	7318
q10	3018	3318	2803	2803
q11	562	506	473	473
q12	653	727	594	594
q13	3529	3995	3236	3236
q14	289	296	268	268
q15	531	472	463	463
q16	651	694	640	640
q17	1238	1772	1249	1249
q18	7760	7561	7473	7473
q19	843	1144	1118	1118
q20	2008	2021	1900	1900
q21	5694	5226	4937	4937
q22	592	647	597	597
Total cold run time: 53373 ms
Total hot run time: 51810 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192057 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8bfc61d1df469b433b836196de74ea0f18df3a77, data reload: false

query1	1340	934	921	921
query2	6191	2089	2116	2089
query3	10971	4654	4490	4490
query4	35686	23407	23144	23144
query5	4373	662	491	491
query6	294	204	204	204
query7	3977	515	304	304
query8	289	243	224	224
query9	9458	2648	2631	2631
query10	469	314	238	238
query11	18184	15217	14917	14917
query12	165	107	104	104
query13	1575	559	410	410
query14	11282	7343	6995	6995
query15	235	206	184	184
query16	7614	690	475	475
query17	1589	763	581	581
query18	2056	422	328	328
query19	210	204	165	165
query20	119	118	118	118
query21	213	130	105	105
query22	4548	4441	4517	4441
query23	34236	33313	33387	33313
query24	6338	2300	2329	2300
query25	482	464	403	403
query26	778	287	160	160
query27	2073	505	331	331
query28	5241	2499	2479	2479
query29	553	576	438	438
query30	256	190	160	160
query31	964	892	835	835
query32	68	60	59	59
query33	508	398	322	322
query34	796	915	511	511
query35	841	858	772	772
query36	1018	1045	968	968
query37	128	105	77	77
query38	4426	4339	4281	4281
query39	1738	1483	1461	1461
query40	207	119	110	110
query41	55	50	49	49
query42	122	105	106	105
query43	544	559	513	513
query44	1429	835	841	835
query45	189	197	181	181
query46	934	1106	671	671
query47	1898	1880	1838	1838
query48	399	402	308	308
query49	743	520	422	422
query50	681	723	420	420
query51	4307	4346	4257	4257
query52	114	108	96	96
query53	246	286	191	191
query54	502	524	448	448
query55	83	80	80	80
query56	286	259	244	244
query57	1227	1231	1141	1141
query58	244	240	255	240
query59	3181	3339	3279	3279
query60	287	281	269	269
query61	120	131	119	119
query62	781	745	678	678
query63	233	199	203	199
query64	2624	1025	672	672
query65	3324	3218	3222	3218
query66	934	404	296	296
query67	16193	15587	15457	15457
query68	5927	786	546	546
query69	476	303	251	251
query70	1197	1197	1126	1126
query71	384	299	250	250
query72	5919	3928	3945	3928
query73	653	791	359	359
query74	10370	9041	8805	8805
query75	3246	3161	2660	2660
query76	3097	1252	791	791
query77	480	383	275	275
query78	10034	9976	9337	9337
query79	2948	828	609	609
query80	725	543	449	449
query81	497	277	229	229
query82	237	148	127	127
query83	175	170	149	149
query84	240	94	77	77
query85	744	364	310	310
query86	390	310	291	291
query87	4517	4592	4456	4456
query88	4646	2164	2121	2121
query89	472	330	285	285
query90	1853	192	187	187
query91	135	138	111	111
query92	79	59	56	56
query93	2405	918	528	528
query94	664	423	305	305
query95	345	270	257	257
query96	494	661	279	279
query97	2782	2904	2720	2720
query98	225	200	195	195
query99	1277	1376	1223	1223
Total cold run time: 290802 ms
Total hot run time: 192057 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.08 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8bfc61d1df469b433b836196de74ea0f18df3a77, data reload: false

query1	0.06	0.03	0.04
query2	0.08	0.03	0.03
query3	0.25	0.06	0.07
query4	1.62	0.11	0.10
query5	0.41	0.41	0.40
query6	1.18	0.65	0.67
query7	0.03	0.01	0.01
query8	0.04	0.04	0.03
query9	0.56	0.50	0.51
query10	0.56	0.54	0.55
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.61
query14	2.83	2.73	2.73
query15	0.90	0.82	0.83
query16	0.38	0.37	0.38
query17	0.97	1.03	1.03
query18	0.23	0.21	0.21
query19	1.92	1.82	1.94
query20	0.01	0.02	0.02
query21	15.38	0.91	0.58
query22	0.76	0.76	0.70
query23	15.32	1.48	0.52
query24	3.35	1.92	1.26
query25	0.16	0.22	0.18
query26	0.23	0.15	0.14
query27	0.05	0.05	0.04
query28	14.14	0.99	0.45
query29	12.59	4.02	3.34
query30	0.25	0.09	0.06
query31	2.83	0.60	0.39
query32	3.23	0.54	0.47
query33	3.07	3.02	3.06
query34	16.43	5.14	4.54
query35	4.58	4.44	4.51
query36	0.65	0.50	0.49
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.04	0.03	0.02
query40	0.17	0.13	0.12
query41	0.09	0.03	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.45 s
Total hot run time: 31.08 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 42.05% (10971/26089)
Line Coverage: 32.31% (92709/286954)
Region Coverage: 31.48% (47556/151069)
Branch Coverage: 27.51% (24077/87526)
Coverage Report: http://coverage.selectdb-in.cc/coverage/8bfc61d1df469b433b836196de74ea0f18df3a77_8bfc61d1df469b433b836196de74ea0f18df3a77/report/index.html

@hust-hhb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32341 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dd5468284bda0ee8e6062782619eff13d60bfdc0, data reload: false

------ Round 1 ----------------------------------
q1	17603	5508	5317	5317
q2	2050	299	170	170
q3	10427	1243	728	728
q4	10207	964	524	524
q5	7545	2402	2175	2175
q6	192	175	134	134
q7	923	760	601	601
q8	9218	1325	1159	1159
q9	5209	4913	4914	4913
q10	6833	2324	1878	1878
q11	463	279	247	247
q12	337	352	214	214
q13	17768	3742	3157	3157
q14	232	221	212	212
q15	514	477	444	444
q16	615	605	601	601
q17	561	854	318	318
q18	7337	6623	6501	6501
q19	1680	967	531	531
q20	306	311	194	194
q21	2789	2116	2013	2013
q22	366	334	310	310
Total cold run time: 103175 ms
Total hot run time: 32341 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5489	5446	5465	5446
q2	235	332	241	241
q3	2278	2661	2345	2345
q4	1403	1841	1409	1409
q5	4300	4743	4659	4659
q6	167	157	126	126
q7	2044	1971	1880	1880
q8	2634	2897	2687	2687
q9	7331	7251	7199	7199
q10	3023	3292	2801	2801
q11	576	519	482	482
q12	638	755	581	581
q13	3516	3905	3283	3283
q14	283	316	283	283
q15	512	479	471	471
q16	657	688	650	650
q17	1217	1721	1255	1255
q18	7717	7429	7459	7429
q19	787	1181	1059	1059
q20	1996	2030	1904	1904
q21	5734	5298	4912	4912
q22	615	629	567	567
Total cold run time: 53152 ms
Total hot run time: 51669 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191312 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dd5468284bda0ee8e6062782619eff13d60bfdc0, data reload: false

query1	1332	918	913	913
query2	6272	2031	1998	1998
query3	10976	4434	4251	4251
query4	60548	29084	23171	23171
query5	5468	597	440	440
query6	417	191	184	184
query7	5513	502	310	310
query8	335	242	232	232
query9	8206	2727	2715	2715
query10	440	310	239	239
query11	17729	15139	15554	15139
query12	168	110	107	107
query13	1430	567	407	407
query14	11317	6886	6654	6654
query15	216	206	183	183
query16	7519	632	471	471
query17	1113	739	586	586
query18	1894	416	323	323
query19	205	182	161	161
query20	118	118	119	118
query21	209	128	111	111
query22	4365	4488	4583	4488
query23	33975	34004	33467	33467
query24	5564	2336	2295	2295
query25	531	451	406	406
query26	641	244	155	155
query27	1630	482	330	330
query28	4167	2507	2475	2475
query29	554	556	409	409
query30	212	203	154	154
query31	937	871	811	811
query32	71	56	57	56
query33	456	362	291	291
query34	730	865	515	515
query35	816	901	756	756
query36	1023	1075	956	956
query37	113	92	77	77
query38	4352	4318	4202	4202
query39	1495	1437	1454	1437
query40	200	114	103	103
query41	50	50	48	48
query42	114	106	103	103
query43	514	564	485	485
query44	1295	812	814	812
query45	187	177	186	177
query46	885	1057	660	660
query47	1901	1934	1853	1853
query48	397	408	330	330
query49	698	487	405	405
query50	653	682	403	403
query51	4301	4303	4290	4290
query52	108	112	98	98
query53	228	258	189	189
query54	486	503	419	419
query55	80	78	75	75
query56	267	262	239	239
query57	1191	1228	1120	1120
query58	245	248	233	233
query59	3268	3281	3055	3055
query60	265	271	262	262
query61	146	120	114	114
query62	758	758	677	677
query63	229	190	187	187
query64	1237	1036	669	669
query65	3255	3212	3177	3177
query66	770	402	302	302
query67	16053	15752	15513	15513
query68	3926	822	526	526
query69	465	332	254	254
query70	1195	1126	1124	1124
query71	398	279	256	256
query72	6051	3883	3762	3762
query73	698	753	367	367
query74	9340	9166	8930	8930
query75	3196	3138	2673	2673
query76	3254	1174	755	755
query77	466	359	277	277
query78	10149	10251	9394	9394
query79	1093	842	590	590
query80	1651	523	451	451
query81	554	275	238	238
query82	357	151	128	128
query83	267	178	210	178
query84	283	89	72	72
query85	750	358	299	299
query86	399	319	291	291
query87	4433	4577	4368	4368
query88	3093	2230	2178	2178
query89	397	325	343	325
query90	1552	189	185	185
query91	127	135	105	105
query92	58	60	53	53
query93	1639	845	527	527
query94	682	411	298	298
query95	332	260	247	247
query96	477	606	285	285
query97	2832	2926	2743	2743
query98	217	200	188	188
query99	1262	1350	1254	1254
Total cold run time: 304431 ms
Total hot run time: 191312 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.43 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dd5468284bda0ee8e6062782619eff13d60bfdc0, data reload: false

query1	0.03	0.05	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.07
query4	1.61	0.11	0.11
query5	0.42	0.42	0.41
query6	1.16	0.66	0.67
query7	0.02	0.02	0.01
query8	0.04	0.03	0.04
query9	0.59	0.51	0.49
query10	0.55	0.56	0.54
query11	0.14	0.10	0.10
query12	0.14	0.11	0.10
query13	0.61	0.59	0.61
query14	2.87	2.73	2.86
query15	0.89	0.84	0.83
query16	0.39	0.39	0.39
query17	1.05	1.06	1.09
query18	0.23	0.21	0.21
query19	2.00	1.76	2.00
query20	0.02	0.02	0.02
query21	15.36	0.89	0.59
query22	0.75	0.75	0.65
query23	15.35	1.35	0.57
query24	3.45	0.92	1.86
query25	0.21	0.19	0.09
query26	0.25	0.15	0.13
query27	0.07	0.04	0.04
query28	14.44	0.97	0.42
query29	12.65	3.98	3.30
query30	0.25	0.08	0.06
query31	2.84	0.63	0.37
query32	3.22	0.57	0.45
query33	2.99	3.05	3.03
query34	16.49	5.15	4.41
query35	4.52	4.45	4.51
query36	0.66	0.50	0.49
query37	0.10	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.12	0.12
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.02
Total cold run time: 107.08 s
Total hot run time: 30.43 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 42.05% (10971/26091)
Line Coverage: 32.31% (92708/286966)
Region Coverage: 31.48% (47552/151075)
Branch Coverage: 27.51% (24077/87528)
Coverage Report: http://coverage.selectdb-in.cc/coverage/dd5468284bda0ee8e6062782619eff13d60bfdc0_dd5468284bda0ee8e6062782619eff13d60bfdc0/report/index.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dataroaring dataroaring dataroaring left review comments

@gavinchou gavinchou gavinchou left review comments

@zhannngchen zhannngchen zhannngchen left review comments

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
dev/3.0.x p0_b reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@hust-hhb @hello-stephen @doris-robot @dataroaring @gavinchou @zhannngchen