Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[improvement](info) Add F/L commitSeq and commitTs for get_lag #46769

Merged
merged 1 commit into from
Jan 17, 2025
Merged

[improvement](info) Add F/L commitSeq and commitTs for get_lag #46769

merged 1 commit into from
Jan 17, 2025

Conversation

wyxxxcat
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@wyxxxcat wyxxxcat marked this pull request as draft January 10, 2025 08:37
@wyxxxcat wyxxxcat marked this pull request as ready for review January 10, 2025 09:35
@wyxxxcat
Copy link
Contributor Author

run buildall

@wyxxxcat
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32705 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dc03725828b7dbdb3708ec212a8cc4d9c5c4d35e, data reload: false

------ Round 1 ----------------------------------
q1	17587	6398	6028	6028
q2	2058	313	175	175
q3	10612	1256	738	738
q4	10200	899	449	449
q5	7532	2204	2004	2004
q6	241	177	146	146
q7	906	765	609	609
q8	9253	1412	1229	1229
q9	5302	4916	4937	4916
q10	6771	2318	1837	1837
q11	469	281	264	264
q12	335	364	217	217
q13	17773	3753	3080	3080
q14	238	234	216	216
q15	575	525	517	517
q16	619	607	577	577
q17	575	859	331	331
q18	7133	6449	6366	6366
q19	2716	957	535	535
q20	310	316	188	188
q21	2847	2245	1962	1962
q22	374	326	321	321
Total cold run time: 104426 ms
Total hot run time: 32705 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6306	6196	6187	6187
q2	238	327	240	240
q3	2250	2677	2350	2350
q4	1381	1856	1371	1371
q5	4375	4802	4912	4802
q6	191	173	137	137
q7	2080	1971	1828	1828
q8	2610	2882	2725	2725
q9	7267	7251	7329	7251
q10	3064	3276	2760	2760
q11	603	532	499	499
q12	686	794	607	607
q13	3518	3966	3203	3203
q14	279	302	293	293
q15	575	523	509	509
q16	679	721	656	656
q17	1236	1745	1287	1287
q18	7848	7513	7362	7362
q19	793	1118	1085	1085
q20	2020	2024	1854	1854
q21	5756	5080	4901	4901
q22	647	618	647	618
Total cold run time: 54402 ms
Total hot run time: 52525 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195383 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dc03725828b7dbdb3708ec212a8cc4d9c5c4d35e, data reload: false

query1	1341	974	940	940
query2	6356	2413	2383	2383
query3	11014	4663	4655	4655
query4	32658	23627	23593	23593
query5	3623	606	467	467
query6	313	193	197	193
query7	3993	491	317	317
query8	307	252	251	251
query9	9286	2741	2751	2741
query10	466	306	264	264
query11	17928	15242	15109	15109
query12	164	109	107	107
query13	1570	527	399	399
query14	9529	7786	7112	7112
query15	254	210	195	195
query16	7602	683	487	487
query17	1580	776	647	647
query18	1994	402	321	321
query19	207	184	166	166
query20	122	126	115	115
query21	240	123	109	109
query22	4389	4431	4283	4283
query23	34120	33737	33519	33519
query24	6405	2270	2324	2270
query25	543	505	391	391
query26	727	281	154	154
query27	2001	483	339	339
query28	5258	2510	2493	2493
query29	598	566	441	441
query30	214	192	157	157
query31	970	905	818	818
query32	80	60	61	60
query33	503	369	303	303
query34	777	869	530	530
query35	824	827	753	753
query36	1018	1034	958	958
query37	135	103	80	80
query38	4385	4084	4022	4022
query39	1494	1499	1498	1498
query40	221	118	103	103
query41	53	52	50	50
query42	120	105	107	105
query43	506	537	501	501
query44	1329	845	842	842
query45	188	192	170	170
query46	868	1046	646	646
query47	1842	1935	1809	1809
query48	390	412	323	323
query49	724	512	406	406
query50	644	693	396	396
query51	7195	6849	7071	6849
query52	101	101	93	93
query53	228	252	187	187
query54	484	492	411	411
query55	104	83	86	83
query56	266	262	249	249
query57	1248	1234	1159	1159
query58	247	246	252	246
query59	3206	3288	3095	3095
query60	269	275	252	252
query61	116	137	115	115
query62	860	809	713	713
query63	232	191	186	186
query64	3134	1036	684	684
query65	3292	3268	3266	3266
query66	803	408	308	308
query67	16257	15814	15275	15275
query68	8202	691	516	516
query69	498	288	260	260
query70	1177	1143	1146	1143
query71	433	291	254	254
query72	6550	3795	3926	3795
query73	655	746	359	359
query74	10437	9179	8831	8831
query75	4068	3142	2620	2620
query76	3651	1180	797	797
query77	756	368	281	281
query78	10051	9974	9205	9205
query79	3501	821	609	609
query80	616	526	460	460
query81	492	278	241	241
query82	679	158	123	123
query83	162	164	155	155
query84	246	92	70	70
query85	786	345	296	296
query86	395	323	296	296
query87	4442	4302	4586	4302
query88	4654	2226	2186	2186
query89	405	329	281	281
query90	1785	194	194	194
query91	133	138	106	106
query92	68	57	53	53
query93	2058	901	530	530
query94	647	400	277	277
query95	342	272	274	272
query96	495	612	281	281
query97	2888	2957	2835	2835
query98	236	210	199	199
query99	1439	1485	1394	1394
Total cold run time: 292862 ms
Total hot run time: 195383 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.58 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dc03725828b7dbdb3708ec212a8cc4d9c5c4d35e, data reload: false

query1	0.04	0.03	0.02
query2	0.09	0.05	0.04
query3	0.23	0.06	0.06
query4	1.64	0.09	0.08
query5	0.42	0.40	0.41
query6	1.18	0.68	0.66
query7	0.02	0.01	0.02
query8	0.05	0.05	0.05
query9	0.56	0.50	0.50
query10	0.55	0.56	0.54
query11	0.16	0.11	0.12
query12	0.15	0.13	0.13
query13	0.62	0.59	0.59
query14	2.72	2.73	2.73
query15	0.91	0.84	0.84
query16	0.37	0.39	0.39
query17	1.06	1.07	1.00
query18	0.19	0.19	0.20
query19	1.92	1.90	2.00
query20	0.02	0.01	0.01
query21	15.38	0.96	0.67
query22	0.76	0.80	0.72
query23	14.93	1.51	0.68
query24	2.19	0.38	0.23
query25	0.15	0.09	0.09
query26	0.28	0.19	0.18
query27	0.08	0.08	0.08
query28	13.45	1.83	1.13
query29	12.67	4.07	3.40
query30	0.24	0.08	0.06
query31	2.83	0.62	0.40
query32	3.24	0.59	0.49
query33	3.17	3.13	3.16
query34	16.50	5.10	4.47
query35	4.51	4.50	4.52
query36	0.62	0.51	0.48
query37	0.19	0.16	0.16
query38	0.15	0.15	0.15
query39	0.06	0.04	0.04
query40	0.17	0.15	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 104.68 s
Total hot run time: 31.58 s

@wyxxxcat
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33257 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 28f042017b591048e89e64f1cb576b0268914a34, data reload: false

------ Round 1 ----------------------------------
q1	17625	6232	6129	6129
q2	2054	307	170	170
q3	10412	1296	759	759
q4	10222	902	462	462
q5	7530	2246	2005	2005
q6	206	179	147	147
q7	923	761	609	609
q8	9252	1421	1217	1217
q9	5401	4951	4957	4951
q10	6783	2310	1880	1880
q11	496	291	261	261
q12	354	370	224	224
q13	17770	3757	3162	3162
q14	246	246	219	219
q15	592	518	517	517
q16	661	610	589	589
q17	616	888	336	336
q18	7442	6459	6460	6459
q19	1761	960	574	574
q20	328	339	194	194
q21	3004	2233	2076	2076
q22	371	346	317	317
Total cold run time: 104049 ms
Total hot run time: 33257 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6396	6269	6317	6269
q2	242	329	243	243
q3	2284	2677	2368	2368
q4	1441	1817	1382	1382
q5	4415	4816	5013	4816
q6	188	176	139	139
q7	2111	1986	1845	1845
q8	2693	2798	2725	2725
q9	7274	7206	7234	7206
q10	3083	3405	2872	2872
q11	602	531	516	516
q12	669	767	610	610
q13	3585	3947	3314	3314
q14	279	296	278	278
q15	582	530	530	530
q16	676	692	637	637
q17	1219	1752	1286	1286
q18	7659	7484	7406	7406
q19	863	1163	1123	1123
q20	2026	2013	1920	1920
q21	5815	5200	4976	4976
q22	605	617	544	544
Total cold run time: 54707 ms
Total hot run time: 53005 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189926 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 28f042017b591048e89e64f1cb576b0268914a34, data reload: false

query1	1004	384	377	377
query2	6547	2079	2045	2045
query3	6709	214	208	208
query4	33625	23714	23648	23648
query5	4337	644	481	481
query6	291	208	194	194
query7	4628	503	305	305
query8	287	229	229	229
query9	9359	2705	2713	2705
query10	474	330	266	266
query11	18268	15222	15021	15021
query12	156	108	101	101
query13	1651	515	399	399
query14	10427	7533	7485	7485
query15	279	200	197	197
query16	8108	624	433	433
query17	1608	722	552	552
query18	2121	396	296	296
query19	225	198	173	173
query20	117	109	110	109
query21	216	119	104	104
query22	4324	4211	4149	4149
query23	34330	33315	34025	33315
query24	6520	2264	2266	2264
query25	502	485	409	409
query26	1076	253	163	163
query27	2027	475	346	346
query28	5069	2463	2450	2450
query29	571	539	442	442
query30	240	192	166	166
query31	964	890	805	805
query32	96	70	65	65
query33	532	370	346	346
query34	759	859	528	528
query35	798	811	725	725
query36	1010	1009	932	932
query37	126	104	81	81
query38	4283	4163	4166	4163
query39	1483	1370	1396	1370
query40	207	124	140	124
query41	53	53	51	51
query42	127	106	103	103
query43	518	519	487	487
query44	1406	837	827	827
query45	181	173	167	167
query46	888	1038	651	651
query47	1820	1830	1763	1763
query48	391	404	314	314
query49	814	510	399	399
query50	638	652	411	411
query51	6950	6969	6807	6807
query52	106	106	94	94
query53	228	259	188	188
query54	485	490	427	427
query55	85	79	78	78
query56	275	281	256	256
query57	1153	1160	1063	1063
query58	248	253	236	236
query59	3055	3095	2801	2801
query60	274	273	258	258
query61	147	115	132	115
query62	836	789	712	712
query63	231	205	191	191
query64	4593	1040	663	663
query65	3260	3194	3183	3183
query66	1077	444	331	331
query67	15943	15591	15549	15549
query68	4970	828	539	539
query69	486	293	264	264
query70	1219	1140	1122	1122
query71	385	313	266	266
query72	5916	3821	3842	3821
query73	664	762	374	374
query74	10128	8941	8870	8870
query75	3181	3151	2673	2673
query76	3182	1182	780	780
query77	529	385	286	286
query78	10016	10025	9377	9377
query79	3032	793	602	602
query80	676	528	478	478
query81	519	321	246	246
query82	316	157	125	125
query83	177	179	152	152
query84	245	98	75	75
query85	791	350	315	315
query86	396	305	319	305
query87	4353	4471	4428	4428
query88	5107	2221	2180	2180
query89	390	330	296	296
query90	1880	195	193	193
query91	136	141	109	109
query92	74	61	59	59
query93	2485	915	540	540
query94	662	413	307	307
query95	344	267	261	261
query96	500	609	291	291
query97	2843	2832	2713	2713
query98	228	221	202	202
query99	1450	1480	1381	1381
Total cold run time: 288416 ms
Total hot run time: 189926 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.49 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 28f042017b591048e89e64f1cb576b0268914a34, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.22	0.07	0.06
query4	1.63	0.10	0.11
query5	0.42	0.41	0.39
query6	1.17	0.65	0.66
query7	0.03	0.01	0.01
query8	0.04	0.04	0.03
query9	0.56	0.50	0.51
query10	0.54	0.55	0.55
query11	0.15	0.09	0.10
query12	0.15	0.10	0.11
query13	0.61	0.59	0.60
query14	2.74	2.76	2.72
query15	0.89	0.83	0.82
query16	0.38	0.38	0.40
query17	1.05	1.04	1.00
query18	0.22	0.21	0.21
query19	1.82	2.02	1.81
query20	0.01	0.01	0.01
query21	15.35	0.91	0.58
query22	0.75	0.81	0.81
query23	15.18	1.48	0.56
query24	2.96	1.49	1.12
query25	0.13	0.11	0.13
query26	0.31	0.14	0.13
query27	0.06	0.07	0.06
query28	14.35	1.57	1.04
query29	12.62	3.86	3.23
query30	0.25	0.09	0.06
query31	2.84	0.63	0.37
query32	3.24	0.55	0.46
query33	3.04	3.01	3.13
query34	16.64	5.16	4.53
query35	4.55	4.55	4.61
query36	0.68	0.50	0.49
query37	0.10	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.14	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.18 s
Total hot run time: 31.49 s

@wyxxxcat wyxxxcat force-pushed the get_lag_info branch 2 times, most recently from 126ad13 to 048ad78 Compare January 14, 2025 05:10
@wyxxxcat
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33021 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 048ad786833a2fb90b619ced0a7ab5ac4c016ecf, data reload: false

------ Round 1 ----------------------------------
q1	17876	6188	6099	6099
q2	2054	309	184	184
q3	10804	1243	758	758
q4	10549	884	448	448
q5	9429	2186	1989	1989
q6	209	180	145	145
q7	911	750	620	620
q8	9258	1372	1194	1194
q9	5169	4804	4933	4804
q10	6819	2304	1844	1844
q11	483	290	262	262
q12	346	370	229	229
q13	17785	3658	3138	3138
q14	220	227	214	214
q15	568	532	530	530
q16	620	625	612	612
q17	578	861	338	338
q18	6866	6554	6501	6501
q19	1880	952	583	583
q20	320	331	191	191
q21	2797	2241	2023	2023
q22	373	340	315	315
Total cold run time: 105914 ms
Total hot run time: 33021 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6366	6188	6216	6188
q2	245	332	239	239
q3	2231	2688	2304	2304
q4	1396	1770	1391	1391
q5	4356	4782	4871	4782
q6	195	178	146	146
q7	2083	1950	1824	1824
q8	2626	2798	2720	2720
q9	7263	7202	7289	7202
q10	3042	3205	2751	2751
q11	576	545	514	514
q12	662	768	603	603
q13	3548	3897	3332	3332
q14	277	305	285	285
q15	589	528	523	523
q16	664	692	651	651
q17	1249	1742	1271	1271
q18	7763	7520	7311	7311
q19	845	1197	1030	1030
q20	2000	2072	1930	1930
q21	5683	5196	5092	5092
q22	614	631	584	584
Total cold run time: 54273 ms
Total hot run time: 52673 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196172 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 048ad786833a2fb90b619ced0a7ab5ac4c016ecf, data reload: false

query1	1319	963	939	939
query2	6387	2061	1977	1977
query3	11006	4487	4381	4381
query4	61741	28744	23782	23782
query5	5560	584	453	453
query6	442	199	179	179
query7	5522	532	308	308
query8	342	252	241	241
query9	8193	2714	2703	2703
query10	468	312	253	253
query11	17203	15261	15550	15261
query12	162	116	109	109
query13	1378	552	399	399
query14	11835	7511	7569	7511
query15	212	198	179	179
query16	7213	665	466	466
query17	1148	739	595	595
query18	1853	414	296	296
query19	200	219	164	164
query20	125	110	108	108
query21	204	119	100	100
query22	4398	4760	4364	4364
query23	34071	33518	33643	33518
query24	5732	2370	2308	2308
query25	485	503	432	432
query26	650	275	161	161
query27	1551	484	348	348
query28	3916	2512	2476	2476
query29	579	588	461	461
query30	216	187	163	163
query31	965	872	832	832
query32	75	101	59	59
query33	479	384	306	306
query34	750	872	516	516
query35	811	810	773	773
query36	1025	1050	979	979
query37	128	106	77	77
query38	4316	4316	4198	4198
query39	1491	1446	1450	1446
query40	214	151	104	104
query41	51	51	51	51
query42	124	114	106	106
query43	512	541	494	494
query44	1375	868	839	839
query45	197	176	177	176
query46	906	1078	664	664
query47	1900	1877	1852	1852
query48	391	399	337	337
query49	695	495	410	410
query50	689	681	419	419
query51	6901	6983	6956	6956
query52	105	100	95	95
query53	234	271	193	193
query54	503	525	426	426
query55	86	87	80	80
query56	261	298	258	258
query57	1173	1127	1067	1067
query58	248	251	233	233
query59	2946	3137	2916	2916
query60	292	297	282	282
query61	145	161	112	112
query62	787	797	701	701
query63	230	191	190	190
query64	1258	1013	650	650
query65	3261	3173	3145	3145
query66	776	401	301	301
query67	16032	15597	15432	15432
query68	5016	852	540	540
query69	511	298	269	269
query70	1198	1149	1114	1114
query71	409	293	267	267
query72	6054	3878	3958	3878
query73	807	774	368	368
query74	10257	9187	9028	9028
query75	3238	3134	2678	2678
query76	3791	1182	779	779
query77	505	381	281	281
query78	10016	9987	9424	9424
query79	3418	831	589	589
query80	796	543	449	449
query81	518	279	240	240
query82	1109	157	130	130
query83	175	175	173	173
query84	295	97	80	80
query85	744	445	296	296
query86	382	317	307	307
query87	4421	4427	4562	4427
query88	4656	2211	2193	2193
query89	417	325	288	288
query90	1583	191	191	191
query91	138	144	107	107
query92	66	63	53	53
query93	2922	851	543	543
query94	740	411	296	296
query95	333	263	253	253
query96	492	602	279	279
query97	2825	2875	2777	2777
query98	231	196	188	188
query99	1622	1512	1377	1377
Total cold run time: 316128 ms
Total hot run time: 196172 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.56 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 048ad786833a2fb90b619ced0a7ab5ac4c016ecf, data reload: false

query1	0.03	0.04	0.03
query2	0.09	0.05	0.04
query3	0.23	0.06	0.06
query4	1.65	0.09	0.10
query5	0.44	0.41	0.40
query6	1.17	0.66	0.67
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.56	0.49	0.49
query10	0.56	0.58	0.55
query11	0.17	0.12	0.11
query12	0.16	0.12	0.13
query13	0.62	0.60	0.59
query14	2.87	2.75	2.88
query15	0.92	0.83	0.84
query16	0.38	0.39	0.39
query17	1.08	1.07	1.07
query18	0.20	0.19	0.19
query19	1.99	2.03	1.86
query20	0.01	0.02	0.01
query21	15.35	0.96	0.65
query22	0.78	0.82	0.71
query23	14.97	1.48	0.67
query24	2.18	0.38	0.24
query25	0.14	0.08	0.08
query26	0.28	0.19	0.19
query27	0.08	0.08	0.08
query28	13.48	1.80	1.13
query29	12.66	4.06	3.39
query30	0.24	0.08	0.06
query31	2.85	0.64	0.40
query32	3.24	0.59	0.47
query33	2.98	3.07	3.05
query34	16.40	5.19	4.50
query35	4.60	4.57	4.55
query36	0.62	0.48	0.50
query37	0.20	0.17	0.16
query38	0.16	0.15	0.15
query39	0.06	0.04	0.04
query40	0.17	0.15	0.13
query41	0.10	0.06	0.05
query42	0.07	0.05	0.05
query43	0.05	0.05	0.04
Total cold run time: 104.86 s
Total hot run time: 31.56 s

@wyxxxcat
Copy link
Contributor Author

run feut

@wyxxxcat
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Jan 16, 2025
@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@wyxxxcat
Copy link
Contributor Author

run buildall

@wyxxxcat
Copy link
Contributor Author

run cloudut

@doris-robot
Copy link

TPC-H: Total hot run time: 32562 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8dde1b5bfaebe78257fa5547cf2367a31350268f, data reload: false

------ Round 1 ----------------------------------
q1	17753	5581	5465	5465
q2	2074	310	170	170
q3	10484	1284	718	718
q4	10232	1001	560	560
q5	7608	2485	2176	2176
q6	198	171	148	148
q7	912	758	607	607
q8	9233	1356	1208	1208
q9	5250	4939	4919	4919
q10	6824	2361	1916	1916
q11	491	273	251	251
q12	342	369	219	219
q13	17774	3706	3072	3072
q14	221	223	221	221
q15	515	488	484	484
q16	614	614	597	597
q17	598	897	338	338
q18	7371	6511	6403	6403
q19	1657	974	566	566
q20	318	328	194	194
q21	2862	2175	2007	2007
q22	381	334	323	323
Total cold run time: 103712 ms
Total hot run time: 32562 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5602	5582	5539	5539
q2	240	328	243	243
q3	2218	2676	2301	2301
q4	1422	1863	1390	1390
q5	4348	4802	4695	4695
q6	173	168	135	135
q7	2140	2017	1893	1893
q8	2649	2809	2716	2716
q9	7372	7383	7200	7200
q10	3024	3263	2808	2808
q11	594	527	503	503
q12	694	786	652	652
q13	3529	3968	3281	3281
q14	265	306	271	271
q15	531	476	475	475
q16	654	693	652	652
q17	1248	1776	1269	1269
q18	7730	7582	7498	7498
q19	834	1118	1141	1118
q20	1982	2029	1889	1889
q21	5623	5418	5098	5098
q22	608	596	584	584
Total cold run time: 53480 ms
Total hot run time: 52210 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187767 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8dde1b5bfaebe78257fa5547cf2367a31350268f, data reload: false

query1	980	381	376	376
query2	6533	2037	1989	1989
query3	6797	224	219	219
query4	33450	23072	23099	23072
query5	4312	607	445	445
query6	304	210	215	210
query7	4600	490	321	321
query8	288	243	209	209
query9	9247	2673	2675	2673
query10	479	308	241	241
query11	17956	15139	15007	15007
query12	153	103	102	102
query13	1650	517	407	407
query14	10061	6493	6662	6493
query15	217	190	192	190
query16	7816	652	502	502
query17	1611	758	582	582
query18	2006	405	322	322
query19	202	200	175	175
query20	120	114	112	112
query21	215	123	108	108
query22	4238	4458	4107	4107
query23	34101	33009	33188	33009
query24	6843	2258	2297	2258
query25	486	436	387	387
query26	1237	264	156	156
query27	2133	466	337	337
query28	5206	2487	2422	2422
query29	685	543	411	411
query30	238	190	156	156
query31	961	888	795	795
query32	74	67	63	63
query33	505	349	297	297
query34	734	862	531	531
query35	773	838	755	755
query36	1002	1094	950	950
query37	121	107	75	75
query38	4117	4171	4078	4078
query39	1451	1387	1379	1379
query40	214	122	106	106
query41	52	53	52	52
query42	123	104	102	102
query43	511	523	489	489
query44	1314	808	807	807
query45	174	174	164	164
query46	862	1048	632	632
query47	1833	1823	1796	1796
query48	392	403	318	318
query49	778	493	417	417
query50	638	662	393	393
query51	6948	6872	6870	6870
query52	101	103	99	99
query53	221	251	192	192
query54	493	503	459	459
query55	84	81	85	81
query56	264	267	240	240
query57	1147	1180	1093	1093
query58	248	230	251	230
query59	2884	3041	2798	2798
query60	280	272	252	252
query61	122	113	119	113
query62	814	737	672	672
query63	224	198	191	191
query64	4137	1038	661	661
query65	3236	3176	3146	3146
query66	1107	434	312	312
query67	16068	15840	15443	15443
query68	5593	819	536	536
query69	478	289	289	289
query70	1191	1164	1079	1079
query71	379	278	266	266
query72	5910	3860	3798	3798
query73	654	752	356	356
query74	10101	9181	9029	9029
query75	3159	3204	2697	2697
query76	3145	1188	779	779
query77	492	358	282	282
query78	10117	10060	9716	9716
query79	3076	822	604	604
query80	601	530	435	435
query81	510	284	238	238
query82	615	157	128	128
query83	166	174	153	153
query84	249	90	82	82
query85	781	356	309	309
query86	396	307	285	285
query87	4384	4402	4273	4273
query88	4932	2203	2168	2168
query89	401	331	308	308
query90	1858	196	195	195
query91	132	147	111	111
query92	73	58	54	54
query93	1861	868	535	535
query94	703	406	309	309
query95	336	272	265	265
query96	505	617	283	283
query97	2837	2835	2730	2730
query98	224	211	193	193
query99	1307	1401	1233	1233
Total cold run time: 286337 ms
Total hot run time: 187767 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.29 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8dde1b5bfaebe78257fa5547cf2367a31350268f, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.06
query4	1.63	0.11	0.10
query5	0.42	0.40	0.43
query6	1.18	0.66	0.66
query7	0.03	0.01	0.02
query8	0.04	0.04	0.03
query9	0.59	0.50	0.51
query10	0.56	0.58	0.57
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.61	0.59
query14	2.71	2.85	2.74
query15	0.88	0.82	0.83
query16	0.38	0.37	0.38
query17	1.05	0.97	1.04
query18	0.23	0.21	0.21
query19	1.99	1.89	1.97
query20	0.02	0.01	0.02
query21	15.36	0.97	0.59
query22	0.76	0.78	0.76
query23	15.25	1.44	0.59
query24	2.60	1.30	1.44
query25	0.16	0.12	0.11
query26	0.31	0.15	0.14
query27	0.05	0.04	0.05
query28	14.43	1.00	0.42
query29	12.66	3.87	3.30
query30	0.25	0.09	0.07
query31	2.84	0.59	0.38
query32	3.23	0.55	0.46
query33	3.02	3.02	3.02
query34	16.68	5.16	4.58
query35	4.54	4.53	4.56
query36	0.61	0.48	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.03
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.18 s
Total hot run time: 31.29 s

dataroaring
dataroaring approved these changes Jan 17, 2025
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@w41ter w41ter merged commit a27db94 into apache:master Jan 17, 2025
26 of 28 checks passed
github-actions bot pushed a commit that referenced this pull request Jan 17, 2025
@wyxxxcat
[improvement](info) Add F/L commitSeq and commitTs for get_lag (#46769)
7d509ce
@github-actions github-actions bot mentioned this pull request Jan 17, 2025
Open
github-actions bot pushed a commit that referenced this pull request Jan 17, 2025
@wyxxxcat
[improvement](info) Add F/L commitSeq and commitTs for get_lag (#46769)
7b3582a
@github-actions github-actions bot mentioned this pull request Jan 17, 2025
Open
@wyxxxcat wyxxxcat mentioned this pull request Jan 17, 2025
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dataroaring dataroaring dataroaring approved these changes

@w41ter w41ter w41ter approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.x dev/3.0.x reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@wyxxxcat @hello-stephen @doris-robot @w41ter @dataroaring