Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](cloud-mow)Add more calculate delete bitmap fail case #46766

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

hust-hhb
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Jan 10, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32395 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 21915a32b5bce9d01198e72f1813aa9f9cd60f95, data reload: false

------ Round 1 ----------------------------------
q1	17798	6152	6024	6024
q2	2050	320	193	193
q3	10513	1217	778	778
q4	10263	882	453	453
q5	7929	2207	1963	1963
q6	202	178	152	152
q7	880	775	605	605
q8	9245	1335	1119	1119
q9	5218	5017	4806	4806
q10	6754	2306	1842	1842
q11	467	272	257	257
q12	343	355	219	219
q13	17766	3667	3000	3000
q14	253	244	213	213
q15	577	514	502	502
q16	637	617	574	574
q17	556	834	318	318
q18	6895	6415	6388	6388
q19	2350	941	533	533
q20	311	309	182	182
q21	2859	2182	1977	1977
q22	363	323	297	297
Total cold run time: 104229 ms
Total hot run time: 32395 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6292	6283	6219	6219
q2	243	332	229	229
q3	2241	2631	2326	2326
q4	1410	1815	1346	1346
q5	4353	4806	4839	4806
q6	180	178	141	141
q7	2016	1980	1785	1785
q8	2618	2803	2699	2699
q9	7262	7233	7231	7231
q10	3038	3307	2738	2738
q11	573	518	497	497
q12	683	781	644	644
q13	3501	3809	3224	3224
q14	276	324	268	268
q15	568	514	510	510
q16	647	703	669	669
q17	1249	1717	1264	1264
q18	7745	7511	7287	7287
q19	817	1074	1102	1074
q20	2060	2015	1868	1868
q21	5662	5079	5042	5042
q22	614	624	569	569
Total cold run time: 54048 ms
Total hot run time: 52436 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 39.35% (10255/26059)
Line Coverage: 30.51% (87389/286407)
Region Coverage: 29.56% (44539/150682)
Branch Coverage: 26.10% (22795/87324)
Coverage Report: http://coverage.selectdb-in.cc/coverage/21915a32b5bce9d01198e72f1813aa9f9cd60f95_21915a32b5bce9d01198e72f1813aa9f9cd60f95/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 194285 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 21915a32b5bce9d01198e72f1813aa9f9cd60f95, data reload: false

query1	1313	975	918	918
query2	6390	2351	2361	2351
query3	10947	4671	4742	4671
query4	32954	23558	23300	23300
query5	4243	585	454	454
query6	293	215	192	192
query7	3976	482	301	301
query8	305	235	229	229
query9	9454	2643	2646	2643
query10	466	321	258	258
query11	17822	15292	15204	15204
query12	151	108	108	108
query13	1563	517	390	390
query14	9148	6490	7324	6490
query15	235	222	189	189
query16	8215	613	497	497
query17	1532	793	597	597
query18	2150	422	321	321
query19	236	205	178	178
query20	137	115	113	113
query21	223	124	105	105
query22	4653	4533	4425	4425
query23	34250	33874	33089	33089
query24	6460	2325	2295	2295
query25	490	469	394	394
query26	892	269	156	156
query27	2282	450	334	334
query28	5391	2490	2462	2462
query29	648	566	425	425
query30	208	191	156	156
query31	917	889	862	862
query32	77	60	62	60
query33	484	358	315	315
query34	737	852	519	519
query35	827	808	747	747
query36	1020	1033	960	960
query37	121	100	81	81
query38	4055	4117	4046	4046
query39	1511	1455	1541	1455
query40	218	139	109	109
query41	54	50	52	50
query42	123	103	110	103
query43	503	525	494	494
query44	1319	806	831	806
query45	188	183	167	167
query46	866	1054	653	653
query47	1870	1872	1891	1872
query48	377	416	327	327
query49	706	501	398	398
query50	652	673	409	409
query51	6977	6905	6931	6905
query52	103	101	91	91
query53	226	267	190	190
query54	481	492	415	415
query55	82	81	79	79
query56	267	284	257	257
query57	1182	1182	1171	1171
query58	235	244	227	227
query59	3287	3270	3210	3210
query60	284	293	264	264
query61	115	114	142	114
query62	850	797	744	744
query63	218	194	186	186
query64	3534	1027	662	662
query65	3268	3202	3229	3202
query66	922	418	311	311
query67	16383	15765	15436	15436
query68	8347	710	510	510
query69	490	284	256	256
query70	1196	1163	1168	1163
query71	433	282	252	252
query72	6553	3855	3865	3855
query73	643	747	357	357
query74	10191	9160	8822	8822
query75	4090	3118	2653	2653
query76	3707	1164	751	751
query77	766	388	269	269
query78	9931	9962	9322	9322
query79	3624	789	579	579
query80	722	511	442	442
query81	488	286	235	235
query82	580	143	122	122
query83	198	162	144	144
query84	277	89	73	73
query85	778	359	305	305
query86	342	306	298	298
query87	4465	4435	4271	4271
query88	4543	2137	2122	2122
query89	409	325	281	281
query90	1839	183	181	181
query91	129	139	106	106
query92	67	55	56	55
query93	1699	870	528	528
query94	630	385	279	279
query95	339	250	250	250
query96	478	618	280	280
query97	2886	2955	2821	2821
query98	217	200	206	200
query99	1625	1455	1361	1361
Total cold run time: 294748 ms
Total hot run time: 194285 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.47 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 21915a32b5bce9d01198e72f1813aa9f9cd60f95, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.07
query4	1.61	0.11	0.11
query5	0.39	0.43	0.40
query6	1.16	0.65	0.67
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.59	0.53	0.50
query10	0.56	0.57	0.56
query11	0.14	0.10	0.11
query12	0.14	0.11	0.10
query13	0.62	0.59	0.60
query14	2.74	2.71	2.86
query15	0.88	0.84	0.82
query16	0.39	0.39	0.38
query17	1.05	1.01	1.01
query18	0.22	0.20	0.21
query19	1.89	1.84	2.03
query20	0.01	0.02	0.01
query21	15.35	0.91	0.59
query22	0.76	0.75	0.64
query23	15.34	1.38	0.59
query24	2.93	1.45	1.10
query25	0.11	0.17	0.20
query26	0.33	0.15	0.13
query27	0.06	0.05	0.05
query28	13.93	1.55	1.04
query29	12.59	4.09	3.33
query30	0.24	0.09	0.07
query31	2.82	0.62	0.38
query32	3.22	0.54	0.45
query33	3.07	3.06	3.08
query34	16.66	5.18	4.46
query35	4.52	4.46	4.47
query36	0.68	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.17	0.13	0.12
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.03	0.02
Total cold run time: 105.91 s
Total hot run time: 31.47 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants