Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [fix](cloud) Support clean tablet file cache when tablet drop #46390 #47021

Open
wants to merge 1 commit into
base: branch-3.0
Choose a base branch
from

Conversation

deardeng
Copy link
Contributor

cherry pick from #46390

@deardeng
Copy link
Contributor Author

run buildall

@Thearas
Copy link
Contributor

Thearas commented Jan 15, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@doris-robot
Copy link

TPC-H: Total hot run time: 41021 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c12a4a8ced57adaf0fc70b7e35fe33dfcdd7fb48, data reload: false

------ Round 1 ----------------------------------
q1	17582	7481	7506	7481
q2	2083	177	175	175
q3	10624	1060	1206	1060
q4	10564	694	740	694
q5	7746	2885	2736	2736
q6	238	147	150	147
q7	979	605	604	604
q8	9376	1939	2021	1939
q9	6612	6425	6399	6399
q10	7158	2344	2339	2339
q11	463	265	264	264
q12	401	221	213	213
q13	17792	3016	2998	2998
q14	242	208	208	208
q15	581	528	528	528
q16	702	606	602	602
q17	958	583	540	540
q18	7270	6801	6750	6750
q19	1419	1052	1115	1052
q20	470	203	201	201
q21	4158	3141	3098	3098
q22	1105	993	1015	993
Total cold run time: 108523 ms
Total hot run time: 41021 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7271	7249	7272	7249
q2	332	237	237	237
q3	2943	2944	2953	2944
q4	2083	1817	1802	1802
q5	5678	5716	5761	5716
q6	228	140	143	140
q7	2210	1804	1867	1804
q8	3345	3555	3475	3475
q9	8913	8894	8798	8798
q10	3587	3556	3559	3556
q11	614	505	492	492
q12	832	619	630	619
q13	8421	3146	3235	3146
q14	310	274	291	274
q15	587	545	536	536
q16	710	686	678	678
q17	1836	1609	1616	1609
q18	8231	7706	7732	7706
q19	1659	1592	1478	1478
q20	2122	1838	1858	1838
q21	5645	5349	5446	5349
q22	1127	1030	1032	1030
Total cold run time: 68684 ms
Total hot run time: 60476 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197347 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c12a4a8ced57adaf0fc70b7e35fe33dfcdd7fb48, data reload: false

query1	1324	927	915	915
query2	6263	2090	2135	2090
query3	11002	4319	4278	4278
query4	65830	29081	23469	23469
query5	4917	474	459	459
query6	416	186	176	176
query7	5633	311	304	304
query8	308	227	233	227
query9	9216	2688	2683	2683
query10	484	283	272	272
query11	17255	15289	15798	15289
query12	160	101	104	101
query13	1546	482	438	438
query14	10526	6735	6647	6647
query15	196	181	179	179
query16	7126	517	544	517
query17	1081	596	615	596
query18	1901	342	328	328
query19	224	168	173	168
query20	120	116	121	116
query21	210	102	106	102
query22	4644	4411	4520	4411
query23	34696	34288	34152	34152
query24	6306	2935	2851	2851
query25	539	453	445	445
query26	674	176	169	169
query27	2055	364	370	364
query28	4310	2480	2460	2460
query29	718	481	477	477
query30	266	169	166	166
query31	1024	821	831	821
query32	74	61	57	57
query33	426	306	280	280
query34	917	510	520	510
query35	846	757	741	741
query36	1078	949	961	949
query37	122	73	72	72
query38	4007	3979	3986	3979
query39	1515	1477	1458	1458
query40	214	101	99	99
query41	49	47	49	47
query42	116	109	114	109
query43	524	493	494	493
query44	1199	827	830	827
query45	185	168	168	168
query46	1149	722	728	722
query47	2018	1883	1920	1883
query48	467	387	394	387
query49	727	407	395	395
query50	846	445	438	438
query51	7238	7276	7259	7259
query52	101	92	91	91
query53	260	179	182	179
query54	567	470	466	466
query55	76	80	79	79
query56	264	252	242	242
query57	1235	1153	1103	1103
query58	209	197	212	197
query59	3197	2980	2917	2917
query60	274	263	256	256
query61	116	107	108	107
query62	763	664	676	664
query63	208	198	195	195
query64	1374	696	650	650
query65	3266	3165	3209	3165
query66	707	312	306	306
query67	15866	15887	15606	15606
query68	4012	593	575	575
query69	430	272	273	272
query70	1147	1135	1090	1090
query71	361	269	257	257
query72	6407	4146	3970	3970
query73	748	347	366	347
query74	10246	9009	8964	8964
query75	3327	2596	2687	2596
query76	1918	1110	1126	1110
query77	517	305	283	283
query78	10606	9719	9538	9538
query79	1172	575	569	569
query80	829	435	436	435
query81	515	249	242	242
query82	1302	125	115	115
query83	172	144	137	137
query84	281	83	76	76
query85	869	300	316	300
query86	336	287	292	287
query87	4402	4426	4296	4296
query88	3794	2452	2377	2377
query89	412	295	293	293
query90	2050	190	191	190
query91	185	150	150	150
query92	64	52	51	51
query93	1400	551	544	544
query94	843	306	300	300
query95	369	265	271	265
query96	611	290	296	290
query97	3315	3267	3179	3179
query98	219	203	198	198
query99	1550	1323	1285	1285
Total cold run time: 317579 ms
Total hot run time: 197347 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.42 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c12a4a8ced57adaf0fc70b7e35fe33dfcdd7fb48, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.24	0.06	0.07
query4	1.62	0.10	0.10
query5	0.50	0.50	0.50
query6	1.13	0.74	0.74
query7	0.02	0.01	0.02
query8	0.04	0.03	0.04
query9	0.56	0.51	0.50
query10	0.56	0.55	0.56
query11	0.14	0.10	0.10
query12	0.13	0.11	0.11
query13	0.61	0.60	0.60
query14	3.09	3.01	2.93
query15	0.91	0.83	0.82
query16	0.39	0.39	0.38
query17	1.05	1.01	0.97
query18	0.24	0.22	0.21
query19	1.83	1.91	2.04
query20	0.01	0.01	0.02
query21	15.35	0.61	0.58
query22	2.57	2.74	2.22
query23	16.90	1.17	0.83
query24	2.65	1.08	0.95
query25	0.21	0.19	0.05
query26	0.31	0.14	0.14
query27	0.05	0.05	0.06
query28	10.92	1.10	1.07
query29	12.54	3.28	3.21
query30	0.25	0.06	0.06
query31	2.86	0.38	0.38
query32	3.26	0.46	0.46
query33	2.99	3.00	2.98
query34	17.01	4.56	4.53
query35	4.53	4.54	4.54
query36	0.67	0.48	0.49
query37	0.09	0.06	0.07
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.12	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.72 s
Total hot run time: 33.42 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants