Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [fix](bloomfilter) fix inlist support for date/datetimev1 in bloomfilter index #46961 #47005

Open
wants to merge 1 commit into
base: branch-3.0
Choose a base branch
from

Conversation

github-actions[bot]
Copy link
Contributor

Cherry-picked from #46961

…ter index (#46961)

Problem Summary:
#43351 fix date/datetime v1 support in comparison predicate, this PR try
to fix it in inlist predicate.
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Jan 15, 2025
@hello-stephen
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41562 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fa3bc3fbbd3deff18d0621675228e2928f19a1ab, data reload: false

------ Round 1 ----------------------------------
q1	17567	7339	7229	7229
q2	2073	168	167	167
q3	10551	1164	1144	1144
q4	10343	777	758	758
q5	7791	2929	2940	2929
q6	241	152	149	149
q7	998	633	628	628
q8	9630	1979	2080	1979
q9	6822	6556	6513	6513
q10	7811	2334	2407	2334
q11	476	290	283	283
q12	417	230	223	223
q13	18220	3033	3049	3033
q14	243	214	212	212
q15	565	545	528	528
q16	708	609	634	609
q17	990	642	581	581
q18	7426	6894	6702	6702
q19	1392	1057	1109	1057
q20	487	207	206	206
q21	4079	3309	3310	3309
q22	1091	990	989	989
Total cold run time: 109921 ms
Total hot run time: 41562 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7252	7142	7201	7142
q2	348	248	247	247
q3	3171	3019	2992	2992
q4	2038	1793	1817	1793
q5	5748	5713	5702	5702
q6	222	136	142	136
q7	2269	1804	1757	1757
q8	3334	3595	3489	3489
q9	8916	8904	8849	8849
q10	3618	3569	3554	3554
q11	610	518	530	518
q12	819	612	633	612
q13	6437	3257	3269	3257
q14	320	296	278	278
q15	572	527	525	525
q16	728	657	687	657
q17	1826	1592	1598	1592
q18	8260	7711	7659	7659
q19	1724	1504	1514	1504
q20	2054	1799	1800	1799
q21	5377	5298	5235	5235
q22	1076	997	987	987
Total cold run time: 66719 ms
Total hot run time: 60284 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192254 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fa3bc3fbbd3deff18d0621675228e2928f19a1ab, data reload: false

query1	994	380	366	366
query2	6508	2150	2098	2098
query3	6703	214	225	214
query4	34150	23499	23602	23499
query5	4404	471	453	453
query6	280	176	176	176
query7	4646	308	322	308
query8	296	216	213	213
query9	9606	2695	2679	2679
query10	495	266	273	266
query11	17996	15136	15254	15136
query12	160	104	104	104
query13	1653	429	417	417
query14	9877	7195	7844	7195
query15	256	182	187	182
query16	8211	436	465	436
query17	1689	586	567	567
query18	2146	308	310	308
query19	371	165	163	163
query20	119	110	105	105
query21	212	104	103	103
query22	4581	4408	4238	4238
query23	34696	33687	34128	33687
query24	11277	2906	2967	2906
query25	661	400	411	400
query26	1445	170	175	170
query27	2797	351	351	351
query28	7611	2436	2465	2436
query29	937	433	443	433
query30	331	165	163	163
query31	1039	796	816	796
query32	99	58	57	57
query33	798	301	301	301
query34	940	504	551	504
query35	866	726	728	726
query36	1119	939	960	939
query37	142	78	74	74
query38	4161	3898	3844	3844
query39	1468	1418	1467	1418
query40	292	102	100	100
query41	52	50	50	50
query42	119	104	102	102
query43	531	499	488	488
query44	1314	800	819	800
query45	193	171	171	171
query46	1193	719	741	719
query47	1931	1793	1818	1793
query48	475	381	379	379
query49	1162	401	396	396
query50	851	418	424	418
query51	7282	6972	7181	6972
query52	103	94	94	94
query53	278	189	190	189
query54	1244	466	477	466
query55	83	76	79	76
query56	267	263	256	256
query57	1242	1099	1102	1099
query58	244	212	217	212
query59	3343	3305	3040	3040
query60	304	252	273	252
query61	123	116	132	116
query62	888	679	682	679
query63	242	196	198	196
query64	5400	683	661	661
query65	3272	3201	3172	3172
query66	1465	320	327	320
query67	16137	15604	15370	15370
query68	4558	566	574	566
query69	437	290	273	273
query70	1197	1141	1151	1141
query71	341	254	257	254
query72	6434	4159	4156	4156
query73	785	354	358	354
query74	10408	9096	9014	9014
query75	3397	2678	2673	2673
query76	2979	1103	1084	1084
query77	439	297	282	282
query78	10343	9664	9661	9661
query79	1098	611	619	611
query80	791	470	463	463
query81	519	241	244	241
query82	768	124	128	124
query83	244	154	159	154
query84	239	87	92	87
query85	1175	359	359	359
query86	324	304	305	304
query87	4573	4317	4296	4296
query88	3488	2392	2361	2361
query89	404	297	309	297
query90	2080	198	194	194
query91	200	162	165	162
query92	64	59	56	56
query93	1062	570	555	555
query94	799	320	312	312
query95	368	276	280	276
query96	627	287	280	280
query97	3316	3142	3223	3142
query98	225	212	235	212
query99	1510	1307	1293	1293
Total cold run time: 300962 ms
Total hot run time: 192254 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.16 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fa3bc3fbbd3deff18d0621675228e2928f19a1ab, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.06	0.06
query4	1.63	0.10	0.11
query5	0.51	0.53	0.52
query6	1.13	0.73	0.72
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.57	0.50	0.49
query10	0.52	0.54	0.55
query11	0.14	0.11	0.11
query12	0.14	0.12	0.12
query13	0.61	0.59	0.58
query14	3.05	2.94	2.97
query15	0.89	0.82	0.83
query16	0.37	0.37	0.38
query17	0.99	1.03	1.00
query18	0.24	0.21	0.22
query19	1.96	1.88	2.10
query20	0.01	0.00	0.01
query21	15.35	0.57	0.58
query22	2.73	2.46	1.60
query23	17.16	0.95	0.79
query24	2.81	1.36	0.38
query25	0.17	0.27	0.06
query26	0.30	0.15	0.14
query27	0.04	0.05	0.05
query28	11.17	1.10	1.07
query29	12.59	3.30	3.29
query30	0.24	0.06	0.05
query31	2.87	0.38	0.37
query32	3.26	0.45	0.46
query33	3.01	3.04	3.03
query34	17.18	4.46	4.47
query35	4.50	4.53	4.50
query36	0.67	0.47	0.51
query37	0.09	0.06	0.06
query38	0.04	0.04	0.04
query39	0.04	0.02	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.03
query42	0.03	0.02	0.02
query43	0.05	0.03	0.03
Total cold run time: 107.7 s
Total hot run time: 32.16 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants