This topic describes the test environment, test plan, and detailed test data results of the TPC-DS test in OceanBase AI Database.
Note
The test data in this topic is based on the version baseline at the time of publication. Results may vary across different versions and hardware environments.
Test environment
Hardware configuration
Service type |
Instance type |
Number of instances |
Number of cores per machine |
Memory |
|---|---|---|---|---|
| OceanBase AI Database | ecs.r9i.8xlarge | 1 | 32C | 256G |
| OceanBase LogService and Client | ecs.r9i.8xlarge | 1 | 32C | 256G |
Software version
Service type |
Software version |
|---|---|
| OceanBase AI Database | V4.6.3.0 |
Test specifications
Project |
Configuration |
|---|---|
| Test data size | 100G and 1T |
| Test scenario | Hot and Cold |
| Query set | TPC-DS Q1–Q99 |
Test plan
This TPC-DS test executed queries at two data scales, 100G and 1T, and each data scale included both Hot and Cold test scenarios.
- For the test procedure, parameter settings, table creation, data loading, and statistics collection methods, see OceanBase AI Database TPC-DS test.
- Hot scenario: Queries are executed in a preheated cache state. Each query is executed three times consecutively, and the average of the last two runs is taken as the response time (RT) of that query.
- Cold scenario: The cache is cleared and the test waits for it to expire before each query is executed. The time consumed in a single execution is taken as the RT of that query, excluding cache clearing and waiting time.
- Each data scale executes 99 queries; in both scenarios, all 99 queries must be executed successfully.
- Data loading time only accumulates the client execution time of the final successful
LOAD DATAstatement, excluding row count verification, failed retry attempts, major compactions, statistics collection, and queries.
Test results
Summary
Data scale |
Pure import time |
Total cold duration |
Total hot time |
Cold/Hot |
SQL result |
|---|---|---|---|---|---|
| 100G | 515.72 s | 441.87 s | 52.59 s | 8.40× | 99 succeeded / 0 failed |
| 1T | 3183.35 s | 1456.77 s | 452.23 s | 3.22× | 99 succeeded / 0 failed |
100G detailed results
Query |
Hot time (s) |
Cold duration (s) |
Cold/Hot |
|---|---|---|---|
| Q1 | 0.11 | 2.70 | 24.55× |
| Q2 | 0.17 | 3.43 | 20.18× |
| Q3 | 0.06 | 2.86 | 47.67× |
| Q4 | 3.72 | 11.22 | 3.02× |
| Q5 | 0.13 | 8.67 | 66.69× |
| Q6 | 0.09 | 2.84 | 31.56× |
| Q7 | 0.09 | 4.81 | 53.44× |
| Q8 | 0.07 | 3.26 | 46.57× |
| Q9 | 0.41 | 3.01 | 7.34× |
| Q10 | 0.12 | 6.18 | 51.50× |
| Q11 | 1.28 | 6.41 | 5.01× |
| Q12 | 0.05 | 1.65 | 33.00× |
| Q13 | 0.10 | 6.51 | 65.10× |
| Q14 | 3.49 | 11.42 | 3.27× |
| Q15 | 0.10 | 2.92 | 29.20× |
| Q16 | 0.06 | 4.88 | 81.33× |
| Q17 | 0.17 | 4.96 | 29.18× |
| Q18 | 0.14 | 5.20 | 37.14× |
| Q19 | 0.05 | 4.10 | 82.00× |
| Q20 | 0.04 | 1.73 | 43.25× |
| Q21 | 0.05 | 2.36 | 47.20× |
| Q22 | 1.26 | 2.48 | 1.97× |
| Q23 | 8.19 | 15.38 | 1.88× |
| Q24 | 1.38 | 9.00 | 6.52× |
| Q25 | 0.09 | 4.13 | 45.89× |
| Q26 | 0.07 | 3.64 | 52.00× |
| Q27 | 0.08 | 3.39 | 42.38× |
| Q28 | 0.59 | 3.28 | 5.56× |
| Q29 | 0.30 | 4.67 | 15.57× |
| Q30 | 0.10 | 3.93 | 39.30× |
| Q31 | 0.38 | 4.05 | 10.66× |
| Q32 | 0.02 | 1.56 | 78.00× |
| Q33 | 0.16 | 5.34 | 33.38× |
| Q34 | 0.09 | 4.94 | 54.89× |
| Q35 | 0.35 | 5.55 | 15.86× |
| Q36 | 0.13 | 2.50 | 19.23× |
| Q37 | 0.02 | 1.67 | 83.50× |
| Q38 | 1.50 | 6.56 | 4.37× |
| Q39 | 0.32 | 1.96 | 6.13× |
| Q40 | 0.06 | 3.20 | 53.33× |
| Q41 | 0.02 | 0.42 | 21.00× |
| Q42 | 0.02 | 1.77 | 88.50× |
| Q43 | 0.11 | 2.36 | 21.45× |
| Q44 | 0.22 | 4.15 | 18.86× |
| Q45 | 0.10 | 3.55 | 35.50× |
| Q46 | 0.18 | 6.30 | 35.00× |
| Q47 | 0.83 | 2.53 | 3.05× |
| Q48 | 0.09 | 5.20 | 57.78× |
| Q49 | 0.12 | 8.61 | 71.75× |
| Q50 | 0.90 | 5.02 | 5.58× |
| Q51 | 2.49 | 4.91 | 1.97× |
| Q52 | 0.02 | 1.77 | 88.50× |
| Q53 | 0.05 | 1.78 | 35.60× |
| Q54 | 0.30 | 7.26 | 24.20× |
| Q55 | 0.02 | 1.60 | 80.00× |
| Q56 | 0.14 | 4.98 | 35.57× |
| Q57 | 0.54 | 2.38 | 4.41× |
| Q58 | 0.30 | 3.53 | 11.77× |
| Q59 | 0.34 | 2.85 | 8.38× |
| Q60 | 0.15 | 5.10 | 34.00× |
| Q61 | 0.10 | 3.63 | 36.30× |
| Q62 | 0.36 | 2.39 | 6.64× |
| Q63 | 0.05 | 1.76 | 35.20× |
| Q64 | 1.03 | 10.79 | 10.48× |
| Q65 | 0.51 | 2.44 | 4.78× |
| Q66 | 0.13 | 4.96 | 38.15× |
| Q67 | 5.18 | 6.66 | 1.29× |
| Q68 | 0.10 | 7.15 | 71.50× |
| Q69 | 0.11 | 5.17 | 47.00× |
| Q70 | 0.58 | 2.99 | 5.16× |
| Q71 | 0.14 | 4.83 | 34.50× |
| Q72 | 0.48 | 6.26 | 13.04× |
| Q73 | 0.06 | 5.36 | 89.33× |
| Q74 | 1.28 | 4.84 | 3.78× |
| Q75 | 0.93 | 9.12 | 9.81× |
| Q76 | 0.16 | 5.52 | 34.50× |
| Q77 | 0.15 | 7.71 | 51.40× |
| Q78 | 2.52 | 8.72 | 3.46× |
| Q79 | 0.35 | 5.37 | 15.34× |
| Q80 | 0.27 | 9.00 | 33.33× |
| Q81 | 0.13 | 4.80 | 36.92× |
| Q82 | 0.03 | 1.93 | 64.33× |
| Q83 | 0.13 | 2.89 | 22.23× |
| Q84 | 0.04 | 3.29 | 82.25× |
| Q85 | 0.07 | 6.05 | 86.43× |
| Q86 | 0.18 | 1.60 | 8.89× |
| Q87 | 1.56 | 5.87 | 3.76× |
| Q88 | 0.22 | 3.67 | 16.68× |
| Q89 | 0.08 | 2.00 | 25.00× |
| Q90 | 0.08 | 1.96 | 24.50× |
| Q91 | 0.05 | 3.50 | 70.00× |
| Q92 | 0.02 | 1.60 | 80.00× |
| Q93 | 0.69 | 5.64 | 8.17× |
| Q94 | 0.06 | 3.59 | 59.83× |
| Q95 | 0.16 | 3.45 | 21.56× |
| Q96 | 0.17 | 2.96 | 17.41× |
| Q97 | 1.14 | 3.80 | 3.33× |
| Q98 | 0.10 | 1.90 | 19.00× |
| Q99 | 0.66 | 2.28 | 3.45× |
| Total | 52.59 | 441.87 | 8.40× |
1T detailed results
Query |
Hot time (s) |
Cold duration (s) |
Cold/Hot |
|---|---|---|---|
| Q1 | 0.77 | 4.37 | 5.68× |
| Q2 | 1.26 | 9.10 | 7.22× |
| Q3 | 0.30 | 8.35 | 27.83× |
| Q4 | 36.19 | 67.03 | 1.85× |
| Q5 | 1.64 | 16.91 | 10.31× |
| Q6 | 0.43 | 4.05 | 9.42× |
| Q7 | 0.54 | 12.01 | 22.24× |
| Q8 | 0.24 | 5.22 | 21.75× |
| Q9 | 2.16 | 21.63 | 10.01× |
| Q10 | 0.24 | 10.24 | 42.67× |
| Q11 | 18.32 | 33.24 | 1.81× |
| Q12 | 0.07 | 2.73 | 39.00× |
| Q13 | 0.59 | 17.79 | 30.15× |
| Q14 | 33.43 | 60.41 | 1.81× |
| Q15 | 0.65 | 4.49 | 6.91× |
| Q16 | 0.43 | 10.29 | 23.93× |
| Q17 | 1.62 | 10.67 | 6.59× |
| Q18 | 0.72 | 10.46 | 14.53× |
| Q19 | 0.29 | 5.35 | 18.45× |
| Q20 | 0.08 | 2.46 | 30.75× |
| Q21 | 0.07 | 2.50 | 35.71× |
| Q22 | 2.37 | 3.80 | 1.60× |
| Q23 | 78.74 | 98.42 | 1.25× |
| Q24 | 13.67 | 56.59 | 4.14× |
| Q25 | 0.80 | 8.75 | 10.94× |
| Q26 | 0.32 | 7.46 | 23.31× |
| Q27 | 0.51 | 10.93 | 21.43× |
| Q28 | 4.46 | 20.84 | 4.67× |
| Q29 | 2.23 | 14.62 | 6.56× |
| Q30 | 0.41 | 5.59 | 13.63× |
| Q31 | 4.21 | 9.00 | 2.14× |
| Q32 | 0.04 | 2.29 | 57.25× |
| Q33 | 0.42 | 7.28 | 17.33× |
| Q34 | 0.64 | 21.37 | 33.39× |
| Q35 | 3.52 | 11.11 | 3.16× |
| Q36 | 0.61 | 7.91 | 12.97× |
| Q37 | 0.05 | 1.44 | 28.80× |
| Q38 | 15.26 | 21.27 | 1.39× |
| Q39 | 0.69 | 2.82 | 4.09× |
| Q40 | 0.26 | 4.82 | 18.54× |
| Q41 | 0.02 | 0.56 | 28.00× |
| Q42 | 0.05 | 3.36 | 67.20× |
| Q43 | 0.91 | 5.62 | 6.18× |
| Q44 | 0.20 | 17.92 | 89.60× |
| Q45 | 0.13 | 4.67 | 35.92× |
| Q46 | 1.00 | 30.15 | 30.15× |
| Q47 | 4.97 | 9.85 | 1.98× |
| Q48 | 0.61 | 11.63 | 19.07× |
| Q49 | 0.90 | 16.01 | 17.79× |
| Q50 | 8.26 | 37.37 | 4.52× |
| Q51 | 10.76 | 16.81 | 1.56× |
| Q52 | 0.04 | 2.99 | 74.75× |
| Q53 | 0.28 | 4.66 | 16.64× |
| Q54 | 0.41 | 9.58 | 23.37× |
| Q55 | 0.04 | 2.96 | 74.00× |
| Q56 | 0.28 | 6.77 | 24.18× |
| Q57 | 2.66 | 5.61 | 2.11× |
| Q58 | 0.67 | 5.87 | 8.76× |
| Q59 | 2.53 | 9.94 | 3.93× |
| Q60 | 0.38 | 8.59 | 22.61× |
| Q61 | 0.43 | 5.69 | 13.23× |
| Q62 | 3.16 | 5.04 | 1.59× |
| Q63 | 0.26 | 4.67 | 17.96× |
| Q64 | 7.98 | 40.99 | 5.14× |
| Q65 | 3.77 | 8.08 | 2.14× |
| Q66 | 1.25 | 12.23 | 9.78× |
| Q67 | 49.02 | 52.94 | 1.08× |
| Q68 | 0.33 | 27.81 | 84.27× |
| Q69 | 0.28 | 7.74 | 27.64× |
| Q70 | 5.28 | 9.99 | 1.89× |
| Q71 | 0.40 | 8.57 | 21.43× |
| Q72 | 3.90 | 14.66 | 3.76× |
| Q73 | 0.29 | 21.36 | 73.66× |
| Q74 | 13.23 | 22.09 | 1.67× |
| Q75 | 10.45 | 42.50 | 4.07× |
| Q76 | 0.04 | 2.65 | 66.25× |
| Q77 | 0.41 | 12.01 | 29.29× |
| Q78 | 31.71 | 55.86 | 1.76× |
| Q79 | 2.55 | 28.06 | 11.00× |
| Q80 | 1.33 | 17.50 | 13.16× |
| Q81 | 0.75 | 5.41 | 7.21× |
| Q82 | 0.19 | 2.92 | 15.37× |
| Q83 | 0.52 | 4.61 | 8.87× |
| Q84 | 0.15 | 4.77 | 31.80× |
| Q85 | 0.31 | 9.40 | 30.32× |
| Q86 | 1.50 | 4.56 | 3.04× |
| Q87 | 15.79 | 21.15 | 1.34× |
| Q88 | 2.76 | 23.06 | 8.36× |
| Q89 | 0.47 | 5.11 | 10.87× |
| Q90 | 0.63 | 6.41 | 10.17× |
| Q91 | 0.06 | 3.82 | 63.67× |
| Q92 | 0.05 | 2.27 | 45.40× |
| Q93 | 5.96 | 44.95 | 7.54× |
| Q94 | 0.38 | 10.88 | 28.63× |
| Q95 | 0.95 | 9.75 | 10.26× |
| Q96 | 1.59 | 20.01 | 12.58× |
| Q97 | 14.18 | 19.57 | 1.38× |
| Q98 | 0.17 | 3.50 | 20.59× |
| Q99 | 5.40 | 7.65 | 1.42× |
| Total | 452.23 | 1456.77 | 3.22× |