This topic describes the test environment, test plan, and detailed test results of the TPC-H test in OceanBase AI Database.
Note
The test data in this topic is based on the baseline version at the time of publication. Results may vary across different versions and hardware environments.
Test environment
Hardware configuration
Service type |
Instance type |
Number of instances |
Number of cores per machine |
Memory |
|---|---|---|---|---|
| OceanBase AI Database | ecs.r9i.8xlarge | 1 | 32C | 256G |
| OceanBase LogService and Client | ecs.r9i.8xlarge | 1 | 32C | 256G |
Software version
Software |
Version or description |
|---|---|
| OceanBase AI Database | V4.6.3.0 |
| Client | OBClient or MySQL client |
| Data generation tool | dbgen, used to generate sharded data for the 100G scenario |
Test specifications
Project |
Configuration |
|---|---|
| Test data size | 100G and 1T |
| Test scenario | Hot and Cold |
| Query set | 22 TPC-H queries |
| Query parallelism | 96 (PARALLEL(96) hint in SQL statements) |
Test plan
In this test, the TPC-H 22 queries were executed at two data scales: 100G and 1T. Each data scale included both Hot and Cold test scenarios.
- For the test procedure, parameter settings, table creation, data loading, and statistics collection methods, see OceanBase AI Database TPC-H test.
- Hot scenario: Queries are executed while the cache is warm. Each query is run three times in a row, and the average time of the last two runs is taken as the RT for that query.
- Cold scenario: The cache is cleared and waits for expiration before each query is executed. The execution time for a single query is taken as its RT, excluding cache clearance and wait time.
- For each data scale, the standard TPC-H 22 queries are executed. In both scenarios, all 22 queries must execute successfully.
- Data loading time only accumulates the client execution time of the final successful
LOAD DATAstatement, excluding row count verification, failed retry attempts, major compactions, statistics collection, and queries.
Test results
Summary
Data scale |
Pure import time |
Total cold duration |
Total hot time |
Cold/Hot |
SQL result |
|---|---|---|---|---|---|
| 100G | 292.34 s | 102.10 s | 13.12 s | 7.78× | 22 succeeded / 0 failed |
| 1T | 3280.36 s | 532.17 s | 217.25 s | 2.45× | 22 succeeded / 0 failed |
100G detailed results
Query |
Hot time (s) |
Cold duration (s) |
Cold/Hot |
|---|---|---|---|
| Q1 | 1.47 | 5.86 | 3.99× |
| Q2 | 0.12 | 4.10 | 34.17× |
| Q3 | 0.72 | 5.24 | 7.28× |
| Q4 | 0.57 | 5.19 | 9.11× |
| Q5 | 0.68 | 6.75 | 9.93× |
| Q6 | 0.02 | 2.04 | 102.00× |
| Q7 | 0.41 | 5.09 | 12.41× |
| Q8 | 0.59 | 7.82 | 13.25× |
| Q9 | 1.88 | 8.93 | 4.75× |
| Q10 | 0.62 | 4.91 | 7.92× |
| Q11 | 0.18 | 1.77 | 9.83× |
| Q12 | 0.14 | 4.47 | 31.93× |
| Q13 | 1.06 | 4.37 | 4.12× |
| Q14 | 0.15 | 2.19 | 14.60× |
| Q15 | 0.11 | 1.88 | 17.09× |
| Q16 | 0.33 | 2.24 | 6.79× |
| Q17 | 0.21 | 5.42 | 25.81× |
| Q18 | 1.72 | 4.40 | 2.56× |
| Q19 | 0.24 | 6.34 | 26.42× |
| Q20 | 0.23 | 3.65 | 15.87× |
| Q21 | 1.44 | 7.39 | 5.13× |
| Q22 | 0.23 | 2.05 | 8.91× |
| Total | 13.12 | 102.10 | 7.78× |
1T detailed results
Query |
Hot time (s) |
Cold duration (s) |
Cold/Hot |
|---|---|---|---|
| Q1 | 19.82 | 29.77 | 1.50× |
| Q2 | 1.05 | 5.81 | 5.53× |
| Q3 | 12.20 | 26.81 | 2.20× |
| Q4 | 5.18 | 22.00 | 4.25× |
| Q5 | 8.67 | 40.60 | 4.68× |
| Q6 | 0.24 | 5.56 | 23.17× |
| Q7 | 4.67 | 18.93 | 4.05× |
| Q8 | 7.69 | 50.91 | 6.62× |
| Q9 | 75.43 | 80.89 | 1.07× |
| Q10 | 7.67 | 24.81 | 3.23× |
| Q11 | 1.84 | 6.50 | 3.53× |
| Q12 | 2.27 | 7.93 | 3.49× |
| Q13 | 11.89 | 29.61 | 2.49× |
| Q14 | 2.02 | 4.01 | 1.99× |
| Q15 | 1.37 | 3.96 | 2.89× |
| Q16 | 3.59 | 6.30 | 1.75× |
| Q17 | 2.42 | 25.04 | 10.35× |
| Q18 | 24.78 | 46.21 | 1.86× |
| Q19 | 2.50 | 29.72 | 11.89× |
| Q20 | 2.23 | 11.50 | 5.16× |
| Q21 | 17.15 | 47.01 | 2.74× |
| Q22 | 2.57 | 8.29 | 3.23× |
| Total | 217.25 | 532.17 | 2.45× |