enable_lake_table_parallel_resolving specifies whether to enable parallel data file pruning for Iceberg tables.
Overview
When querying an Iceberg lake table, the system needs to prune data files based on query conditions to filter out irrelevant files and reduce the amount of data to be read later. When a table has a large number of data files, serial pruning can become a performance bottleneck for plan generation. After enabling this configuration, the system distributes the pruning tasks to multiple threads for parallel execution, thereby shortening the plan generation time.
Attributes
Attribute |
Description |
|---|---|
| Parameter type | BOOL |
| Default Value | True |
| Value range | True / False |
| Modifiable | Yes, you can use the following methods:ALTER SYSTEM SETStatement modification. |
| Whether to restart the OBServer node for the change to take effect | No, the setting takes effect immediately. |
Usage instructions
For Iceberg tables with a large number of data files, it is recommended to keep the default value True. If you need to temporarily disable parallel pruning for special troubleshooting purposes, you can set it to False.
Configuration example
-- View Current Value
SHOW PARAMETERS LIKE 'enable_lake_table_parallel_resolving';
-- Enable parallel pruning
ALTER SYSTEM SET enable_lake_table_parallel_resolving = True;
-- Disable parallel pruning
ALTER SYSTEM SET enable_lake_table_parallel_resolving = False;