Parameter |
Type |
Required |
Default value |
Description |
|---|---|---|---|---|
| checkpoint | JsonNode | Yes | None | The checkpoint. Format: { "ClientId": { "databaseName": "", "tableName": "", "value": { "col1": "val", "col2": "val" }, "syncedCount": the synchronized count.}, ... } |
| clients | JsonNode | Yes | None | The clients, in the format of a JSON list. |
| database_connection_timeout_sec | Integer | No | 120 | The connection timeout period for each JDBC client in the database. |
| database_max_connection | Integer | No | 32 | The maximum number of connections allowed for each JDBC client in the database. |
| database_time_zone | String | No | +08:00 | The time zone set in connections. |
| database_type | String | Yes | None | The type of the database. |
| dataflow_fetch_size | Integer | No | 1000 | The size of data pulled at a time, which may increase based on the number of source databases. |
| dataflow_init_table_thread_num | Integer | No | 8 | The number of worker thread pools for initializing tables. The values of the core and max parameters are the same. |
| dataflow_pull_worker_num | Integer | No | 32 | The number of worker thread pools for pulling data. The values of the core and max parameters are the same. |
| dataflow_retry_time | Integer | No | 3 | The number of retries for requesting a database operation. The default value is 3. |
| dataflow_retry_interval_sec | Integer | No | 3 | The retry interval. The default value is 3, indicating 3 seconds. |
| dataflow_slice_queue_size | Integer | No | 128 | The size of the dataflow slice queue, which increases based on the number of sources. The value of this parameter must be greater than 0. |
| dataflow_slice_worker_num | Integer | No | 16 | The number of worker thread pools for sharding tables. The values of the core and max parameters are the same. |
| source_queue_size | Integer | No | 16384 | The maximum number of messages in a queue on the source database side. |
Dataflow client parameters
Parameter |
Type |
Required |
Default value |
Description |
|---|---|---|---|---|
| characterSet | String | No | Subject to the value of the upper-layer parameter | The character set. |
| clientId | String | Yes | None | The client ID. |
| cluster | String | No | None | The cluster, which is exclusive to OceanBase Database. |
| config | Map | No | None | The configuration of the data source. |
| connTimeout | Integer | No | Subject to the value of the upper-layer parameter | The timeout period for connecting to the database. |
| instance | String | Yes | None | The service address of the database, in the format of ip:port. |
| logicDatabase | String | No | None | The name of the logical database. |
| logicTable | String | No | None | The name of the logical table. |
| password | String | Yes | None | The password. |
| retryIntervalSec | Integer | No | Subject to the value of the upper-layer parameter | The retry interval for queries or writes. |
| retryTime | Integer | No | Subject to the value of the upper-layer parameter | The number of retries allowed for queries or writes. |
| tableWhiteLists | Map | Yes | None | The whitelist of tables from which data is pulled. |
| tenant | String | No | None | The tenant, which is exclusive to OceanBase Database. |
| username | String | Yes | None | The username. |