Change Data Capture (CDC) helps you identify data that has changed since the last extraction. You can use the data provided by CDC to build historical databases and near-real-time caches, or feed it into message queues (MQs) for consumption in analytics and auditing.
OceanBase Change Data Capture (obcdc) exposes real-time incremental (transactional) data from OceanBase AI Database as a dynamic library.
obcdc requests the clog (redo) logs of each partition from OceanBase AI Database over RPC. Combined with the schema information of each table and column (obtained through interaction with OBServer nodes), it converts redo logs into an intermediate data format (LOGMSG). It aggregates the data changes involved in a transaction and outputs the changed data row by row for each transaction.
Applications of obcdc
obcdc provides incremental transactional data from OceanBase AI Database. Processes that call obcdc can use this data for data synchronization and data subscription.
Data synchronization: Synchronize data from OceanBase to homogeneous or heterogeneous databases for logical migration, logical standby, logical upgrade, and other purposes.
Data subscription: Synchronize data from OceanBase to message queues or data warehouses for real-time computing, auditing, monitoring, and other applications.
Limitations
- obcdc does not support synchronizing tables that contain LOB columns (such as TEXT, BLOB, and JSON).
For more information about how to use obcdc, see obcdc development instructions.