OceanBase AI Database supports efficiently compressing the bitmap data type (RoaringBitmap), allowing users to store and process a set of unsigned integers (i.e., non-negative integers).
Bitmap is a technique used to process large volumes of data efficiently. Its main advantages include:
- High space efficiency. It uses a single bit to represent the presence status of an element, significantly saving storage space. This structure is commonly used in scenarios that require processing large volumes of data, such as data statistics, data deduplication, and data analysis.
- Simple and fast operations. For example, checking if an element exists, adding an element, and deleting an element can be achieved using corresponding bitwise operations. Bitwise operations such as XOR, intersection, and union on bitmaps can efficiently implement business data queries and analytical requirements.
Compared with traditional bitmap data types, the highly compressed bitmap type is better suited for storing very sparse bit arrays. In some cases, it can be hundreds of times faster than other bitmaps and offers significantly better compression. Additionally, the highly compressed bitmap type supports 64-bit integer data.
In addition to providing an efficient compressed bitmap data type, functions are also available for bitmap data. For more information, see Overview of bitmap functions.