The current version of OceanBase AI Database supports Azure Blob, AWS S3, and object storage services that are compatible with the S3 protocol (for example, Alibaba Cloud OSS, Huawei OBS, Google GCS, and Tencent COS). Some storage media must meet certain basic requirements before they can be used.
When configuring object storage, the URL provided supports only the following two URI schemes; all other schemes are not supported:
- AWS S3 and S3-compatible object storage:
s3://, for examples3://your-bucket-name/your-path?host=your-service.com&access_id=your-access-id&access_key=your-access-key. - Azure Blob:
azblob://, for exampleazblob://your-bucket-name/your-path?host=http://your-storage-account.blob.core.windows.net&access_id=your-access-id&access_key=your-access-key.
When deploying an OceanBase AI Database cluster, it is recommended to configure different object storage buckets for OBServer and LogService.
SDK version requirements
In the current version, object storage is accessed by default through obdal. obdal is a unified object storage framework developed based on OpenDAL. For more information about OpenDAL, see OpenDAL.
In addition, if you need to use an object storage SDK, only S3 SDK for C++ is supported, with version 1.11.156.
Permission requirements
Make sure that the nodes where OBServer and LogService run can access the configured object storage.
Interface requirements
S3-compatible object storage (for example, Alibaba Cloud OSS, Huawei OBS, Google GCS, and Tencent COS):
It must be compatible with the S3 API behaviors listed in the following table.
Interface nameDescriptionPutObject Upload a single object DeleteObject Delete a single object DeleteObjects Batch delete objects GetObject Download a single object ListObjects List all objects under the path HeadObject Get metadata of a specific object PutObjectTagging (Optional) Set object tags GetObjectTagging (Optional) Get object tags CreateMultipartUpload Initialize multipart upload UploadPart Upload a single part CompleteMultipartUpload Merge uploaded parts into a single object AbortMultipartUpload Abort a multipart upload and delete uploaded parts ListMultipartUploads List uploaded parts ListParts List information about parts that have been uploaded in the upload task It must support the Virtual-hosted–style object access URL. For detailed information about Virtual-hosted–style requests, see AWS S3 official website.
When selecting a storage medium, you can use the test_io_device command in the ob_admin tool to verify whether the I/O interfaces and current I/O permissions provided by the medium meet the requirements of the OceanBase AI Database cluster. You can also use the io_adapter_benchmark command in ob_admin to check the read/write performance from OBServer nodes to the storage medium. For details about the test_io_device and io_adapter_benchmark commands, see the ob_admin tool documentation in the OceanBase AI Database documentation center.