代码示例: 以下是Hudi写入数据集的示例代码:
// 设置基础配置
HoodieWriteConfig config = HoodieWriteConfig.newBuilder()
.withPath(basePath)
.withSchema(SCHEMA)
.withParallelism(2, 2)
.withBulkInsertParallelism(4)
.withFinalizeWriteParallelism(1)
.withWriteBufferSize(12 * 1024 * 1024)
.onError((id, data, error) -> {
})
.withIndexConfig(HoodieIndexConfig.newBuilder()
.withIndexType(HoodieIndex.IndexType.BLOOM)
.withBloomFilterNumBytes(1024 * 1024)
.