[HUDI-3524] Decouple basic and advanced configs in website

• Type: Task
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.12.1
• Component/s: docs
• Labels: hudi-on-call pull-request-available
• Assignee: Bhavani Sudha
• Reporter: sivabalan narayanan

Reviewers

sivabalan narayanan

• Created: 27/Feb/22 19:12
• Updated: 07/Nov/22 10:26
• Resolved: 07/Nov/22 10:26

Description

Spark Datasource Configs

Read configs:
hoodie.datasource.query.type

Write Options

hoodie.datasource.write.operation
hoodie.datasource.write.recordkey.field
hoodie.datasource.write.precombine.field
hoodie.datasource.write.partitionpath.field
hoodie.datasource.write.keygenerator.class
hoodie.datasource.write.payload.class
hoodie.datasource.write.table.type
hoodie.datasource.write.table.name
hoodie.datasource.hive_sync.enable
hoodie.datasource.write.hive_style_partitioning
hoodie.datasource.hive_sync.mode
hoodie.datasource.write.partitionpath.urlencode
hoodie.datasource.hive_sync.partition_extractor_class
hoodie.datasource.hive_sync.partition_fields

Storage Config:
hoodie.parquet.max.file.size
hoodie.parquet.block.size

HoodieMetadataConfig:
hoodie.metadata.enable

WriteConfigurations:
hoodie.combine.before.upsert
hoodie.write.markers.type
hoodie.insert.shuffle.parallelism
hoodie.rollback.parallelism
hoodie.combine.before.delete
hoodie.combine.before.insert
hoodie.bulkinsert.shuffle.parallelism
hoodie.delete.shuffle.parallelism
hoodie.bulkinsert.sort.mode
hoodie.embed.timeline.server
hoodie.upsert.shuffle.parallelism
hoodie.rollback.using.markers
hoodie.finalize.write.parallelism

Compaction config:

hoodie.copyonwrite.record.size.estimate
hoodie.compact.inline.max.delta.seconds
hoodie.cleaner.policy
hoodie.cleaner.commits.retained
hoodie.clean.async
hoodie.clean.automatic
hoodie.commits.archival.batch
hoodie.compact.inline
hoodie.parquet.small.file.limit
hoodie.compaction.strategy
hoodie.archive.automatic
hoodie.copyonwrite.insert.auto.split
hoodie.compact.inline.max.delta.commits
hoodie.keep.min.commits
hoodie.cleaner.parallelism
hoodie.record.size.estimation.threshold
hoodie.compact.inline.trigger.strategy
hoodie.keep.max.commits
hoodie.copyonwrite.insert.split.size

File System View Storage Configurations
hoodie.filesystem.view.type
hoodie.filesystem.view.secondary.type

Index Configs:
hoodie.index.type
hoodie.index.bloom.fpp
hoodie.index.bloom.num_entries
hoodie.bloom.index.update.partition.path
hoodie.bloom.index.use.caching
hoodie.bloom.index.parallelism
hoodie.bloom.index.prune.by.ranges
hoodie.bloom.index.filter.type

hoodie.simple.index.parallelism
hoodie.simple.index.use.caching
hoodie.global.simple.index.parallelism
hoodie.simple.index.update.partition.path

Common Configrations:
hoodie.common.spillable.diskmap.type

Metrics Configs:

hoodie.metrics.reporter.type
hoodie.metrics.on
hoodie.metrics.reporter.class

Record payload configs:
hoodie.payload.ordering.field
hoodie.payload.event.time.field

Issue Links

• links to: GitHub Pull Request #4927