Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-4034

Improve log merging performance for Metadata Table

    XMLWordPrintableJSON

Details

    • Task
    • Status: In Progress
    • Blocker
    • Resolution: Unresolved
    • None
    • None
    • metadata, performance
    • None

    Description

      For Metadata Table as a MOR table, there is a separate log record reader "HoodieMetadataMergedLogRecordReader".  We want to see if we can further improve the merging latency on different file systems including S3.

      Attachments

        Activity

          People

            guoyihua Ethan Guo
            guoyihua Ethan Guo
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: