Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-3288

Partition specific compaction strategy for the metadata table

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • None
    • None
    • compaction, index, metadata, table-service
    • None

    Description

      With bloom filters and also col stats, I am not sure if the same compaction policy works for everything. for e.g we might want to compact the "files" partition more aggressively than "col_stats" or "bloom_filters" 

       

      We need controls for all this. 

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HUDI-3317 Partition specific pointed lookup/reading strategy for metadata table

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Activity

            People

              codope Sagar Sumit
              vinoth Vinoth Chandar
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: