Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-4102

Optimization of bucket index in Flink

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • None
    • index
    • None

    Description

      write.task value can only be less than or equal to bucket num value, because even if it is exceeded, the writing efficiency cannot be improved.This is because the bucket index does not consider partition in partitioncustom

      Attachments

        1. write.task=80,bucket=1.png
          373 kB
          HunterXHunter

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. HUDI-4101 BucketIndexPartitioner should take partition path for better dispersion

          • Major - Major loss of function.
          • Closed

          Activity

            People

              minihippo XiaoyuGeng
              HunterHunter HunterXHunter
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: