Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-8357

BaseHoodieTableFileIndex should not scan archival timeline

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Blocker
    • Resolution: Unresolved
    • None
    • 1.0.0, 0.15.1
    • None
    • None

    Description

      When developing completion time incremental query(https://github.com/apache/hudi/pull/11947), we noticed that BaseHoodieTableFileIndex#listPartitionPaths would scan archival timeline, which would harm the performance of incremental queries. This issue was addressed along with the PR above in 1.0, but we need to address this for Hudi 0.x as well

      Attachments

        Activity

          People

            Unassigned Unassigned
            yc2523 Shawn Chang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: