Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-8720 File group reader enhancement - Phase 1
  3. HUDI-8207

Unmerged reading is broken for spark relation implementation

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • None
    • 1.0.1
    • spark
    • None

    Description

      It does not merge the base file and log files, but the log files are merged. If you only have 1 log file in the filegroup it looks like it works correctly, but if you have 2 or more it has incorrect behavior

      Attachments

        Issue Links

          Discovered while testing

          Improvement - An improvement or enhancement to an existing feature or task. HUDI-7341 Support unmerged log reader for HoodieFileGroupReader

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          is caused by

          New Feature - A new feature of the product, which has yet to be developed. HUDI-69 Support realtime view in Spark datasource #136

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Activity

            People

              Unassigned Unassigned
              jonvex Jonathan Vexler
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: