Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-7028

Fix Spark Quick Start

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • 1.0.0
    • None
    • None

    Description

      Fix the bugs for Spark quick start when turning on file group reader and positional merging flag.

       

      List some issues found so far:

      1. [compatibility]When no positions are stored in the header, the read query failed. Idea behavior: use key based merging instead of failing.
      2. [compatibility]When a parquet file contains Avro records, the file group reader of spark job will check if the payload is the expected type; otherwise, it will throw.

      Attachments

        Activity

          People

            jonvex Jonathan Vexler
            linliu Lin Liu
            Y Ethan Guo
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: