Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-8719 File group reader enhancement - Phase 0
  3. HUDI-7081

Hoodie FilegroupReader cannot read Enums from MOR avro log blocks

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 1.0.1
    • None

    Description

      buildFileGroupIterator(
        Option.empty[PartitionedFile => Iterator[InternalRow]],
        partitionValues,
        Option.empty[HoodieBaseFile],
        getLogFilesFromSlice(fileSlice),
        requiredSchemaWithMandatory,
        outputSchema,
        partitionSchema,
        broadcastedHadoopConf.value.value,
        -1,
        -1,
        shouldUseRecordPosition
      ) 

      This only uses StructType schemas and converts to avro. So it thinks enums are strings

      Attachments

        Issue Links

          Activity

            People

              linliu Lin Liu
              jonvex Jonathan Vexler
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: