Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-101

Exception when reading data with parquet.task.side.metadata=false

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.6.0
    • 1.6.0
    • None
    • None

    Description

      Error: java.lang.IllegalStateException: All the offsets listed in the split should be found in the file. expected: [178996073, 202818477] found: REDACTED] out of: [4, 30470363, 51019598, 69907789, 106365281, 126337626, 145280217, 178996073] in range 0, 202818477
      at parquet.hadoop.ParquetRecordReader.initializeInternalReader(ParquetRecordReader.java:175)

      Attachments

        Issue Links

          is broken by

          Improvement - An improvement or enhancement to an existing feature or task. PARQUET-84 Add an option to read the rowgroup metadata on the task side.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              julienledem Julien Le Dem
              julienledem Julien Le Dem
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: