Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8885

Improve parquet version metadata error

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: Impala 3.4.0
    • Component/s: Backend
    • Labels:

      Description

      The error looks like this now:

      File 'hdfs://nn/books/books1G.csv' has an invalid version number: .99 This could be due to stale metadata. Try running "refresh s3db.books_s3".
      

      It seems to be reasonably common that this happens because a non-parquet file is being queried in a parquet table.

      The error message should say something like "File 'hdfs://nn/books/books1G.csv' has an invalid Parquet version number: .99 and does not appear to be a valid Parquet file. This could be due to stale metadata. Try running "refresh s3db.books_s3"

        Attachments

          Activity

            People

            • Assignee:
              tarmstrong Tim Armstrong
              Reporter:
              tarmstrong Tim Armstrong
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: