Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8885

Improve parquet version metadata error

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • Impala 3.4.0
    • Backend

    Description

      The error looks like this now:

      File 'hdfs://nn/books/books1G.csv' has an invalid version number: .99 This could be due to stale metadata. Try running "refresh s3db.books_s3".
      

      It seems to be reasonably common that this happens because a non-parquet file is being queried in a parquet table.

      The error message should say something like "File 'hdfs://nn/books/books1G.csv' has an invalid Parquet version number: .99 and does not appear to be a valid Parquet file. This could be due to stale metadata. Try running "refresh s3db.books_s3"

      Attachments

        Activity

          People

            tarmstrong Tim Armstrong
            tarmstrong Tim Armstrong
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: