Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-20

Better exception when files are unaccessible

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      In some cases the Hadoop filesystem API will throw NullPointerException when trying to access files that have moved.
      We'd want to catch those and give a better error message.

      Caused by: java.lang.NullPointerException
      	at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1043)
      	at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:211)
      	at parquet.hadoop.ParquetInputFormat.listStatus(ParquetInputFormat.java:395)
      	at parquet.hadoop.ParquetInputFormat.getFooters(ParquetInputFormat.java:443)
      	at parquet.hadoop.ParquetInputFormat.getGlobalMetaData(ParquetInputFormat.java:467)
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            julienledem Julien Le Dem
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: