[PARQUET-20] Better exception when files are unaccessible

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Labels: newbie pick-me-up
• Assignee: Unassigned
• Reporter: Julien Le Dem
• Created: 14/Jul/14 20:01
• Updated: 23/Jun/24 03:26

Description

In some cases the Hadoop filesystem API will throw NullPointerException when trying to access files that have moved.
We'd want to catch those and give a better error message.

Caused by: java.lang.NullPointerException
	at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1043)
	at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:211)
	at parquet.hadoop.ParquetInputFormat.listStatus(ParquetInputFormat.java:395)
	at parquet.hadoop.ParquetInputFormat.getFooters(ParquetInputFormat.java:443)
	at parquet.hadoop.ParquetInputFormat.getGlobalMetaData(ParquetInputFormat.java:467)