[SPARK-7117] SparkSQL and Spark sometimes throw exceptions when reading Parquet files.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Flags: Patch
• Assignee: Unassigned
• Reporter: Jason Taylor
• Created: 24/Apr/15 07:51
• Updated: 24/Apr/15 11:56
• Resolved: 24/Apr/15 11:56

Description

Upgrading the parquet version to 1.6.0rc6 resolves this along with one fix to an API call.

I have attached the patch.

Exception below...

15/04/23 14:48:03 ERROR thriftserver.SparkExecuteStatementOperation: Error executing query:
java.lang.NullPointerException
at parquet.format.converter.ParquetMetadataConverter.fromParquetStatistics(ParquetMetadataConverter.java:249)

Issue Links

• duplicates: SPARK-6566 Update Spark to use the latest version of Parquet libraries