[SPARK-23049] `spark.sql.files.ignoreCorruptFiles` should work for ORC files

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.2, 2.1.2, 2.2.1
• Fix Version/s: 2.3.0
• Component/s: SQL
• Assignee: Dongjoon Hyun
• Reporter: Dongjoon Hyun
• Created: 11/Jan/18 22:46
• Updated: 15/Jan/18 04:59
• Resolved: 15/Jan/18 04:59

Description

When `spark.sql.files.ignoreCorruptFiles=true`, we should ignore corrupted ORC files.

Issue Links

• blocks: SPARK-20901 Feature parity for ORC with Parquet
• links to: [Github] Pull Request #20240 (dongjoon-hyun)