[ORC-233] Allow `orc.include.columns` to be empty

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.4.1, 1.5.0
• Component/s: Java
• Assignee: Ajay Yadav
• Reporter: Dongjoon Hyun
• Created: 18/Aug/17 20:35
• Updated: 17/Oct/17 08:46
• Resolved: 29/Aug/17 17:06

Description

Apache ORC should support returning all NULLs by the following.

conf.set(OrcConf.INCLUDE_COLUMNS.getAttribute, "")

Currently, it raises the following exceptions.

For input string: ""
java.lang.NumberFormatException: For input string: ""
	at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
	at java.lang.Integer.parseInt(Integer.java:592)
	at java.lang.Integer.parseInt(Integer.java:615)
	at org.apache.orc.mapred.OrcInputFormat.parseInclude(OrcInputFormat.java:69)

Issue Links

• relates to: SPARK-20901 Feature parity for ORC with Parquet
• links to: GitHub Pull Request #160