[ORC-527] orc-tools cannot read files it creates itself

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Invalid
• Affects Version/s: 1.5.5, 1.6.0
• Component/s: tools
• Assignee: Unassigned
• Reporter: Fabian Groffen
• Created: 27/Jun/19 11:34
• Updated: 12/Jan/21 03:14
• Resolved: 27/Jun/19 12:29

Description

Same scenario as ORC-526.

$ cat timestamp2.csv
2019-01-01 00:00:00.0000
2015-01-01 00:00:00.0001
2015-01-01 00:00:00.0000
2014-12-31 23:59:59.9999
1970-01-01 00:00:00.0001
1970-01-01 00:00:00.0000
1969-12-31 23:59:59.9999
1969-12-31 23:59:59.0001
1969-12-31 23:59:59.0000
1969-12-31 23:59:58.9999
$ env TZ=UTC java -jar tools/target/orc-tools-1.6.0-SNAPSHOT-uber.jar convert --schema timestamp --timestampformat "yyyy-MM-dd HH:mm:ss.SSSS" timestamp2.csv -o timestamp2-tools16.orc
{{$ java -jar tools/target/orc-tools-1.6.0-SNAPSHOT-uber.jar data timestamp2-tools16.orc       }}
log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Processing data file timestamp2-tools16.orc [length: 207]
Unable to dump data for file: timestamp2-tools16.orc
org.codehaus.jettison.json.JSONException: Value out of sequence.
        at org.codehaus.jettison.json.JSONWriter.append(JSONWriter.java:136)
        at org.codehaus.jettison.json.JSONWriter.value(JSONWriter.java:323)
        at org.apache.orc.tools.PrintData.printValue(PrintData.java:154)
        at org.apache.orc.tools.PrintData.printRow(PrintData.java:192)
        at org.apache.orc.tools.PrintData.printJsonData(PrintData.java:206)
        at org.apache.orc.tools.PrintData.main(PrintData.java:241)
        at org.apache.orc.tools.Driver.main(Driver.java:110)