[HADOOP-3711] Streaming input is not parsed properly to find the separator

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.19.0
• Hadoop Flags: Reviewed
• Assignee: Amareshwari Sriramadasu
• Reporter: Amareshwari Sriramadasu
• Created: 08/Jul/08 05:55
• Updated: 08/Jul/09 17:05
• Resolved: 10/Jul/08 12:18

Description

Sometimes, finding field separator position in the input line for streaming fails with following exception:
org.apache.hadoop.streaming.PipeMapRed: java.lang.IllegalArgumentException: splitPos must be in the range [0, 17]: 74
at org.apache.hadoop.streaming.UTF8ByteArrayUtils.splitKeyVal(UTF8ByteArrayUtils.java:152)
at org.apache.hadoop.streaming.PipeMapRed.splitKeyVal(PipeMapRed.java:337)
at org.apache.hadoop.streaming.PipeMapRed$MROutputThread.run(PipeMapRed.java:363)