[HADOOP-3429] Increase the buffersize for the streaming parent java process's streams

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.18.0
• Hadoop Flags: Reviewed
• Release Note: Increased the size of the buffer used in the communication between the Java task and the Streaming process to 128KB.
• Assignee: Amareshwari Sriramadasu
• Reporter: Devaraj Das
• Created: 21/May/08 13:56
• Updated: 08/Jul/09 17:05
• Resolved: 03/Jun/08 14:06

Description

We saw improved performance when we increased the buffersize for Pipes (HADOOP-1788). In the streaming case, the buffersize is 8K (default for BufferedOutputStream). We should set that to 128k.