Issue Details (XML | Word | Printable)

Key: HADOOP-3429
Type: Improvement Improvement
Status: Closed Closed
Resolution: Fixed
Priority: Major Major
Assignee: Amareshwari Sriramadasu
Reporter: Devaraj Das
Votes: 0
Watchers: 1
Operations

If you were logged in you would be able to see more operations.
Hadoop Common

Increase the buffersize for the streaming parent java process's streams

Created: 21/May/08 01:56 PM   Updated: 08/Jul/09 05:05 PM
Component/s: None
Affects Version/s: None
Fix Version/s: 0.18.0

Time Tracking:
Not Specified

File Attachments:
  File Name Date Attached Attached By Size
Text File Licensed for inclusion in ASF works patch-3429.txt 2008-05-23 09:37 AM Amareshwari Sriramadasu 3 kB

Hadoop Flags: Reviewed
Release Note: Increased the size of the buffer used in the communication between the Java task and the Streaming process to 128KB.
Resolution Date: 03/Jun/08 02:06 PM


 Description  « Hide
We saw improved performance when we increased the buffersize for Pipes (HADOOP-1788). In the streaming case, the buffersize is 8K (default for BufferedOutputStream). We should set that to 128k.

 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Amareshwari Sriramadasu made changes - 23/May/08 09:37 AM
Field Original Value New Value
Attachment patch-3429.txt [ 12382627 ]
Amareshwari Sriramadasu made changes - 23/May/08 09:38 AM
Status Open [ 1 ] Patch Available [ 10002 ]
Amareshwari Sriramadasu made changes - 23/May/08 10:01 AM
Component/s contrib/streaming [ 12310972 ]
Amareshwari Sriramadasu made changes - 28/May/08 08:40 AM
Status Patch Available [ 10002 ] Open [ 1 ]
Amareshwari Sriramadasu made changes - 28/May/08 08:41 AM
Status Open [ 1 ] Patch Available [ 10002 ]
Amareshwari Sriramadasu made changes - 02/Jun/08 04:29 AM
Status Patch Available [ 10002 ] Open [ 1 ]
Amareshwari Sriramadasu made changes - 02/Jun/08 04:29 AM
Status Open [ 1 ] Patch Available [ 10002 ]
Amareshwari Sriramadasu made changes - 03/Jun/08 04:29 AM
Status Patch Available [ 10002 ] Open [ 1 ]
Amareshwari Sriramadasu made changes - 03/Jun/08 04:29 AM
Status Open [ 1 ] Patch Available [ 10002 ]
Devaraj Das made changes - 03/Jun/08 02:06 PM
Resolution Fixed [ 1 ]
Release Note Increases the size of the buffersize used in the communication between the Java task and the Streaming process to 128K. Gives performance improvements.
Hadoop Flags [Reviewed]
Status Patch Available [ 10002 ] Resolved [ 5 ]
Robert Chansler made changes - 30/Jun/08 10:02 PM
Release Note Increases the size of the buffersize used in the communication between the Java task and the Streaming process to 128K. Gives performance improvements. Increased the size of the buffer used in the communication between the Java task and the Streaming process to 128KB.
Nigel Daley made changes - 22/Aug/08 07:50 PM
Status Resolved [ 5 ] Closed [ 6 ]
Owen O'Malley made changes - 08/Jul/09 05:05 PM
Component/s contrib/streaming [ 12310972 ]

Powered by a free Atlassian JIRA open source license for Apache Software Foundation. Try JIRA - bug tracking software for your team.
Atlassian JIRA the Professional Issue Tracker. (Enterprise Edition, Version: 3.13.2-#335) - Bug/feature request - Atlassian news - Contact Administrators