Issue Details (XML | Word | Printable)

Key: HADOOP-3863
Type: Bug Bug
Status: Closed Closed
Resolution: Fixed
Priority: Critical Critical
Assignee: Arun C Murthy
Reporter: Arun C Murthy
Votes: 0
Watchers: 1
Operations

If you were logged in you would be able to see more operations.
Hadoop Common

Use a thread-local rather than static ENCODER/DECODER variables in Text for synchronization

Created: 30/Jul/08 05:59 PM   Updated: 08/Jul/09 04:52 PM
Return to search
Component/s: None
Affects Version/s: 0.18.0
Fix Version/s: 0.19.0

Time Tracking:
Not Specified

File Attachments:
  Size
Text File Licensed for inclusion in ASF works HADOOP-3863_0_20080730.patch 2008-07-30 06:53 PM Arun C Murthy 5 kB
Text File Licensed for inclusion in ASF works HADOOP-3863_1_20080730.patch 2008-07-30 09:57 PM Arun C Murthy 5 kB

Hadoop Flags: Reviewed
Resolution Date: 30/Jul/08 10:59 PM


 Description  « Hide
Text.{ENCODER|DECODER} are static variables which need to be synchronized in Text.{read|write}String; given that lots of RPC code calls Text.{read|write}String the contention for this lock shows up very significantly on large clusters.

 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Repository Revision Date User Message
ASF #681238 Wed Jul 30 22:59:02 UTC 2008 omalley HADOOP-3863. Use a thread-local string encoder rather than a static one
that is protected by a lock. (acmurthy via omalley)
Files Changed
MODIFY /hadoop/core/trunk/src/core/org/apache/hadoop/io/Text.java
MODIFY /hadoop/core/trunk/CHANGES.txt
MODIFY /hadoop/core/trunk/src/test/org/apache/hadoop/io/TestText.java