[TEZ-4275] Use Google Guava Intern Facility

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.3, 0.10.2
• Assignee: David Mollitor
• Reporter: David Mollitor
• Created: 28/Jan/21 21:42
• Updated: 30/Jun/21 15:10
• Resolved: 30/Jun/21 15:10

Description

Google Guava has a pretty cool Interner facility.

 

• More memory efficient than current offering.  Map contains a weak key and a static dummy value (current implementation uses a weak value)
• Current implementation has a single lock around the entire data structure.  Google segments their data structure into (default: 4) segments for better concurrency
• All the other thoughtful stuff Google has added into this feature

Issue Links

• is blocked by: TEZ-2164 Shade the guava version used by Tez and move to guava-18
• links to: GitHub Pull Request #95