[MAHOUT-277] Increase number of entries in memory per chunk of dictionary

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.3
• Fix Version/s: 0.3
• Component/s: classic
• Assignee: Robin Anil
• Reporter: Robin Anil
• Created: 07/Feb/10 18:51
• Updated: 31/Jan/24 22:17
• Resolved: 07/Feb/10 23:26

Description

Java HashMap was having a huge overhead that was decreasing the number of entries per chunk hence increases number of passes over the data
Dictionary was using Text,LongWritable key. Integer is enough to keep the feature ids.