Uploaded image for project: 'Mahout'
  1. Mahout
  2. MAHOUT-277

Increase number of entries in memory per chunk of dictionary

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.3
    • Fix Version/s: 0.3
    • Component/s: Integration
    • Labels:
      None

      Description

      Java HashMap was having a huge overhead that was decreasing the number of entries per chunk hence increases number of passes over the data
      Dictionary was using Text,LongWritable key. Integer is enough to keep the feature ids.

        Attachments

        1. MAHOUT-277.patch
          6 kB
          Robin Anil

          Activity

            People

            • Assignee:
              robinanil Robin Anil
              Reporter:
              robinanil Robin Anil
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: