Uploaded image for project: 'Hama'
  1. Hama
  2. HAMA-423

Improve and Refactor Partitioning in the Examples

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.3.0
    • 0.4.0
    • examples
    • None

    Description

      Currently partitioning will write a key/value pair for each vertex/adjacent mapping.
      This results in heavy IO writes which actually bloats the file and let the partitioning take unnecessarily long.

      We should partition directly into the vertex classes and implement a vertex list/array writable which just writes a single key/value pair for a vertex/all-adjacents mapping.

      In fact we should make it generic, passing a vertex class which should implement the Writable interface.

      Attachments

        1. sickimprovement.PNG
          10 kB
          Thomas Jungblut
        2. HAMA-423-withoutCRs.patch
          54 kB
          Thomas Jungblut
        3. HAMA-423-v1.patch
          54 kB
          Thomas Jungblut

        Activity

          People

            thomas.jungblut Thomas Jungblut
            thomas.jungblut Thomas Jungblut
            Votes:
            1 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: