Hama
  1. Hama
  2. HAMA-154

[Performance]Combine multi-mapreduce jobs into a single mapreduce job while computing such as 'C=alpha*B + A'

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: math
    • Labels:
      None

      Description

      now, In Hama we use two map-reduce jobs to do 'C=alpha*B + A'.
      first job is to generate a matrix B' = alpha * B
      second job is to generate the result matrix C = B' + A
      I think the first map-reduce job is unneccesary for we can do the constant-multiplication during Addition-MapReducing.

      And we also encount the same problem during computing 'A1 + A2 + ... + An'.
      we need to generate (n-1) hbase-tables for the temp results during addition. Can we just combine n-1 addition-mapreduce jobs into only a simple one?

      1. HAMA-154.patch
        3 kB
        Sijie Guo
      2. HAMA-154_v02.patch
        7 kB
        Sijie Guo
      3. HAMA-154_v03.patch
        12 kB
        Edward J. Yoon

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Unassigned
            Reporter:
            Sijie Guo
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 1h
              1h
              Remaining:
              Remaining Estimate - 1h
              1h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development