Uploaded image for project: 'Hama'
  1. Hama
  2. HAMA-154

[Performance]Combine multi-mapreduce jobs into a single mapreduce job while computing such as 'C=alpha*B + A'

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • math
    • None

    Description

      now, In Hama we use two map-reduce jobs to do 'C=alpha*B + A'.
      first job is to generate a matrix B' = alpha * B
      second job is to generate the result matrix C = B' + A
      I think the first map-reduce job is unneccesary for we can do the constant-multiplication during Addition-MapReducing.

      And we also encount the same problem during computing 'A1 + A2 + ... + An'.
      we need to generate (n-1) hbase-tables for the temp results during addition. Can we just combine n-1 addition-mapreduce jobs into only a simple one?

      Attachments

        1. HAMA-154.patch
          3 kB
          Sijie Guo
        2. HAMA-154_v02.patch
          7 kB
          Sijie Guo
        3. HAMA-154_v03.patch
          12 kB
          Edward J. Yoon

        Activity

          People

            Unassigned Unassigned
            hustlmsp Sijie Guo
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 1h
                1h
                Remaining:
                Remaining Estimate - 1h
                1h
                Logged:
                Time Spent - Not Specified
                Not Specified