Uploaded image for project: 'Giraph (Retired)'
  1. Giraph (Retired)
  2. GIRAPH-13

Port Giraph to YARN

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      Now that YARN (aka MR2 aka MAPREDUCE-279) has been merged into the Hadoop trunk, we should think about what it would take to separate out the graph processing bits of Giraph from the MR1-specific code so as to take advantage of the less-MR centric aspects of YARN, while still supporting both over the medium term.

      Review Board link (ready for review now): https://reviews.apache.org/r/9811/

      Attachments

        1. GIRAPH-13-9-r6.patch
          123 kB
          Eli Reisman
        2. GIRAPH-13-9-r5.patch
          121 kB
          Eli Reisman
        3. GIRAPH-13-9-r4.patch
          121 kB
          Eli Reisman
        4. GIRAPH-13-9-r3.patch
          120 kB
          Eli Reisman
        5. GIRAPH-13-9-r2.patch
          117 kB
          Eli Reisman
        6. GIRAPH-13-9-r1.patch
          116 kB
          Eli Reisman
        7. GIRAPH-13-9.patch
          115 kB
          Eli Reisman
        8. GIRAPH-13-8.patch
          94 kB
          Eli Reisman
        9. GIRAPH-13-7.patch
          90 kB
          Eli Reisman
        10. GIRAPH-13-6.patch
          77 kB
          Eli Reisman
        11. GIRAPH-13-5.patch
          72 kB
          Eli Reisman
        12. GIRAPH-13-4.patch
          72 kB
          Eli Reisman
        13. GIRAPH-13-3.patch
          65 kB
          Eli Reisman
        14. GIRAPH-13-2.patch
          118 kB
          Eli Reisman
        15. GIRAPH-13-1.patch
          109 kB
          Eli Reisman

        Issue Links

          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. GIRAPH-37 Implement Netty-backed IPC

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. GIRAPH-77 Coordinator should expose a web interface with progress, vertex region assignments, etc.

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. GIRAPH-76 Refactor worker logic from GraphMapper

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. GIRAPH-158 Support YARN (next generation MapReduce)

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. GIRAPH-108 Refactor code to run independently of Map/Reduce

          • Major - Major loss of function.
          • Open
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. GIRAPH-628 Can't build Giraph without git due to mavanagaiata not configured right

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              initialcontext Eli Reisman
              jghoman Jakob Homan
              Votes:
              0 Vote for this issue
              Watchers:
              31 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: