Uploaded image for project: 'Giraph'
  1. Giraph
  2. GIRAPH-485

Hadoop Shims, smart detect version on job start

    XMLWordPrintableJSON

    Details

    • Type: Wish
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      We should be able to (in theory at least, haven't looked deeply into it yet) use hive style shims to get rid of our munge whatnots and compile against all of the hadoops at once. This would mean having a common interface and a module for each hadoop we support. Then, when the user launches a giraph job we can detect the hadoop we're running in and load the appropriate module.

      This will require some exploration and research to figure out.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                nitay Nitay Joffe
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: