Uploaded image for project: 'Giraph'
  1. Giraph
  2. GIRAPH-485

Hadoop Shims, smart detect version on job start

    XMLWordPrintableJSON

Details

    • Wish
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      We should be able to (in theory at least, haven't looked deeply into it yet) use hive style shims to get rid of our munge whatnots and compile against all of the hadoops at once. This would mean having a common interface and a module for each hadoop we support. Then, when the user launches a giraph job we can detect the hadoop we're running in and load the appropriate module.

      This will require some exploration and research to figure out.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              nitay Nitay Joffe
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: