Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-234

Hadoop Pipes for writing map/reduce jobs in C++ and python

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.14.0
    • Component/s: None
    • Labels:
      None

      Description

      MapReduce C++ support

      Requirements

      1. Allow users to write Map, Reduce, RecordReader, and RecordWriter functions in C++, rest of the infrastructure already present in Java should be reused.
      2. Avoid users having to write both Java and C++ for this to work.
      3. Avoid users having to work with JNI methods directly by wrapping them in helper functions.
      4. The interface should be SWIG'able.

        Attachments

        1. Hadoop MaReduce Developer doc.pdf
          112 kB
          Sanjay Dahiya
        2. hadoop-pipes.html
          11 kB
          Owen O'Malley
        3. pipes.patch
          3.98 MB
          Owen O'Malley
        4. pipes-2.patch
          3.98 MB
          Owen O'Malley

          Issue Links

            Activity

              People

              • Assignee:
                owen.omalley Owen O'Malley
                Reporter:
                sanjay.dahiya Sanjay Dahiya
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: