Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-234

Hadoop Pipes for writing map/reduce jobs in C++ and python

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.14.0
    • Component/s: None
    • Labels:
      None

      Description

      MapReduce C++ support

      Requirements

      1. Allow users to write Map, Reduce, RecordReader, and RecordWriter functions in C++, rest of the infrastructure already present in Java should be reused.
      2. Avoid users having to write both Java and C++ for this to work.
      3. Avoid users having to work with JNI methods directly by wrapping them in helper functions.
      4. The interface should be SWIG'able.

        Attachments

        1. pipes-2.patch
          3.98 MB
          Owen O'Malley
        2. pipes.patch
          3.98 MB
          Owen O'Malley
        3. hadoop-pipes.html
          11 kB
          Owen O'Malley
        4. Hadoop MaReduce Developer doc.pdf
          112 kB
          Sanjay Dahiya

          Issue Links

            Activity

              People

              • Assignee:
                owen.omalley Owen O'Malley
                Reporter:
                sanjay.dahiya Sanjay Dahiya
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: