Hadoop Common
  1. Hadoop Common
  2. HADOOP-234

Hadoop Pipes for writing map/reduce jobs in C++ and python

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.14.0
    • Component/s: None
    • Labels:
      None

      Description

      MapReduce C++ support

      Requirements

      1. Allow users to write Map, Reduce, RecordReader, and RecordWriter functions in C++, rest of the infrastructure already present in Java should be reused.
      2. Avoid users having to write both Java and C++ for this to work.
      3. Avoid users having to work with JNI methods directly by wrapping them in helper functions.
      4. The interface should be SWIG'able.

      1. Hadoop MaReduce Developer doc.pdf
        112 kB
        Sanjay Dahiya
      2. hadoop-pipes.html
        11 kB
        Owen O'Malley
      3. pipes.patch
        3.98 MB
        Owen O'Malley
      4. pipes-2.patch
        3.98 MB
        Owen O'Malley

        Issue Links

          Activity

            People

            • Assignee:
              Owen O'Malley
              Reporter:
              Sanjay Dahiya
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development