Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-234

Hadoop Pipes for writing map/reduce jobs in C++ and python

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.14.0
    • None
    • None

    Description

      MapReduce C++ support

      Requirements

      1. Allow users to write Map, Reduce, RecordReader, and RecordWriter functions in C++, rest of the infrastructure already present in Java should be reused.
      2. Avoid users having to write both Java and C++ for this to work.
      3. Avoid users having to work with JNI methods directly by wrapping them in helper functions.
      4. The interface should be SWIG'able.

      Attachments

        1. Hadoop MaReduce Developer doc.pdf
          112 kB
          Sanjay Dahiya
        2. hadoop-pipes.html
          11 kB
          Owen O'Malley
        3. pipes.patch
          3.98 MB
          Owen O'Malley
        4. pipes-2.patch
          3.98 MB
          Owen O'Malley

        Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-1251 A method to get the InputSplit from a Mapper

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-1250 Remove the MustangFile class from streaming and promote the chmod into FileUtils

          • Major - Major loss of function.
          • Closed

          Activity

            People

              omalley Owen O'Malley
              sanjay.dahiya Sanjay Dahiya
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: