Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-234

Hadoop Pipes for writing map/reduce jobs in C++ and python

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.14.0
    • None
    • None

    Description

      MapReduce C++ support

      Requirements

      1. Allow users to write Map, Reduce, RecordReader, and RecordWriter functions in C++, rest of the infrastructure already present in Java should be reused.
      2. Avoid users having to write both Java and C++ for this to work.
      3. Avoid users having to work with JNI methods directly by wrapping them in helper functions.
      4. The interface should be SWIG'able.

      Attachments

        1. pipes-2.patch
          3.98 MB
          Owen O'Malley
        2. pipes.patch
          3.98 MB
          Owen O'Malley
        3. hadoop-pipes.html
          11 kB
          Owen O'Malley
        4. Hadoop MaReduce Developer doc.pdf
          112 kB
          Sanjay Dahiya

        Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-1251 A method to get the InputSplit from a Mapper

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-1250 Remove the MustangFile class from streaming and promote the chmod into FileUtils

          • Major - Major loss of function.
          • Closed

          Activity

            People

              omalley Owen O'Malley
              sanjay.dahiya Sanjay Dahiya
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: