Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-65

add a record I/O framework to hadoop

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.2.0
    • Fix Version/s: 0.2.0
    • Component/s: io, ipc
    • Labels:
      None

      Description

      Hadoop could benefit greatly from a simple record I/O framework that enables the specification of simple record types and enables the generation of code for serialization/deserialization in multiple target languages. The framework would handle a small well understood set of primitive types and simple compositions of these (structs, vectors, maps) . It would be possible to leverage this framework to express I/O in MapReduce computations and to use this as the basis for Hadoops RPC implementation. This would make interfacing with code in languages other than Java much easier.

        Attachments

        1. HadoopRecordIO.patch
          368 kB
          Milind Barve

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              sameerp Sameer Paranjpye
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: