Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-65

add a record I/O framework to hadoop

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.2.0
    • 0.2.0
    • io, ipc
    • None

    Description

      Hadoop could benefit greatly from a simple record I/O framework that enables the specification of simple record types and enables the generation of code for serialization/deserialization in multiple target languages. The framework would handle a small well understood set of primitive types and simple compositions of these (structs, vectors, maps) . It would be possible to leverage this framework to express I/O in MapReduce computations and to use this as the basis for Hadoops RPC implementation. This would make interfacing with code in languages other than Java much easier.

      Attachments

        1. HadoopRecordIO.patch
          368 kB
          Milind Barve

        Activity

          People

            Unassigned Unassigned
            sameerp Sameer Paranjpye
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: