Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6685

Change the generic serialization framework API to use serialization-specific bytes instead of Map<String,String> for configuration

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • None
    • None
    • Incompatible change

    Description

      Currently, the generic serialization framework uses Map<String,String> for the serialization specific configuration. Since this data is really internal to the specific serialization, I think we should change it to be an opaque binary blob. This will simplify the interface for defining specific serializations for different contexts (MAPREDUCE-1462). It will also move us toward having serialized objects for Mappers, Reducers, etc (MAPREDUCE-1183).

      Attachments

        1. serial.patch
          362 kB
          Owen O'Malley
        2. SerializationAtSummit.pdf
          297 kB
          Owen O'Malley
        3. serial4.patch
          369 kB
          Owen O'Malley
        4. serial6.patch
          370 kB
          Owen O'Malley
        5. serial7.patch
          371 kB
          Owen O'Malley
        6. serial9.patch
          376 kB
          Owen O'Malley

        Issue Links

          Activity

            People

              omalley Owen O'Malley
              omalley Owen O'Malley
              Votes:
              0 Vote for this issue
              Watchers:
              41 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: