Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1423

Ability to pass custom properties to keySerializer for OnFileUnorderedPartitionedKVOutput

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.5.0
    • None
    • None
    • Incompatible change, Reviewed

    Description

      Using OnFileUnorderedPartitionedKVOutput there is no way of passing custom properties to its keySerializer class given that this class implements Configurable.

      For OnFileSortedOutput this is possible because comparatorConf and partitionerConf touching both sides, the input and the output.

      Possible solutions could be either passing a map to keySerializer configuration as well or have custom properties for the input and the output of an edge.

      Attachments

        1. TEZ-1423.1.txt
          41 kB
          Siddharth Seth
        2. TEZ-1423.2.patch
          41 kB
          Bikas Saha

        Activity

          People

            sseth Siddharth Seth
            oae Johannes Zillmann
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: