Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1423

Ability to pass custom properties to keySerializer for OnFileUnorderedPartitionedKVOutput

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.5.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Incompatible change, Reviewed

      Description

      Using OnFileUnorderedPartitionedKVOutput there is no way of passing custom properties to its keySerializer class given that this class implements Configurable.

      For OnFileSortedOutput this is possible because comparatorConf and partitionerConf touching both sides, the input and the output.

      Possible solutions could be either passing a map to keySerializer configuration as well or have custom properties for the input and the output of an edge.

        Attachments

        1. TEZ-1423.2.patch
          41 kB
          Bikas Saha
        2. TEZ-1423.1.txt
          41 kB
          Siddharth Seth

          Activity

            People

            • Assignee:
              sseth Siddharth Seth
              Reporter:
              oae Johannes Zillmann
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: