Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-23191

Prevent redundant output descriptor config serialization

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: None
    • Labels:
      None

      Description

      DagUtils#createVertex(JobConf, BaseWork, Path,
       TezWork, Map<String, LocalResource>)

      creates an output descriptor if it is leaf vertex. It uses the same config object that is used in processor descriptor. It should not create payload from scratch when processor descriptor has the identical payload.

        Attachments

        1. HIVE-23191.patch
          0.7 kB
          Mustafa İman
        2. HIVE-23191.patch
          0.7 kB
          Mustafa İman

          Activity

            People

            • Assignee:
              mustafaiman Mustafa İman
              Reporter:
              mustafaiman Mustafa İman
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: