Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-4141

Let Input/Output Processors load local xml configs

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Abandoned
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      We would like to reduce the amount of configuration going over the wire from a client to application master. If Input/Output processors load local config files, we can reduce the configuration overhead when client and the processors have the exact same config on both sides. It is on user of client to keep the configs same on both sides. Currently, clients have to send all config in payload. Even if we preload config with local xml files, these should be overridden by the full config object coming in payload. Therefore, old clients that send all the config anyway would not be affected in terms of correctness from this change.

        Attachments

        1. TEZ-4141.1.patch
          1 kB
          Mustafa İman

          Activity

            People

            • Assignee:
              mustafaiman Mustafa İman
              Reporter:
              mustafaiman Mustafa İman
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: