Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-4141

Let Input/Output Processors load local xml configs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Abandoned
    • None
    • None
    • None
    • None

    Description

      We would like to reduce the amount of configuration going over the wire from a client to application master. If Input/Output processors load local config files, we can reduce the configuration overhead when client and the processors have the exact same config on both sides. It is on user of client to keep the configs same on both sides. Currently, clients have to send all config in payload. Even if we preload config with local xml files, these should be overridden by the full config object coming in payload. Therefore, old clients that send all the config anyway would not be affected in terms of correctness from this change.

      Attachments

        1. TEZ-4141.1.patch
          1 kB
          Mustafa İman

        Activity

          People

            mustafaiman Mustafa İman
            mustafaiman Mustafa İman
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: