Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1019

YarnConfiguration validation for local disk path and http addresses.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 2.0.5-alpha
    • Fix Version/s: None
    • Component/s: None

      Description

      Today we are not validating certain configuration parameters set in yarn-site.xml. 1) Configurations related to paths... such as local-dirs, log-dirs.. Our NM crashes during startup if they are set to relative paths rather than absolute paths. To avoid such failures we can enforce checks (absolute paths) before startup . i.e. before we actually startup...( i.e. directory handler creating directories).
      2) Also for all the parameters using "hostname:port" unless we are ok with default port.

        Attachments

        1. YARN-1019.0.patch
          2 kB
          Rekha Joshi

          Issue Links

            Activity

              People

              • Assignee:
                sunilg Sunil G
                Reporter:
                ojoshi Omkar Vinit Joshi
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated: