Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-2679

Admin forms of launch env settings

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.7.1, 0.8.2
    • None
    • None
    • Incompatible change
    • Hide
      TEZ-2679 introduced new admin configuration (tez.am.launch.cluster-default.env, tez.task.launch.cluster-default.env) settings. The settings will be merged per environment variable and environment variables specified in both admin setting and user override will merged in the following manner (assuming linux classpath here, but works for other OS's).

      ./:USER_PATH:ADMIN_PATH
      Show
      TEZ-2679 introduced new admin configuration (tez.am.launch.cluster-default.env, tez.task.launch.cluster-default.env) settings. The settings will be merged per environment variable and environment variables specified in both admin setting and user override will merged in the following manner (assuming linux classpath here, but works for other OS's). ./:USER_PATH:ADMIN_PATH

    Description

      Tez should provide corresponding admin configs for launch env and java opt settings that can be specified in tez-site.xml by cluster admins. For example, if users override the launch env settings to setup LD_LIBRARY_PATH to just reference their libs then we can fail to load the native Hadoop libs.

      This is currently mitigated by having Tez rely on the MapReduce admin properties in many cases, but Tez should provide its own admin settings to match the Tez-specific non-admin settings.

      Attachments

        1. TEZ-2679.1.patch
          9 kB
          Jonathan Turner Eagles
        2. TEZ-2679.2.patch
          9 kB
          Jonathan Turner Eagles
        3. TEZ-2679.3.patch
          9 kB
          Jonathan Turner Eagles
        4. TEZ-2679.4.patch
          9 kB
          Jonathan Turner Eagles

        Activity

          People

            jeagles Jonathan Turner Eagles
            jlowe Jason Darrell Lowe
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: