Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3883

Document yarn.nodemanager.delete.debug-delay-sec configuration property

    Details

      Description

      If you are using Yarn's nodemanager, you can add to your configuration:

        <property>
          <name>yarn.nodemanager.delete.debug-delay-sec</name>
          <value>10000000</value>
        </property>
      

      to save the environmental directories of the applications (by default in /tmp/nm-local-dir) that the nodemanager starts so that you can examine them later.

      Set the above value long enough so that you have time to examine the contents before the nodemanager's DeletionService removes them.

      This setting is defined in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java, and used in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DeletionService.java.

      It's a useful configuration setting for developers, but seems not to be documented currently (see http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/yarn-default.xml).

      1. MAPREDUCE-3883.patch
        1 kB
        Eugene Koontz
      2. MAPREDUCE-3883.patch
        3 kB
        Eugene Koontz
      3. MAPREDUCE-3883.patch
        3 kB
        Eugene Koontz
      4. MAPREDUCE-3883.patch
        3 kB
        Eugene Koontz

        Issue Links

          Activity

          Allen Wittenauer made changes -
          Fix Version/s trunk [ 12320360 ]
          Eugene Koontz made changes -
          Link This issue relates to MAPREDUCE-4276 [ MAPREDUCE-4276 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Thomas Graves made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.23.2 [ 12319851 ]
          Resolution Fixed [ 1 ]
          Eugene Koontz made changes -
          Attachment MAPREDUCE-3883.patch [ 12524948 ]
          Eugene Koontz made changes -
          Attachment MAPREDUCE-3883.patch [ 12524922 ]
          Eugene Koontz made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 2.0.0 [ 12320354 ]
          Fix Version/s trunk [ 12320360 ]
          Eugene Koontz made changes -
          Attachment MAPREDUCE-3883.patch [ 12524907 ]
          Thomas Graves made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Target Version/s 2.0.0 [ 12320354 ]
          Eugene Koontz made changes -
          Attachment MAPREDUCE-3883.patch [ 12515488 ]
          Eugene Koontz made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Mahadev konar made changes -
          Assignee Eugene Koontz [ ekoontz ]
          Mahadev konar made changes -
          Component/s mrv2 [ 12314301 ]
          Eugene Koontz made changes -
          Description If you are using Yarn's nodemanager, you can add to your configuration:

          {noformat}
            <property>
              <name>yarn.nodemanager.delete.debug-delay-sec</name>
              <value>10000000</value>
            </property>
          {noformat}

          to save the environmental directories of the applications (by default in {{/tmp/nm-local-dir}} that the nodemanager starts so that you can examine them later.

          Set the above value long enough so that you have time to examine the contents before the nodemanager's {{DeletionService}} removes them.

          This setting is defined in {{hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java}}, and used in {{hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DeletionService.java}}.

          It's a useful configuration setting for developers, but seems not to be documented currently (see http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/yarn-default.xml).


          If you are using Yarn's nodemanager, you can add to your configuration:

          {noformat}
            <property>
              <name>yarn.nodemanager.delete.debug-delay-sec</name>
              <value>10000000</value>
            </property>
          {noformat}

          to save the environmental directories of the applications (by default in {{/tmp/nm-local-dir}}) that the nodemanager starts so that you can examine them later.

          Set the above value long enough so that you have time to examine the contents before the nodemanager's {{DeletionService}} removes them.

          This setting is defined in {{hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java}}, and used in {{hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DeletionService.java}}.

          It's a useful configuration setting for developers, but seems not to be documented currently (see http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/yarn-default.xml).


          Eugene Koontz made changes -
          Field Original Value New Value
          Description If you are using Yarn's nodemanager, you can add to your configuration:

          {{
            <property>
              <name>yarn.nodemanager.delete.debug-delay-sec</name>
              <value>10000000</value>
            </property>
          }}

          (set the {{<value>}} large enough so that you can examine the contents before the {{DeletionService}} deletes them).

          to save the environmental directories of the applications (by default in {{/tmp/nm-local-dir}} that the nodemanager starts so that you can examine them later.

          This setting is defined in {{hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java}}, and used in {{hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DeletionService.java}}.

          It's a useful configuration setting for developers, but seems not to be documented currently (see http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/yarn-default.xml).


          If you are using Yarn's nodemanager, you can add to your configuration:

          {noformat}
            <property>
              <name>yarn.nodemanager.delete.debug-delay-sec</name>
              <value>10000000</value>
            </property>
          {noformat}

          to save the environmental directories of the applications (by default in {{/tmp/nm-local-dir}} that the nodemanager starts so that you can examine them later.

          Set the above value long enough so that you have time to examine the contents before the nodemanager's {{DeletionService}} removes them.

          This setting is defined in {{hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java}}, and used in {{hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DeletionService.java}}.

          It's a useful configuration setting for developers, but seems not to be documented currently (see http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/yarn-default.xml).


          Eugene Koontz created issue -

            People

            • Assignee:
              Eugene Koontz
              Reporter:
              Eugene Koontz
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development