Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3883

Document yarn.nodemanager.delete.debug-delay-sec configuration property

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      If you are using Yarn's nodemanager, you can add to your configuration:

        <property>
          <name>yarn.nodemanager.delete.debug-delay-sec</name>
          <value>10000000</value>
        </property>
      

      to save the environmental directories of the applications (by default in /tmp/nm-local-dir) that the nodemanager starts so that you can examine them later.

      Set the above value long enough so that you have time to examine the contents before the nodemanager's DeletionService removes them.

      This setting is defined in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java, and used in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DeletionService.java.

      It's a useful configuration setting for developers, but seems not to be documented currently (see http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/yarn-default.xml).

      Attachments

        1. MAPREDUCE-3883.patch
          1 kB
          Eugene Joseph Koontz
        2. MAPREDUCE-3883.patch
          3 kB
          Eugene Joseph Koontz
        3. MAPREDUCE-3883.patch
          3 kB
          Eugene Joseph Koontz
        4. MAPREDUCE-3883.patch
          3 kB
          Eugene Joseph Koontz

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ekoontz Eugene Joseph Koontz
            ekoontz Eugene Joseph Koontz
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment