Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3805

Update the documentation of Disk Checker based on YARN-90

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: documentation
    • Labels:
      None
    • Target Version/s:

      Description

      NodeManager is able to recover status of the disk once broken and fixed without restarting by YARN-90.

      1. YARN-3805.001.patch
        5 kB
        Masatake Iwasaki
      2. YARN-3805.002.patch
        4 kB
        Masatake Iwasaki

        Issue Links

          Activity

          Hide
          iwasakims Masatake Iwasaki added a comment -

          in NodeManager.md:

          once a disk is marked as unhealthy, the NodeManager stops checking it to see if it has recovered(e.g. disk became full and was then cleaned up). The only way for the NodeManager to use that disk to restart the software on the node.

          Show
          iwasakims Masatake Iwasaki added a comment - in NodeManager.md: once a disk is marked as unhealthy, the NodeManager stops checking it to see if it has recovered(e.g. disk became full and was then cleaned up). The only way for the NodeManager to use that disk to restart the software on the node.
          Hide
          iwasakims Masatake Iwasaki added a comment -

          The patch conflicts with the one in YARN-3174. I will rebase the one based on the other committed first.

          Show
          iwasakims Masatake Iwasaki added a comment - The patch conflicts with the one in YARN-3174 . I will rebase the one based on the other committed first.
          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          Masatake Iwasaki could you rebase it?

          Show
          ozawa Tsuyoshi Ozawa added a comment - Masatake Iwasaki could you rebase it?
          Hide
          iwasakims Masatake Iwasaki added a comment -

          I rebased the patch. Thanks for pinging me, Tsuyoshi Ozawa.

          Show
          iwasakims Masatake Iwasaki added a comment - I rebased the patch. Thanks for pinging me, Tsuyoshi Ozawa .
          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          +1, pending for Jenkins.

          Show
          ozawa Tsuyoshi Ozawa added a comment - +1, pending for Jenkins.
          Hide
          hadoopqa Hadoop QA added a comment -



          +1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 3m 42s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 release audit 0m 21s The applied patch does not increase the total number of release audit warnings.
          +1 site 2m 59s Site still builds.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
              7m 5s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12745590/YARN-3805.002.patch
          Optional Tests site
          git revision trunk / 90bda9c
          Java 1.7.0_55
          uname Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/8556/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 pre-patch 3m 42s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 release audit 0m 21s The applied patch does not increase the total number of release audit warnings. +1 site 2m 59s Site still builds. +1 whitespace 0m 0s The patch has no lines that end in whitespace.     7m 5s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12745590/YARN-3805.002.patch Optional Tests site git revision trunk / 90bda9c Java 1.7.0_55 uname Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8556/console This message was automatically generated.
          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          Checking this in.

          Show
          ozawa Tsuyoshi Ozawa added a comment - Checking this in.
          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          Committed this to trunk and branch-2. Thanks Masatake Iwasaki for your contribution.

          Show
          ozawa Tsuyoshi Ozawa added a comment - Committed this to trunk and branch-2. Thanks Masatake Iwasaki for your contribution.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8173 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8173/)
          YARN-3805. Update the documentation of Disk Checker based on YARN-90. Contributed by Masatake Iwasaki. (ozawa: rev 1ba2986dee4bbb64d67ada005f8f132e69575274)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/NodeManager.md
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8173 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8173/ ) YARN-3805 . Update the documentation of Disk Checker based on YARN-90 . Contributed by Masatake Iwasaki. (ozawa: rev 1ba2986dee4bbb64d67ada005f8f132e69575274) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/NodeManager.md
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #258 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/258/)
          YARN-3805. Update the documentation of Disk Checker based on YARN-90. Contributed by Masatake Iwasaki. (ozawa: rev 1ba2986dee4bbb64d67ada005f8f132e69575274)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/NodeManager.md
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #258 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/258/ ) YARN-3805 . Update the documentation of Disk Checker based on YARN-90 . Contributed by Masatake Iwasaki. (ozawa: rev 1ba2986dee4bbb64d67ada005f8f132e69575274) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/NodeManager.md
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk #988 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/988/)
          YARN-3805. Update the documentation of Disk Checker based on YARN-90. Contributed by Masatake Iwasaki. (ozawa: rev 1ba2986dee4bbb64d67ada005f8f132e69575274)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/NodeManager.md
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #988 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/988/ ) YARN-3805 . Update the documentation of Disk Checker based on YARN-90 . Contributed by Masatake Iwasaki. (ozawa: rev 1ba2986dee4bbb64d67ada005f8f132e69575274) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/NodeManager.md hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          ABORTED: Integrated in Hadoop-Hdfs-trunk #2185 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2185/)
          YARN-3805. Update the documentation of Disk Checker based on YARN-90. Contributed by Masatake Iwasaki. (ozawa: rev 1ba2986dee4bbb64d67ada005f8f132e69575274)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/NodeManager.md
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - ABORTED: Integrated in Hadoop-Hdfs-trunk #2185 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2185/ ) YARN-3805 . Update the documentation of Disk Checker based on YARN-90 . Contributed by Masatake Iwasaki. (ozawa: rev 1ba2986dee4bbb64d67ada005f8f132e69575274) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/NodeManager.md hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          ABORTED: Integrated in Hadoop-Mapreduce-trunk #2204 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2204/)
          YARN-3805. Update the documentation of Disk Checker based on YARN-90. Contributed by Masatake Iwasaki. (ozawa: rev 1ba2986dee4bbb64d67ada005f8f132e69575274)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/NodeManager.md
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - ABORTED: Integrated in Hadoop-Mapreduce-trunk #2204 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2204/ ) YARN-3805 . Update the documentation of Disk Checker based on YARN-90 . Contributed by Masatake Iwasaki. (ozawa: rev 1ba2986dee4bbb64d67ada005f8f132e69575274) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/NodeManager.md hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #246 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/246/)
          YARN-3805. Update the documentation of Disk Checker based on YARN-90. Contributed by Masatake Iwasaki. (ozawa: rev 1ba2986dee4bbb64d67ada005f8f132e69575274)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/NodeManager.md
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #246 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/246/ ) YARN-3805 . Update the documentation of Disk Checker based on YARN-90 . Contributed by Masatake Iwasaki. (ozawa: rev 1ba2986dee4bbb64d67ada005f8f132e69575274) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/NodeManager.md hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #256 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/256/)
          YARN-3805. Update the documentation of Disk Checker based on YARN-90. Contributed by Masatake Iwasaki. (ozawa: rev 1ba2986dee4bbb64d67ada005f8f132e69575274)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/NodeManager.md
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #256 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/256/ ) YARN-3805 . Update the documentation of Disk Checker based on YARN-90 . Contributed by Masatake Iwasaki. (ozawa: rev 1ba2986dee4bbb64d67ada005f8f132e69575274) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/NodeManager.md hadoop-yarn-project/CHANGES.txt

            People

            • Assignee:
              iwasakims Masatake Iwasaki
              Reporter:
              iwasakims Masatake Iwasaki
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development