Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8929

Add a metric to expose the timestamp of the last journal

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: journal-node
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Exposed a metric 'LastJournalTimestamp' for JournalNode

      Description

      If there are three JNs and only one JN is failing to journal, we can detect it by monitoring the difference of the last written transaction id among JNs from NN WebUI or JN metrics. However, it's difficult to define the threshold to alert because the increase rate of the number of transaction depends on how busy the cluster is. Therefore I'd like to propose a metric to expose the timestamp of the last journal. That way we can easily alert if a JN is failing to journal for some fixed period.

      1. HDFS-8929-001.patch
        5 kB
        Surendra Singh Lilhore
      2. HDFS-8929-002.patch
        5 kB
        Surendra Singh Lilhore
      3. HDFS-8929-003.patch
        5 kB
        Surendra Singh Lilhore
      4. HDFS-8929-004.patch
        6 kB
        Surendra Singh Lilhore
      5. HDFS-8929-005.patch
        6 kB
        Surendra Singh Lilhore

        Activity

        Hide
        surendrasingh Surendra Singh Lilhore added a comment -

        I am interested to working on this, Please feel free to reassign if you already started working.

        Show
        surendrasingh Surendra Singh Lilhore added a comment - I am interested to working on this, Please feel free to reassign if you already started working.
        Hide
        ajisakaa Akira Ajisaka added a comment -

        I haven't started yet. I'll appreciate your contribution.

        Show
        ajisakaa Akira Ajisaka added a comment - I haven't started yet. I'll appreciate your contribution.
        Hide
        surendrasingh Surendra Singh Lilhore added a comment -

        Attached patch , Please review...

        Show
        surendrasingh Surendra Singh Lilhore added a comment - Attached patch , Please review...
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        -1 pre-patch 22m 21s Pre-patch trunk has 1 extant Findbugs (version 3.0.0) warnings.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
        +1 javac 10m 35s There were no new javac warning messages.
        +1 javadoc 11m 49s There were no new javadoc warning messages.
        +1 release audit 0m 26s The applied patch does not increase the total number of release audit warnings.
        +1 site 3m 42s Site still builds.
        +1 checkstyle 2m 52s There were no new checkstyle issues.
        -1 whitespace 0m 0s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix.
        +1 install 1m 43s mvn install still works.
        +1 eclipse:eclipse 0m 39s The patch built with eclipse:eclipse.
        +1 findbugs 5m 9s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        -1 common tests 25m 4s Tests failed in hadoop-common.
        -1 hdfs tests 84m 17s Tests failed in hadoop-hdfs.
            168m 39s  



        Reason Tests
        Failed unit tests hadoop.security.token.delegation.web.TestWebDelegationToken
        Timed out tests org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12752079/HDFS-8929-001.patch
        Optional Tests site javadoc javac unit findbugs checkstyle
        git revision trunk / 48774d0
        Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12096/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
        whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12096/artifact/patchprocess/whitespace.txt
        hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12096/artifact/patchprocess/testrun_hadoop-common.txt
        hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12096/artifact/patchprocess/testrun_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12096/testReport/
        Java 1.7.0_55
        uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12096/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 22m 21s Pre-patch trunk has 1 extant Findbugs (version 3.0.0) warnings. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 10m 35s There were no new javac warning messages. +1 javadoc 11m 49s There were no new javadoc warning messages. +1 release audit 0m 26s The applied patch does not increase the total number of release audit warnings. +1 site 3m 42s Site still builds. +1 checkstyle 2m 52s There were no new checkstyle issues. -1 whitespace 0m 0s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 43s mvn install still works. +1 eclipse:eclipse 0m 39s The patch built with eclipse:eclipse. +1 findbugs 5m 9s The patch does not introduce any new Findbugs (version 3.0.0) warnings. -1 common tests 25m 4s Tests failed in hadoop-common. -1 hdfs tests 84m 17s Tests failed in hadoop-hdfs.     168m 39s   Reason Tests Failed unit tests hadoop.security.token.delegation.web.TestWebDelegationToken Timed out tests org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12752079/HDFS-8929-001.patch Optional Tests site javadoc javac unit findbugs checkstyle git revision trunk / 48774d0 Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12096/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12096/artifact/patchprocess/whitespace.txt hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12096/artifact/patchprocess/testrun_hadoop-common.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12096/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12096/testReport/ Java 1.7.0_55 uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12096/console This message was automatically generated.
        Hide
        surendrasingh Surendra Singh Lilhore added a comment -

        Failed test cases are unrelated...

        Show
        surendrasingh Surendra Singh Lilhore added a comment - Failed test cases are unrelated...
        Hide
        brahmareddy Brahma Reddy Battula added a comment -

        Surendra Singh Lilhore thanks for wokring on this issue..

        Patch overall looks good.. some minor nits

        can you correct the following typos

        1) `LastJournalTimestamp` | The timestamp of last successfuly written transections

        2) @Metric("The timestamp of last successfuly written transections" )

        Show
        brahmareddy Brahma Reddy Battula added a comment - Surendra Singh Lilhore thanks for wokring on this issue.. Patch overall looks good.. some minor nits can you correct the following typos 1) `LastJournalTimestamp` | The timestamp of last successfuly written transections 2) @Metric("The timestamp of last successfuly written transections" )
        Hide
        surendrasingh Surendra Singh Lilhore added a comment -

        Thanks Brahma Reddy Battula for review..

        Attached updated patch, Please review..

        Show
        surendrasingh Surendra Singh Lilhore added a comment - Thanks Brahma Reddy Battula for review.. Attached updated patch, Please review..
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        -1 pre-patch 21m 53s Pre-patch trunk has 4 extant Findbugs (version 3.0.0) warnings.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
        +1 javac 7m 52s There were no new javac warning messages.
        +1 javadoc 10m 4s There were no new javadoc warning messages.
        +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
        +1 site 3m 1s Site still builds.
        +1 checkstyle 2m 36s There were no new checkstyle issues.
        -1 whitespace 0m 0s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix.
        +1 install 1m 24s mvn install still works.
        +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
        +1 findbugs 4m 29s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        +1 common tests 22m 59s Tests passed in hadoop-common.
        -1 hdfs tests 0m 25s Tests failed in hadoop-hdfs.
            75m 40s  



        Reason Tests
        Failed build hadoop-hdfs



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12752499/HDFS-8929-002.patch
        Optional Tests site javadoc javac unit findbugs checkstyle
        git revision trunk / a4d9acc
        Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12138/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
        whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12138/artifact/patchprocess/whitespace.txt
        hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12138/artifact/patchprocess/testrun_hadoop-common.txt
        hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12138/artifact/patchprocess/testrun_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12138/testReport/
        Java 1.7.0_55
        uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12138/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 21m 53s Pre-patch trunk has 4 extant Findbugs (version 3.0.0) warnings. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 7m 52s There were no new javac warning messages. +1 javadoc 10m 4s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. +1 site 3m 1s Site still builds. +1 checkstyle 2m 36s There were no new checkstyle issues. -1 whitespace 0m 0s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 24s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 findbugs 4m 29s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 common tests 22m 59s Tests passed in hadoop-common. -1 hdfs tests 0m 25s Tests failed in hadoop-hdfs.     75m 40s   Reason Tests Failed build hadoop-hdfs Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12752499/HDFS-8929-002.patch Optional Tests site javadoc javac unit findbugs checkstyle git revision trunk / a4d9acc Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12138/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12138/artifact/patchprocess/whitespace.txt hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12138/artifact/patchprocess/testrun_hadoop-common.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12138/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12138/testReport/ Java 1.7.0_55 uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12138/console This message was automatically generated.
        Hide
        brahmareddy Brahma Reddy Battula added a comment -

        Surendra Singh Lilhore thanks for updating patch..

        Again you missed to correct transections in following two lines., it should be transactions

        1) `LastJournalTimestamp` | The timestamp of last successfully written transections
        2) @Metric("The timestamp of last successfully written transections ")

        and 3) please remove the white space also..

        Show
        brahmareddy Brahma Reddy Battula added a comment - Surendra Singh Lilhore thanks for updating patch.. Again you missed to correct transections in following two lines., it should be transactions 1) `LastJournalTimestamp` | The timestamp of last successfully written transections 2) @Metric("The timestamp of last successfully written transections ") and 3) please remove the white space also..
        Hide
        surendrasingh Surendra Singh Lilhore added a comment -

        Thanks Brahma Reddy Battula for review.

        Attached updated patch, Please review..

        Show
        surendrasingh Surendra Singh Lilhore added a comment - Thanks Brahma Reddy Battula for review. Attached updated patch, Please review..
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 22m 43s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
        +1 javac 7m 54s There were no new javac warning messages.
        +1 javadoc 10m 11s There were no new javadoc warning messages.
        +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
        +1 site 3m 3s Site still builds.
        +1 checkstyle 2m 28s There were no new checkstyle issues.
        +1 whitespace 0m 1s The patch has no lines that end in whitespace.
        +1 install 1m 25s mvn install still works.
        +1 eclipse:eclipse 0m 31s The patch built with eclipse:eclipse.
        +1 findbugs 4m 20s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        +1 common tests 22m 53s Tests passed in hadoop-common.
        -1 hdfs tests 164m 20s Tests failed in hadoop-hdfs.
            240m 15s  



        Reason Tests
        Failed unit tests hadoop.hdfs.server.namenode.TestStorageRestore
          hadoop.hdfs.web.TestWebHDFSOAuth2



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12753798/HDFS-8929-003.patch
        Optional Tests site javadoc javac unit findbugs checkstyle
        git revision trunk / 7d6687f
        hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12249/artifact/patchprocess/testrun_hadoop-common.txt
        hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12249/artifact/patchprocess/testrun_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12249/testReport/
        Java 1.7.0_55
        uname Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12249/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 22m 43s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 7m 54s There were no new javac warning messages. +1 javadoc 10m 11s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. +1 site 3m 3s Site still builds. +1 checkstyle 2m 28s There were no new checkstyle issues. +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 25s mvn install still works. +1 eclipse:eclipse 0m 31s The patch built with eclipse:eclipse. +1 findbugs 4m 20s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 common tests 22m 53s Tests passed in hadoop-common. -1 hdfs tests 164m 20s Tests failed in hadoop-hdfs.     240m 15s   Reason Tests Failed unit tests hadoop.hdfs.server.namenode.TestStorageRestore   hadoop.hdfs.web.TestWebHDFSOAuth2 Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12753798/HDFS-8929-003.patch Optional Tests site javadoc javac unit findbugs checkstyle git revision trunk / 7d6687f hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12249/artifact/patchprocess/testrun_hadoop-common.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12249/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12249/testReport/ Java 1.7.0_55 uname Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12249/console This message was automatically generated.
        Hide
        surendrasingh Surendra Singh Lilhore added a comment -

        Failed test cases are unrelated

        Show
        surendrasingh Surendra Singh Lilhore added a comment - Failed test cases are unrelated
        Hide
        brahmareddy Brahma Reddy Battula added a comment -

        Surendra Singh Lilhore thanks for updating the patch..Latest Patch LGTM,Akira Ajisaka do you have some comments on this latest patch..?

        Show
        brahmareddy Brahma Reddy Battula added a comment - Surendra Singh Lilhore thanks for updating the patch..Latest Patch LGTM, Akira Ajisaka do you have some comments on this latest patch..?
        Hide
        vinayrpet Vinayakumar B added a comment -

        Changes looks great.

        Just one more improvement in Test.

        Timestamp update can be verified after sending every edits in TestJournalNode#testJournal().

        +1 once addressed.

        Show
        vinayrpet Vinayakumar B added a comment - Changes looks great. Just one more improvement in Test. Timestamp update can be verified after sending every edits in TestJournalNode#testJournal(). +1 once addressed.
        Hide
        surendrasingh Surendra Singh Lilhore added a comment -

        Thanks Vinayakumar B for review.
        Attached updated patch, please review...

        Show
        surendrasingh Surendra Singh Lilhore added a comment - Thanks Vinayakumar B for review. Attached updated patch, please review...
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 22m 18s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
        +1 javac 7m 46s There were no new javac warning messages.
        +1 javadoc 9m 58s There were no new javadoc warning messages.
        +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
        +1 site 3m 1s Site still builds.
        +1 checkstyle 2m 25s There were no new checkstyle issues.
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 28s mvn install still works.
        +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
        +1 findbugs 4m 19s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        +1 common tests 22m 58s Tests passed in hadoop-common.
        -1 hdfs tests 162m 36s Tests failed in hadoop-hdfs.
            237m 49s  



        Reason Tests
        Timed out tests org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12754679/HDFS-8929-004.patch
        Optional Tests site javadoc javac unit findbugs checkstyle
        git revision trunk / 970daaa
        hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12342/artifact/patchprocess/testrun_hadoop-common.txt
        hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12342/artifact/patchprocess/testrun_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12342/testReport/
        Java 1.7.0_55
        uname Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12342/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 22m 18s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 7m 46s There were no new javac warning messages. +1 javadoc 9m 58s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 site 3m 1s Site still builds. +1 checkstyle 2m 25s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 28s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 findbugs 4m 19s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 common tests 22m 58s Tests passed in hadoop-common. -1 hdfs tests 162m 36s Tests failed in hadoop-hdfs.     237m 49s   Reason Tests Timed out tests org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12754679/HDFS-8929-004.patch Optional Tests site javadoc javac unit findbugs checkstyle git revision trunk / 970daaa hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12342/artifact/patchprocess/testrun_hadoop-common.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12342/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12342/testReport/ Java 1.7.0_55 uname Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12342/console This message was automatically generated.
        Hide
        surendrasingh Surendra Singh Lilhore added a comment -

        Updated patch with small change in metric document.
        Please review .

        Show
        surendrasingh Surendra Singh Lilhore added a comment - Updated patch with small change in metric document. Please review .
        Hide
        vinayrpet Vinayakumar B added a comment -

        +1 for the latest update.

        Show
        vinayrpet Vinayakumar B added a comment - +1 for the latest update.
        Hide
        vinayrpet Vinayakumar B added a comment -

        Committed to trunk and branch-2.
        Thanks Akira Ajisaka for reporting.
        Thanks Surendra Singh Lilhore for the contribution and thanks Brahma Reddy Battula for review.

        Show
        vinayrpet Vinayakumar B added a comment - Committed to trunk and branch-2. Thanks Akira Ajisaka for reporting. Thanks Surendra Singh Lilhore for the contribution and thanks Brahma Reddy Battula for review.
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #8419 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8419/)
        HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) (vinayakumarb: rev 94cf7ab9d28a885181afeb2c181dfe857d158254)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/server/TestJournalNode.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalMetrics.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/Journal.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8419 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8419/ ) HDFS-8929 . Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) (vinayakumarb: rev 94cf7ab9d28a885181afeb2c181dfe857d158254) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/server/TestJournalNode.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalMetrics.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/Journal.java
        Hide
        surendrasingh Surendra Singh Lilhore added a comment -

        Thanks Vinayakumar B for review and commit..

        Show
        surendrasingh Surendra Singh Lilhore added a comment - Thanks Vinayakumar B for review and commit..
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk #2286 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2286/)
        HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) (vinayakumarb: rev 94cf7ab9d28a885181afeb2c181dfe857d158254)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/Journal.java
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/server/TestJournalNode.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalMetrics.java
        • hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2286 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2286/ ) HDFS-8929 . Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) (vinayakumarb: rev 94cf7ab9d28a885181afeb2c181dfe857d158254) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/Journal.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/server/TestJournalNode.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalMetrics.java hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk #2309 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2309/)
        HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) (vinayakumarb: rev 94cf7ab9d28a885181afeb2c181dfe857d158254)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/server/TestJournalNode.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/Journal.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalMetrics.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2309 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2309/ ) HDFS-8929 . Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) (vinayakumarb: rev 94cf7ab9d28a885181afeb2c181dfe857d158254) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/server/TestJournalNode.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/Journal.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalMetrics.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk #1098 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1098/)
        HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) (vinayakumarb: rev 94cf7ab9d28a885181afeb2c181dfe857d158254)

        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/Journal.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/server/TestJournalNode.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalMetrics.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1098 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1098/ ) HDFS-8929 . Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) (vinayakumarb: rev 94cf7ab9d28a885181afeb2c181dfe857d158254) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/Journal.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/server/TestJournalNode.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalMetrics.java
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        -1 pre-patch 20m 25s Findbugs (version ) appears to be broken on trunk.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
        +1 javac 8m 2s There were no new javac warning messages.
        +1 javadoc 10m 38s There were no new javadoc warning messages.
        +1 release audit 0m 25s The applied patch does not increase the total number of release audit warnings.
        +1 site 3m 25s Site still builds.
        +1 checkstyle 1m 40s There were no new checkstyle issues.
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 39s mvn install still works.
        +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
        +1 findbugs 4m 24s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        +1 common tests 23m 56s Tests passed in hadoop-common.
        -1 hdfs tests 57m 59s Tests failed in hadoop-hdfs.
            133m 9s  



        Reason Tests
        Failed unit tests hadoop.hdfs.TestParallelShortCircuitRead
          hadoop.fs.contract.hdfs.TestHDFSContractMkdir
          hadoop.hdfs.server.datanode.TestDataNodeUUID
          hadoop.hdfs.server.namenode.TestAllowFormat
          hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens
          hadoop.hdfs.TestBlockStoragePolicy
          hadoop.hdfs.server.datanode.TestRefreshNamenodes
          hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM
          hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics
          hadoop.cli.TestDeleteCLI
          hadoop.hdfs.tools.TestDFSZKFailoverController
          hadoop.hdfs.TestFileLengthOnClusterRestart
          hadoop.hdfs.TestAppendSnapshotTruncate
          hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing
          hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory
          hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots
          hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate
          hadoop.cli.TestHDFSCLI
          hadoop.hdfs.server.datanode.TestDatanodeStartupOptions
          hadoop.hdfs.server.namenode.TestCheckpoint
          hadoop.hdfs.TestDFSUpgradeFromImage
          hadoop.hdfs.TestReplaceDatanodeOnFailure
          hadoop.hdfs.tools.TestGetGroups
          hadoop.hdfs.TestRemoteBlockReader2
          hadoop.hdfs.server.namenode.TestStartup
          hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
          hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy
          hadoop.hdfs.TestDFSStorageStateRecovery
          hadoop.hdfs.server.namenode.TestFSImageWithXAttr
          hadoop.hdfs.TestRemoteBlockReader
          hadoop.hdfs.TestMultiThreadedHflush
          hadoop.fs.contract.hdfs.TestHDFSContractRename
          hadoop.hdfs.TestBlockReaderLocal
          hadoop.cli.TestCacheAdminCLI
          hadoop.hdfs.server.mover.TestMover
          hadoop.hdfs.server.datanode.fsdataset.impl.TestRbwSpaceReservation
          hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks
          hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits
          hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality
          hadoop.hdfs.server.namenode.TestNameNodeRecovery
          hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir
          hadoop.fs.loadGenerator.TestLoadGenerator
          hadoop.hdfs.server.namenode.TestFSImageWithAcl
          hadoop.hdfs.server.namenode.TestLargeDirectoryDelete
          hadoop.fs.TestFcHdfsSetUMask
          hadoop.hdfs.TestPread
          hadoop.hdfs.server.namenode.TestFSEditLogLoader
          hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation
          hadoop.hdfs.server.namenode.ha.TestQuotasWithHA
          hadoop.hdfs.crypto.TestHdfsCryptoStreams
          hadoop.fs.viewfs.TestViewFsFileStatusHdfs
          hadoop.hdfs.server.namenode.TestCommitBlockSynchronization
          hadoop.hdfs.server.datanode.TestReadOnlySharedStorage
          hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl
          hadoop.hdfs.TestDFSAddressConfig
          hadoop.tracing.TestTracingShortCircuitLocalRead
          hadoop.hdfs.server.namenode.ha.TestBootstrapStandby
          hadoop.hdfs.server.namenode.TestFSDirectory
          hadoop.hdfs.server.datanode.TestBlockScanner
          hadoop.hdfs.server.datanode.TestIncrementalBlockReports
          hadoop.tracing.TestTracing
          hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol
          hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots
          hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles
          hadoop.hdfs.TestParallelRead
          hadoop.hdfs.tools.TestDelegationTokenFetcher
          hadoop.hdfs.TestRestartDFS
          hadoop.fs.TestWebHdfsFileContextMainOperations
          hadoop.hdfs.TestParallelShortCircuitReadNoChecksum
          hadoop.hdfs.server.blockmanagement.TestSequentialBlockId
          hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages
          hadoop.hdfs.server.blockmanagement.TestHeartbeatHandling
          hadoop.hdfs.TestParallelShortCircuitLegacyRead
          hadoop.net.TestNetworkTopology
          hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
          hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
          hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory
          hadoop.hdfs.server.blockmanagement.TestReplicationPolicyConsiderLoad
          hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA
          hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
          hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
          hadoop.fs.TestFcHdfsCreateMkdir
          hadoop.hdfs.server.namenode.TestDeadDatanode
          hadoop.hdfs.server.namenode.ha.TestNNHealthCheck
          hadoop.hdfs.TestHFlush
          hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
          hadoop.hdfs.TestFetchImage
          hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
          hadoop.hdfs.server.namenode.ha.TestDNFencing
          hadoop.hdfs.TestDFSUpgrade
          hadoop.fs.TestFcHdfsPermission
          hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration
          hadoop.hdfs.server.namenode.TestProtectedDirectories
          hadoop.hdfs.server.namenode.TestNamenodeRetryCache
          hadoop.hdfs.server.datanode.TestDataNodeExit
          hadoop.hdfs.server.datanode.TestFsDatasetCache
          hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN
          hadoop.hdfs.TestMissingBlocksAlert
          hadoop.hdfs.server.namenode.TestNNThroughputBenchmark
          hadoop.hdfs.server.namenode.ha.TestHAMetrics
          hadoop.hdfs.TestQuota
          hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot
          hadoop.hdfs.server.namenode.TestQuotaByStorageType
          hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
          hadoop.hdfs.server.namenode.ha.TestEditLogTailer
          hadoop.hdfs.server.namenode.TestStorageRestore
          hadoop.hdfs.server.namenode.TestGetBlockLocations
          hadoop.hdfs.server.namenode.TestSaveNamespace
          hadoop.hdfs.server.namenode.TestParallelImageWrite
          hadoop.hdfs.server.datanode.TestBlockPoolManager
          hadoop.hdfs.tools.TestDebugAdmin
          hadoop.hdfs.server.datanode.TestDiskError
          hadoop.hdfs.TestPersistBlocks
          hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
          hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover
          hadoop.hdfs.server.namenode.TestNameEditsConfigs
          hadoop.hdfs.server.namenode.TestNameNodeRpcServer
          hadoop.hdfs.server.namenode.TestSecureNameNode
          hadoop.hdfs.server.namenode.TestSnapshotPathINodes
          hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd
          hadoop.hdfs.server.datanode.TestDatanodeRegister
          hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
          hadoop.hdfs.server.blockmanagement.TestAvailableSpaceBlockPlacementPolicy
          hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup
          hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold
          hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters
          hadoop.hdfs.TestModTime
          hadoop.hdfs.server.blockmanagement.TestBlockManager
          hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA
          hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations
          hadoop.hdfs.TestGetBlocks
          hadoop.hdfs.TestDFSStartupVersions
          hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl
          hadoop.hdfs.TestRenameWhileOpen
          hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy
          hadoop.fs.viewfs.TestViewFsWithXAttrs
          hadoop.tools.TestJMXGet
          hadoop.hdfs.TestFileAppend4
          hadoop.TestGenericRefresh
          hadoop.hdfs.server.namenode.TestAddBlock
          hadoop.hdfs.TestDataTransferKeepalive
          hadoop.hdfs.server.datanode.TestDataNodeMetrics
          hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
          hadoop.hdfs.server.namenode.TestINodeFile
          hadoop.hdfs.TestFileAppend2
          hadoop.hdfs.server.datanode.TestDataNodeECN
          hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA
          hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
          hadoop.hdfs.server.namenode.TestAuditLogs
          hadoop.fs.TestSWebHdfsFileContextMainOperations
          hadoop.hdfs.TestInjectionForSimulatedStorage
          hadoop.hdfs.server.namenode.TestFsck
          hadoop.fs.contract.hdfs.TestHDFSContractDelete
          hadoop.fs.contract.hdfs.TestHDFSContractSetTimes
          hadoop.hdfs.TestLocalDFS
          hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
          hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade
          hadoop.hdfs.TestCrcCorruption
          hadoop.hdfs.server.namenode.TestNameNodeAcl
          hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr
          hadoop.hdfs.TestConnCache
          hadoop.hdfs.TestGetFileChecksum
          hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
          hadoop.hdfs.TestFileAppend
          hadoop.hdfs.TestReservedRawPaths
          hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade
          hadoop.TestRefreshCallQueue
          hadoop.hdfs.TestDisableConnCache
          hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement
          hadoop.hdfs.server.datanode.TestIncrementalBrVariations
          hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting
          hadoop.cli.TestXAttrCLI
          hadoop.hdfs.server.namenode.TestMetadataVersionOutput
          hadoop.hdfs.TestParallelShortCircuitReadUnCached
          hadoop.fs.TestUrlStreamHandler
          hadoop.hdfs.server.namenode.TestNameNodeMXBean
          hadoop.hdfs.server.namenode.TestValidateConfigurationSettings
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
          hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot
          hadoop.fs.TestEnhancedByteBufferAccess
          hadoop.hdfs.TestHDFSServerPorts
          hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename
          hadoop.hdfs.server.namenode.TestFSNamesystem
          hadoop.hdfs.server.datanode.TestTransferRbw
          hadoop.hdfs.server.namenode.TestAuditLogger
          hadoop.hdfs.TestRollingUpgrade
          hadoop.hdfs.server.namenode.TestLeaseManager
          hadoop.hdfs.server.namenode.TestFSImage
          hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage
          hadoop.hdfs.server.datanode.TestDataNodeInitStorage
          hadoop.fs.viewfs.TestViewFileSystemWithXAttrs
          hadoop.hdfs.server.namenode.TestMalformedURLs
          hadoop.hdfs.server.namenode.TestEditLog
          hadoop.fs.TestHDFSFileContextMainOperations
          hadoop.hdfs.server.namenode.TestTruncateQuotaUpdate
          hadoop.hdfs.TestSafeMode
          hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot
          hadoop.hdfs.server.namenode.TestBackupNode
          hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
          hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes
          hadoop.hdfs.server.namenode.TestFileContextAcl
          hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement
          hadoop.hdfs.server.namenode.TestAclConfigFlag
          hadoop.hdfs.TestWriteRead
          hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength
          hadoop.hdfs.tools.TestDFSAdminWithHA
          hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
          hadoop.hdfs.TestExternalBlockReader
          hadoop.hdfs.server.namenode.TestMetaSave
          hadoop.hdfs.server.datanode.web.dtp.TestDtpHttp2
          hadoop.fs.contract.hdfs.TestHDFSContractAppend
          hadoop.hdfs.server.namenode.ha.TestStateTransitionFailure
          hadoop.hdfs.TestHdfsAdmin
          hadoop.fs.contract.hdfs.TestHDFSContractOpen
          hadoop.hdfs.server.namenode.TestGenericJournalConf
          hadoop.hdfs.TestFileCreation
          hadoop.hdfs.server.namenode.snapshot.TestSnapshot
          hadoop.hdfs.server.mover.TestStorageMover
          hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
          hadoop.hdfs.TestClientReportBadBlock
          hadoop.hdfs.server.namenode.TestAddBlockRetry
          hadoop.tracing.TestTraceAdmin
          hadoop.hdfs.server.namenode.TestSecurityTokenEditLog
          hadoop.hdfs.server.namenode.TestBlockUnderConstruction
          hadoop.hdfs.TestFileCorruption
          hadoop.hdfs.server.namenode.TestHDFSConcat
          hadoop.hdfs.server.datanode.TestDataNodeMXBean
          hadoop.hdfs.server.datanode.TestBlockReplacement
          hadoop.hdfs.TestClose
          hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
          hadoop.hdfs.TestAbandonBlock
          hadoop.hdfs.server.namenode.ha.TestHAFsck
          hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant
          hadoop.hdfs.server.datanode.TestBlockRecovery
          hadoop.hdfs.TestDFSInputStream
          hadoop.hdfs.server.namenode.TestNNStorageRetentionFunctional
          hadoop.hdfs.TestLeaseRecovery
          hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
          hadoop.hdfs.server.datanode.TestTriggerBlockReport
          hadoop.hdfs.tools.TestDFSAdmin
          hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
          hadoop.hdfs.TestWriteBlockGetsBlockLengthHint
          hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation
          hadoop.hdfs.server.namenode.TestFsLimits
          hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages
          hadoop.fs.viewfs.TestViewFsHdfs
          hadoop.fs.contract.hdfs.TestHDFSContractConcat
          hadoop.hdfs.server.namenode.TestFileLimit
          hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing
          hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot
          hadoop.hdfs.TestHDFSTrash
          hadoop.hdfs.server.datanode.TestCachingStrategy
          hadoop.hdfs.TestSmallBlock
          hadoop.cli.TestCryptoAdminCLI
          hadoop.hdfs.TestFileCreationDelete
          hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler
          hadoop.hdfs.tools.TestDFSHAAdminMiniCluster
          hadoop.hdfs.server.namenode.TestClusterId
          hadoop.hdfs.TestReplication
          hadoop.hdfs.server.namenode.ha.TestHAAppend
          hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles
          hadoop.cli.TestAclCLI
          hadoop.fs.viewfs.TestViewFileSystemWithAcls
          hadoop.hdfs.server.namenode.TestEditLogAutoroll
          hadoop.fs.TestSymlinkHdfsFileContext
          hadoop.hdfs.server.namenode.TestNameNodeResourceChecker
          hadoop.hdfs.server.namenode.TestTransferFsImage
          hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot
          hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA
          hadoop.hdfs.server.namenode.TestEditLogRace
          hadoop.fs.TestSymlinkHdfsFileSystem
          hadoop.hdfs.TestFileAppend3
          hadoop.hdfs.server.namenode.TestFileContextXAttr
          hadoop.hdfs.server.datanode.TestDataStorage
          hadoop.hdfs.server.namenode.TestFSPermissionChecker
          hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean
          hadoop.fs.TestUnbuffer
          hadoop.hdfs.TestPipelines
          hadoop.hdfs.server.datanode.TestDataNodeFSDataSetSink
          hadoop.hdfs.server.namenode.TestDecommissioningStatus
          hadoop.hdfs.server.namenode.ha.TestHASafeMode
          hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot
          hadoop.hdfs.server.namenode.TestINodeAttributeProvider
          hadoop.hdfs.qjournal.TestSecureNNWithQJM
          hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps
          hadoop.hdfs.TestBlockReaderFactory
          hadoop.hdfs.server.namenode.TestNamenodeCapacityReport
          hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication
          hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithNodeGroup
          hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
          hadoop.hdfs.server.namenode.TestFileTruncate
          hadoop.hdfs.TestFSOutputSummer
          hadoop.hdfs.TestBlockReaderLocalLegacy
          hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
          hadoop.fs.viewfs.TestViewFsWithAcls
          hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
          hadoop.hdfs.server.blockmanagement.TestPendingReplication
          hadoop.hdfs.server.namenode.ha.TestHAStateTransitions
          hadoop.hdfs.TestEncryptionZones
          hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots
          hadoop.fs.TestResolveHdfsSymlink
          hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
          hadoop.hdfs.server.namenode.TestXAttrConfigFlag
          hadoop.hdfs.TestFileConcurrentReader
          hadoop.hdfs.server.blockmanagement.TestNodeCount
          hadoop.fs.viewfs.TestViewFsDefaultValue
          hadoop.hdfs.TestAppendDifferentChecksum
          hadoop.hdfs.server.namenode.TestCacheDirectives
          hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus
          hadoop.hdfs.server.namenode.TestCreateEditsLog
          hadoop.hdfs.server.namenode.TestFSNamesystemMBean
          hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA
          hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary
          hadoop.hdfs.server.namenode.TestNameNodeXAttr
          hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
          hadoop.hdfs.server.datanode.TestHSync
          hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer
          hadoop.hdfs.server.datanode.TestStorageReport
          hadoop.fs.viewfs.TestViewFileSystemHdfs
          hadoop.hdfs.TestParallelUnixDomainRead
          hadoop.hdfs.client.impl.TestLeaseRenewer
          hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery
          hadoop.hdfs.tools.TestStoragePolicyCommands
          hadoop.hdfs.TestDFSRemove
          hadoop.fs.viewfs.TestViewFsAtHdfsRoot
          hadoop.hdfs.server.datanode.TestDataXceiverLazyPersistHint
          hadoop.hdfs.server.datanode.TestSimulatedFSDataset
          hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport
          hadoop.hdfs.server.datanode.TestDeleteBlockPool
          hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork
          hadoop.hdfs.server.namenode.TestHostsFiles
          hadoop.hdfs.qjournal.TestNNWithQJM
          hadoop.hdfs.TestFileCreationClient
          hadoop.hdfs.TestRollingUpgradeDowngrade
          hadoop.fs.contract.hdfs.TestHDFSContractCreate
          hadoop.fs.permission.TestStickyBit
          hadoop.hdfs.TestEncryptionZonesWithKMS
          hadoop.fs.TestSymlinkHdfsDisable
          hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
          hadoop.hdfs.TestDFSUtil
          hadoop.hdfs.server.namenode.TestDeleteRace
          hadoop.hdfs.server.datanode.TestDataDirs
          hadoop.hdfs.TestLease
          hadoop.hdfs.TestLargeBlock
          hadoop.fs.TestGlobPaths
          hadoop.hdfs.server.datanode.TestBPOfferService
          hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes
          hadoop.hdfs.server.namenode.TestEditLogJournalFailures
          hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys
          hadoop.hdfs.TestClientProtocolForPipelineRecovery
          hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean
          hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica
          hadoop.hdfs.server.datanode.TestDirectoryScanner
          hadoop.hdfs.server.datanode.TestDatanodeProtocolRetryPolicy
          hadoop.hdfs.server.namenode.TestSecondaryWebUi
          hadoop.fs.contract.hdfs.TestHDFSContractSeek
          hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart
          hadoop.fs.shell.TestHdfsTextCommand
          hadoop.hdfs.TestBlockMissingException



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12754825/HDFS-8929-005.patch
        Optional Tests site javadoc javac unit findbugs checkstyle
        git revision trunk / a153b96
        hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12349/artifact/patchprocess/testrun_hadoop-common.txt
        hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12349/artifact/patchprocess/testrun_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12349/testReport/
        Java 1.7.0_55
        uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12349/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 20m 25s Findbugs (version ) appears to be broken on trunk. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 8m 2s There were no new javac warning messages. +1 javadoc 10m 38s There were no new javadoc warning messages. +1 release audit 0m 25s The applied patch does not increase the total number of release audit warnings. +1 site 3m 25s Site still builds. +1 checkstyle 1m 40s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 39s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 findbugs 4m 24s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 common tests 23m 56s Tests passed in hadoop-common. -1 hdfs tests 57m 59s Tests failed in hadoop-hdfs.     133m 9s   Reason Tests Failed unit tests hadoop.hdfs.TestParallelShortCircuitRead   hadoop.fs.contract.hdfs.TestHDFSContractMkdir   hadoop.hdfs.server.datanode.TestDataNodeUUID   hadoop.hdfs.server.namenode.TestAllowFormat   hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens   hadoop.hdfs.TestBlockStoragePolicy   hadoop.hdfs.server.datanode.TestRefreshNamenodes   hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM   hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics   hadoop.cli.TestDeleteCLI   hadoop.hdfs.tools.TestDFSZKFailoverController   hadoop.hdfs.TestFileLengthOnClusterRestart   hadoop.hdfs.TestAppendSnapshotTruncate   hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing   hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory   hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots   hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate   hadoop.cli.TestHDFSCLI   hadoop.hdfs.server.datanode.TestDatanodeStartupOptions   hadoop.hdfs.server.namenode.TestCheckpoint   hadoop.hdfs.TestDFSUpgradeFromImage   hadoop.hdfs.TestReplaceDatanodeOnFailure   hadoop.hdfs.tools.TestGetGroups   hadoop.hdfs.TestRemoteBlockReader2   hadoop.hdfs.server.namenode.TestStartup   hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy   hadoop.hdfs.TestDFSStorageStateRecovery   hadoop.hdfs.server.namenode.TestFSImageWithXAttr   hadoop.hdfs.TestRemoteBlockReader   hadoop.hdfs.TestMultiThreadedHflush   hadoop.fs.contract.hdfs.TestHDFSContractRename   hadoop.hdfs.TestBlockReaderLocal   hadoop.cli.TestCacheAdminCLI   hadoop.hdfs.server.mover.TestMover   hadoop.hdfs.server.datanode.fsdataset.impl.TestRbwSpaceReservation   hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks   hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits   hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality   hadoop.hdfs.server.namenode.TestNameNodeRecovery   hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir   hadoop.fs.loadGenerator.TestLoadGenerator   hadoop.hdfs.server.namenode.TestFSImageWithAcl   hadoop.hdfs.server.namenode.TestLargeDirectoryDelete   hadoop.fs.TestFcHdfsSetUMask   hadoop.hdfs.TestPread   hadoop.hdfs.server.namenode.TestFSEditLogLoader   hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation   hadoop.hdfs.server.namenode.ha.TestQuotasWithHA   hadoop.hdfs.crypto.TestHdfsCryptoStreams   hadoop.fs.viewfs.TestViewFsFileStatusHdfs   hadoop.hdfs.server.namenode.TestCommitBlockSynchronization   hadoop.hdfs.server.datanode.TestReadOnlySharedStorage   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl   hadoop.hdfs.TestDFSAddressConfig   hadoop.tracing.TestTracingShortCircuitLocalRead   hadoop.hdfs.server.namenode.ha.TestBootstrapStandby   hadoop.hdfs.server.namenode.TestFSDirectory   hadoop.hdfs.server.datanode.TestBlockScanner   hadoop.hdfs.server.datanode.TestIncrementalBlockReports   hadoop.tracing.TestTracing   hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol   hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles   hadoop.hdfs.TestParallelRead   hadoop.hdfs.tools.TestDelegationTokenFetcher   hadoop.hdfs.TestRestartDFS   hadoop.fs.TestWebHdfsFileContextMainOperations   hadoop.hdfs.TestParallelShortCircuitReadNoChecksum   hadoop.hdfs.server.blockmanagement.TestSequentialBlockId   hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages   hadoop.hdfs.server.blockmanagement.TestHeartbeatHandling   hadoop.hdfs.TestParallelShortCircuitLegacyRead   hadoop.net.TestNetworkTopology   hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock   hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory   hadoop.hdfs.server.blockmanagement.TestReplicationPolicyConsiderLoad   hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA   hadoop.hdfs.server.namenode.ha.TestPipelinesFailover   hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer   hadoop.fs.TestFcHdfsCreateMkdir   hadoop.hdfs.server.namenode.TestDeadDatanode   hadoop.hdfs.server.namenode.ha.TestNNHealthCheck   hadoop.hdfs.TestHFlush   hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled   hadoop.hdfs.TestFetchImage   hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication   hadoop.hdfs.server.namenode.ha.TestDNFencing   hadoop.hdfs.TestDFSUpgrade   hadoop.fs.TestFcHdfsPermission   hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration   hadoop.hdfs.server.namenode.TestProtectedDirectories   hadoop.hdfs.server.namenode.TestNamenodeRetryCache   hadoop.hdfs.server.datanode.TestDataNodeExit   hadoop.hdfs.server.datanode.TestFsDatasetCache   hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN   hadoop.hdfs.TestMissingBlocksAlert   hadoop.hdfs.server.namenode.TestNNThroughputBenchmark   hadoop.hdfs.server.namenode.ha.TestHAMetrics   hadoop.hdfs.TestQuota   hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot   hadoop.hdfs.server.namenode.TestQuotaByStorageType   hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.server.namenode.TestStorageRestore   hadoop.hdfs.server.namenode.TestGetBlockLocations   hadoop.hdfs.server.namenode.TestSaveNamespace   hadoop.hdfs.server.namenode.TestParallelImageWrite   hadoop.hdfs.server.datanode.TestBlockPoolManager   hadoop.hdfs.tools.TestDebugAdmin   hadoop.hdfs.server.datanode.TestDiskError   hadoop.hdfs.TestPersistBlocks   hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots   hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover   hadoop.hdfs.server.namenode.TestNameEditsConfigs   hadoop.hdfs.server.namenode.TestNameNodeRpcServer   hadoop.hdfs.server.namenode.TestSecureNameNode   hadoop.hdfs.server.namenode.TestSnapshotPathINodes   hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd   hadoop.hdfs.server.datanode.TestDatanodeRegister   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer   hadoop.hdfs.server.blockmanagement.TestAvailableSpaceBlockPlacementPolicy   hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup   hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold   hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters   hadoop.hdfs.TestModTime   hadoop.hdfs.server.blockmanagement.TestBlockManager   hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA   hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations   hadoop.hdfs.TestGetBlocks   hadoop.hdfs.TestDFSStartupVersions   hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl   hadoop.hdfs.TestRenameWhileOpen   hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy   hadoop.fs.viewfs.TestViewFsWithXAttrs   hadoop.tools.TestJMXGet   hadoop.hdfs.TestFileAppend4   hadoop.TestGenericRefresh   hadoop.hdfs.server.namenode.TestAddBlock   hadoop.hdfs.TestDataTransferKeepalive   hadoop.hdfs.server.datanode.TestDataNodeMetrics   hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA   hadoop.hdfs.server.namenode.TestINodeFile   hadoop.hdfs.TestFileAppend2   hadoop.hdfs.server.datanode.TestDataNodeECN   hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA   hadoop.hdfs.server.namenode.TestProcessCorruptBlocks   hadoop.hdfs.server.namenode.TestAuditLogs   hadoop.fs.TestSWebHdfsFileContextMainOperations   hadoop.hdfs.TestInjectionForSimulatedStorage   hadoop.hdfs.server.namenode.TestFsck   hadoop.fs.contract.hdfs.TestHDFSContractDelete   hadoop.fs.contract.hdfs.TestHDFSContractSetTimes   hadoop.hdfs.TestLocalDFS   hadoop.hdfs.server.namenode.TestListCorruptFileBlocks   hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade   hadoop.hdfs.TestCrcCorruption   hadoop.hdfs.server.namenode.TestNameNodeAcl   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr   hadoop.hdfs.TestConnCache   hadoop.hdfs.TestGetFileChecksum   hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks   hadoop.hdfs.TestFileAppend   hadoop.hdfs.TestReservedRawPaths   hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade   hadoop.TestRefreshCallQueue   hadoop.hdfs.TestDisableConnCache   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement   hadoop.hdfs.server.datanode.TestIncrementalBrVariations   hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting   hadoop.cli.TestXAttrCLI   hadoop.hdfs.server.namenode.TestMetadataVersionOutput   hadoop.hdfs.TestParallelShortCircuitReadUnCached   hadoop.fs.TestUrlStreamHandler   hadoop.hdfs.server.namenode.TestNameNodeMXBean   hadoop.hdfs.server.namenode.TestValidateConfigurationSettings   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure   hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot   hadoop.fs.TestEnhancedByteBufferAccess   hadoop.hdfs.TestHDFSServerPorts   hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename   hadoop.hdfs.server.namenode.TestFSNamesystem   hadoop.hdfs.server.datanode.TestTransferRbw   hadoop.hdfs.server.namenode.TestAuditLogger   hadoop.hdfs.TestRollingUpgrade   hadoop.hdfs.server.namenode.TestLeaseManager   hadoop.hdfs.server.namenode.TestFSImage   hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage   hadoop.hdfs.server.datanode.TestDataNodeInitStorage   hadoop.fs.viewfs.TestViewFileSystemWithXAttrs   hadoop.hdfs.server.namenode.TestMalformedURLs   hadoop.hdfs.server.namenode.TestEditLog   hadoop.fs.TestHDFSFileContextMainOperations   hadoop.hdfs.server.namenode.TestTruncateQuotaUpdate   hadoop.hdfs.TestSafeMode   hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot   hadoop.hdfs.server.namenode.TestBackupNode   hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints   hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes   hadoop.hdfs.server.namenode.TestFileContextAcl   hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement   hadoop.hdfs.server.namenode.TestAclConfigFlag   hadoop.hdfs.TestWriteRead   hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength   hadoop.hdfs.tools.TestDFSAdminWithHA   hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport   hadoop.hdfs.TestExternalBlockReader   hadoop.hdfs.server.namenode.TestMetaSave   hadoop.hdfs.server.datanode.web.dtp.TestDtpHttp2   hadoop.fs.contract.hdfs.TestHDFSContractAppend   hadoop.hdfs.server.namenode.ha.TestStateTransitionFailure   hadoop.hdfs.TestHdfsAdmin   hadoop.fs.contract.hdfs.TestHDFSContractOpen   hadoop.hdfs.server.namenode.TestGenericJournalConf   hadoop.hdfs.TestFileCreation   hadoop.hdfs.server.namenode.snapshot.TestSnapshot   hadoop.hdfs.server.mover.TestStorageMover   hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot   hadoop.hdfs.TestClientReportBadBlock   hadoop.hdfs.server.namenode.TestAddBlockRetry   hadoop.tracing.TestTraceAdmin   hadoop.hdfs.server.namenode.TestSecurityTokenEditLog   hadoop.hdfs.server.namenode.TestBlockUnderConstruction   hadoop.hdfs.TestFileCorruption   hadoop.hdfs.server.namenode.TestHDFSConcat   hadoop.hdfs.server.datanode.TestDataNodeMXBean   hadoop.hdfs.server.datanode.TestBlockReplacement   hadoop.hdfs.TestClose   hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics   hadoop.hdfs.TestAbandonBlock   hadoop.hdfs.server.namenode.ha.TestHAFsck   hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant   hadoop.hdfs.server.datanode.TestBlockRecovery   hadoop.hdfs.TestDFSInputStream   hadoop.hdfs.server.namenode.TestNNStorageRetentionFunctional   hadoop.hdfs.TestLeaseRecovery   hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes   hadoop.hdfs.server.datanode.TestTriggerBlockReport   hadoop.hdfs.tools.TestDFSAdmin   hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits   hadoop.hdfs.TestWriteBlockGetsBlockLengthHint   hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation   hadoop.hdfs.server.namenode.TestFsLimits   hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages   hadoop.fs.viewfs.TestViewFsHdfs   hadoop.fs.contract.hdfs.TestHDFSContractConcat   hadoop.hdfs.server.namenode.TestFileLimit   hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing   hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot   hadoop.hdfs.TestHDFSTrash   hadoop.hdfs.server.datanode.TestCachingStrategy   hadoop.hdfs.TestSmallBlock   hadoop.cli.TestCryptoAdminCLI   hadoop.hdfs.TestFileCreationDelete   hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler   hadoop.hdfs.tools.TestDFSHAAdminMiniCluster   hadoop.hdfs.server.namenode.TestClusterId   hadoop.hdfs.TestReplication   hadoop.hdfs.server.namenode.ha.TestHAAppend   hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles   hadoop.cli.TestAclCLI   hadoop.fs.viewfs.TestViewFileSystemWithAcls   hadoop.hdfs.server.namenode.TestEditLogAutoroll   hadoop.fs.TestSymlinkHdfsFileContext   hadoop.hdfs.server.namenode.TestNameNodeResourceChecker   hadoop.hdfs.server.namenode.TestTransferFsImage   hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot   hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA   hadoop.hdfs.server.namenode.TestEditLogRace   hadoop.fs.TestSymlinkHdfsFileSystem   hadoop.hdfs.TestFileAppend3   hadoop.hdfs.server.namenode.TestFileContextXAttr   hadoop.hdfs.server.datanode.TestDataStorage   hadoop.hdfs.server.namenode.TestFSPermissionChecker   hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean   hadoop.fs.TestUnbuffer   hadoop.hdfs.TestPipelines   hadoop.hdfs.server.datanode.TestDataNodeFSDataSetSink   hadoop.hdfs.server.namenode.TestDecommissioningStatus   hadoop.hdfs.server.namenode.ha.TestHASafeMode   hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot   hadoop.hdfs.server.namenode.TestINodeAttributeProvider   hadoop.hdfs.qjournal.TestSecureNNWithQJM   hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps   hadoop.hdfs.TestBlockReaderFactory   hadoop.hdfs.server.namenode.TestNamenodeCapacityReport   hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication   hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithNodeGroup   hadoop.hdfs.server.namenode.ha.TestStandbyIsHot   hadoop.hdfs.server.namenode.TestFileTruncate   hadoop.hdfs.TestFSOutputSummer   hadoop.hdfs.TestBlockReaderLocalLegacy   hadoop.hdfs.server.namenode.TestFSImageWithSnapshot   hadoop.fs.viewfs.TestViewFsWithAcls   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting   hadoop.hdfs.server.blockmanagement.TestPendingReplication   hadoop.hdfs.server.namenode.ha.TestHAStateTransitions   hadoop.hdfs.TestEncryptionZones   hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots   hadoop.fs.TestResolveHdfsSymlink   hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks   hadoop.hdfs.server.namenode.TestXAttrConfigFlag   hadoop.hdfs.TestFileConcurrentReader   hadoop.hdfs.server.blockmanagement.TestNodeCount   hadoop.fs.viewfs.TestViewFsDefaultValue   hadoop.hdfs.TestAppendDifferentChecksum   hadoop.hdfs.server.namenode.TestCacheDirectives   hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus   hadoop.hdfs.server.namenode.TestCreateEditsLog   hadoop.hdfs.server.namenode.TestFSNamesystemMBean   hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary   hadoop.hdfs.server.namenode.TestNameNodeXAttr   hadoop.hdfs.server.blockmanagement.TestReplicationPolicy   hadoop.hdfs.server.datanode.TestHSync   hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer   hadoop.hdfs.server.datanode.TestStorageReport   hadoop.fs.viewfs.TestViewFileSystemHdfs   hadoop.hdfs.TestParallelUnixDomainRead   hadoop.hdfs.client.impl.TestLeaseRenewer   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery   hadoop.hdfs.tools.TestStoragePolicyCommands   hadoop.hdfs.TestDFSRemove   hadoop.fs.viewfs.TestViewFsAtHdfsRoot   hadoop.hdfs.server.datanode.TestDataXceiverLazyPersistHint   hadoop.hdfs.server.datanode.TestSimulatedFSDataset   hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport   hadoop.hdfs.server.datanode.TestDeleteBlockPool   hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork   hadoop.hdfs.server.namenode.TestHostsFiles   hadoop.hdfs.qjournal.TestNNWithQJM   hadoop.hdfs.TestFileCreationClient   hadoop.hdfs.TestRollingUpgradeDowngrade   hadoop.fs.contract.hdfs.TestHDFSContractCreate   hadoop.fs.permission.TestStickyBit   hadoop.hdfs.TestEncryptionZonesWithKMS   hadoop.fs.TestSymlinkHdfsDisable   hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot   hadoop.hdfs.TestDFSUtil   hadoop.hdfs.server.namenode.TestDeleteRace   hadoop.hdfs.server.datanode.TestDataDirs   hadoop.hdfs.TestLease   hadoop.hdfs.TestLargeBlock   hadoop.fs.TestGlobPaths   hadoop.hdfs.server.datanode.TestBPOfferService   hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes   hadoop.hdfs.server.namenode.TestEditLogJournalFailures   hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys   hadoop.hdfs.TestClientProtocolForPipelineRecovery   hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean   hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica   hadoop.hdfs.server.datanode.TestDirectoryScanner   hadoop.hdfs.server.datanode.TestDatanodeProtocolRetryPolicy   hadoop.hdfs.server.namenode.TestSecondaryWebUi   hadoop.fs.contract.hdfs.TestHDFSContractSeek   hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart   hadoop.fs.shell.TestHdfsTextCommand   hadoop.hdfs.TestBlockMissingException Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12754825/HDFS-8929-005.patch Optional Tests site javadoc javac unit findbugs checkstyle git revision trunk / a153b96 hadoop-common test log https://builds.apache.org/job/PreCommit-HDFS-Build/12349/artifact/patchprocess/testrun_hadoop-common.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12349/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12349/testReport/ Java 1.7.0_55 uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12349/console This message was automatically generated.
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #347 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/347/)
        HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) (vinayakumarb: rev 94cf7ab9d28a885181afeb2c181dfe857d158254)

        • hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/server/TestJournalNode.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/Journal.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalMetrics.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #347 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/347/ ) HDFS-8929 . Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) (vinayakumarb: rev 94cf7ab9d28a885181afeb2c181dfe857d158254) hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/server/TestJournalNode.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/Journal.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalMetrics.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #359 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/359/)
        HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) (vinayakumarb: rev 94cf7ab9d28a885181afeb2c181dfe857d158254)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/server/TestJournalNode.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalMetrics.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/Journal.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #359 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/359/ ) HDFS-8929 . Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) (vinayakumarb: rev 94cf7ab9d28a885181afeb2c181dfe857d158254) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/server/TestJournalNode.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalMetrics.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/Journal.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #367 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/367/)
        HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) (vinayakumarb: rev 94cf7ab9d28a885181afeb2c181dfe857d158254)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/server/TestJournalNode.java
        • hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalMetrics.java
        • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/Journal.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #367 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/367/ ) HDFS-8929 . Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) (vinayakumarb: rev 94cf7ab9d28a885181afeb2c181dfe857d158254) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/server/TestJournalNode.java hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalMetrics.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/Journal.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

          People

          • Assignee:
            surendrasingh Surendra Singh Lilhore
            Reporter:
            ajisakaa Akira Ajisaka
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development