Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-187

TestStartup fails if hdfs is running in the same machine

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.0, 0.22.0
    • Fix Version/s: 0.20.2, 0.21.0
    • Component/s: test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Reproduce this:

      • ./bin/start-dfs
      • ant test-core -Dtestcase=TestStartup
        The test may fail.
      1. hdfs-187.txt
        1 kB
        Todd Lipcon
      2. hdfs-187-0.20.txt
        1 kB
        Todd Lipcon

        Activity

        Hide
        Hudson added a comment -

        Integrated in Hdfs-Patch-h5.grid.sp2.yahoo.net #196 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/196/)

        Show
        Hudson added a comment - Integrated in Hdfs-Patch-h5.grid.sp2.yahoo.net #196 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/196/ )
        Hide
        Hudson added a comment -

        Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #99 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/99/)

        Show
        Hudson added a comment - Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #99 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/99/ )
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #202 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/202/)

        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #202 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/202/ )
        Hide
        Tsz Wo Nicholas Sze added a comment -

        I have committed this also to 0.20 and 0.21.

        Show
        Tsz Wo Nicholas Sze added a comment - I have committed this also to 0.20 and 0.21.
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #170 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/170/)
        Move from trunk to 0.20 in CHANGES.txt.

        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #170 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/170/ ) Move from trunk to 0.20 in CHANGES.txt.
        Hide
        Tsz Wo Nicholas Sze added a comment -

        > Hi Nicholas. I think this should be committed to branch-0.21 and branch-0.20 as well. ...
        Sure.

        Reopen for committing it to 0.20 and 0.21.

        Show
        Tsz Wo Nicholas Sze added a comment - > Hi Nicholas. I think this should be committed to branch-0.21 and branch-0.20 as well. ... Sure. Reopen for committing it to 0.20 and 0.21.
        Hide
        Todd Lipcon added a comment -

        Hi Nicholas. I think this should be committed to branch-0.21 and branch-0.20 as well. The trunk patch applies correctly on 0.21. Attaching a patch for 0.20 which is only trivially different (and tested on a machine that previously exhibited this issue)

        Show
        Todd Lipcon added a comment - Hi Nicholas. I think this should be committed to branch-0.21 and branch-0.20 as well. The trunk patch applies correctly on 0.21. Attaching a patch for 0.20 which is only trivially different (and tested on a machine that previously exhibited this issue)
        Hide
        Hudson added a comment -

        Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #94 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/94/)

        Show
        Hudson added a comment - Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #94 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/94/ )
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #195 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/195/)

        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #195 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/195/ )
        Hide
        Hudson added a comment -

        Integrated in Hdfs-Patch-h5.grid.sp2.yahoo.net #172 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/172/)
        . Initialize secondary namenode http address in TestStartup. Contributed by Todd Lipcon

        Show
        Hudson added a comment - Integrated in Hdfs-Patch-h5.grid.sp2.yahoo.net #172 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/172/ ) . Initialize secondary namenode http address in TestStartup. Contributed by Todd Lipcon
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #160 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/160/)
        . Initialize secondary namenode http address in TestStartup. Contributed by Todd Lipcon

        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #160 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/160/ ) . Initialize secondary namenode http address in TestStartup. Contributed by Todd Lipcon
        Hide
        Tsz Wo Nicholas Sze added a comment -

        I have committed this. Thanks, Todd!

        Show
        Tsz Wo Nicholas Sze added a comment - I have committed this. Thanks, Todd!
        Hide
        Tsz Wo Nicholas Sze added a comment -

        +1 patch looks good.

        I tested manually and it worked.

        Show
        Tsz Wo Nicholas Sze added a comment - +1 patch looks good. I tested manually and it worked.
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12429594/hdfs-187.txt
        against trunk revision 895877.

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 3 new or modified tests.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 findbugs. The patch does not introduce any new Findbugs warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed core unit tests.

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/171/testReport/
        Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/171/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
        Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/171/artifact/trunk/build/test/checkstyle-errors.html
        Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/171/console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12429594/hdfs-187.txt against trunk revision 895877. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed core unit tests. +1 contrib tests. The patch passed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/171/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/171/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/171/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/171/console This message is automatically generated.
        Hide
        Todd Lipcon added a comment -

        Trivial patch fixes the issue

        Show
        Todd Lipcon added a comment - Trivial patch fixes the issue
        Hide
        Todd Lipcon added a comment -

        This is still the case in trunk, and can also cause spurious test failures when a build machine is shared.

        Show
        Todd Lipcon added a comment - This is still the case in trunk, and can also cause spurious test failures when a build machine is shared.
        Hide
        Tsz Wo Nicholas Sze added a comment -

        It seems that TestStartup is talking to the running hdfs through servlets. It may fail in different ways. I guess the failure depends on the status of the hdfs.

        Show
        Tsz Wo Nicholas Sze added a comment - It seems that TestStartup is talking to the running hdfs through servlets. It may fail in different ways. I guess the failure depends on the status of the hdfs.

          People

          • Assignee:
            Todd Lipcon
            Reporter:
            Tsz Wo Nicholas Sze
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development