Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2871

Unit tests (16) fail on Windows due to java.lang.IllegalArgumentException causing MiniMRCluster to not start up

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.17.0
    • 0.17.0
    • None
    • None
    • Windows

    Description

      Unit tests (16) fail on Windows due to java.lang.IllegalArgumentException causing MiniMRCluster to not start up. It works fine on Linux and Solaris

      I suspect it is due to this fix: HADOOP-2178. Job History on DFS

      All changes that went in:
      1. HADOOP-2769. TestNNThroughputBnechmark should not use a fixed port for the namenode http port.
      2. HADOOP-2192. Error messages from "dfs mv" command improved.
      3. HADOOP-2178. Job History on DFS.
      4. HADOOP-2730. HOD documentation update.
      5. HADOOP-2371. Commit for the html/pdf docs.
      6. HADOOP-2766. Enables setting of HADOOP_OPTS env variable for the hadoop daemons through HOD.

      Failing tests:
      org.apache.hadoop.ipc.TestSocketFactory.unknown
      org.apache.hadoop.mapred.TestClusterMRNotification.unknown
      org.apache.hadoop.mapred.TestClusterMapReduceTestCase.unknown
      org.apache.hadoop.mapred.TestEmptyJobWithDFS.unknown
      org.apache.hadoop.mapred.TestJobStatusPersistency.unknown
      org.apache.hadoop.mapred.TestMRServerPorts.testJobTrackerPorts
      org.apache.hadoop.mapred.TestMRServerPorts.testTaskTrackerPorts
      org.apache.hadoop.mapred.TestMiniMRBringup.unknown
      org.apache.hadoop.mapred.TestMiniMRClasspath.unknown
      org.apache.hadoop.mapred.TestMiniMRDFSCaching.unknown
      org.apache.hadoop.mapred.TestMiniMRDFSSort.unknown
      org.apache.hadoop.mapred.TestMiniMRLocalFS.unknown
      org.apache.hadoop.mapred.TestMiniMRMapRedDebugScript.unknown
      org.apache.hadoop.mapred.TestMiniMRTaskTempDir.unknown
      org.apache.hadoop.mapred.TestMiniMRWithDFS.unknown
      org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath.unknown

      Snippet from console:
      [junit] java.lang.IllegalArgumentException: Wrong FS: file://C:\hudson\workspace\Hadoop-WindowsTest\trunk/build/test/logs/history, expected: file:///
      [junit] at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:268)
      [junit] at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:54)
      [junit] at org.apache.hadoop.fs.RawLocalFileSystem.exists(RawLocalFileSystem.java:223)
      [junit] at org.apache.hadoop.fs.FilterFileSystem.exists(FilterFileSystem.java:147)
      [junit] at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:124)
      [junit] at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:706)
      [junit] at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:124)
      [junit] at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner.run(MiniMRCluster.java:73)
      [junit] at java.lang.Thread.run(Thread.java:595)
      [junit] 2008-02-21 10:21:29,319 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(281)) - Waiting for JobTracker to start...
      [junit] 2008-02-21 10:21:30,318 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(281)) - Waiting for JobTracker to start...
      [junit] 2008-02-21 10:21:31,318 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(281)) - Waiting for JobTracker to start...
      [junit] 2008-02-21 10:21:32,318 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(281)) - Waiting for JobTracker to start...
      [junit] 2008-02-21 10:21:33,317 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(281)) - Waiting for JobTracker to start...
      [junit] 2008-02-21 10:21:34,317 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(281)) - Waiting for JobTracker to start...
      [junit] 2008-02-21 10:21:35,316 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(281)) - Waiting for JobTracker to start...
      [junit] 2008-02-21 10:21:36,316 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(281)) - Waiting for JobTracker to start...
      [junit] 2008-02-21 10:21:37,316 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(281)) - Waiting for JobTracker to start...
      [junit] 2008-02-21 10:21:38,315 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(281)) - Waiting for JobTracker to start...
      [junit] 2008-02-21 10:21:39,315 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(281)) - Waiting for JobTracker to start...

      Attachments

        1. patch-2871.txt
          2 kB
          Amareshwari Sriramadasu

        Activity

          People

            amareshwari Amareshwari Sriramadasu
            mukundm Mukund Madhugiri
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: