Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5114

A bunch of mapred unit tests are failing on Windows

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Test
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.18.3
    • 0.18.4
    • test
    • None
    • Windows

    • Reviewed
    • Remove timeout for accept() in DataNode. This made accept() fail in JDK on Windows and caused many tests to fail.

    Description

      A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:

      Exception: "java.net.ConnectException: Connection refused: no further information"
      Failing tests:

      • TestMiniMRMapRedDebugScript - testMapDebugScript
      • TestNoDefaultsJobConf - testNoDefaults
      • TestQueueManager - testAllEnabledACLForJobSubmission
      • TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
      • TestJobInProgressListener - testJobQueueChanges
      • TestKillCompletedJob - testKillCompJob
      • TestMiniMRClasspath - testClassPath
      • TestMiniMRDFSCaching - testWithDFS
      • TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
      • TestSetupAndCleanupFailure - testWithDFS
      • TestDBJob - testRun
      • TestMiniMRWithDFS - testWithDFS
      • TestJobStatusPersistency - testNonPersistency
      • TestSpecialCharactersInOutputPath - testJobWithDFS
      • TestUserDefinedCounters - testMapReduceJob
      • TestDelegatingInputFormat - testSplitting
      • TestEmptyJobWithDFS - testEmptyJobWithDFS
      • TestJavaSerialization - testMapReduceJob
      • TestClusterMapReduceTestCase - testMapReduce

      Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
      Failing tests:

      • TestJobInProgress - testRunningTaskCount
      • TestJobQueueInformation - testJobQueues
      • TestJobTrackerRestart - testJobTrackerRestart

      Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
      Failing tests:

      • TestJobSysDirWithDFS - testWithDFS
      • TestJobInProgress - testPendingMapTaskCount
      • TestMiniMRDFSSort - testMapReduceSort

      Exception: junit.framework.AssertionFailedError
      Failing tests:

      • TestMRServerPorts - testJobTrackerPorts
      • TestMRServerPorts - testTaskTrackerPorts
      • TestMiniMRTaskTempDir - testTaskTempDir

      Exception: java.io.IOException: Job failed!
      Failing tests:

      • TestMiniMRLocalFS - testWithLocal

      Attachments

        1. HADOOP-5114.patch
          5 kB
          Raghu Angadi
        2. HADOOP-5114.patch
          2 kB
          Raghu Angadi
        3. HADOOP-5114.patch
          2 kB
          Raghu Angadi
        4. HADOOP-5114.patch
          2 kB
          Raghu Angadi
        5. HADOOP-5114.patch
          6 kB
          Raghu Angadi
        6. HADOOP-5114-branch-18.patch
          4 kB
          Raghu Angadi
        7. HADOOP-5114-branch-18.patch
          2 kB
          Raghu Angadi
        8. HADOOP-5114-branch-18.patch
          2 kB
          Raghu Angadi
        9. LOGS.zip
          44 kB
          Ramya Sunil
        10. TEST-org.apache.hadoop.dfs.TestOverReplicatedBlocks.txt
          34 kB
          Ramya Sunil
        11. tmp.log
          66 kB
          Konstantin Shvachko

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rangadi Raghu Angadi
            rramya Ramya Sunil
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment