Details
-
Bug
-
Status: Closed
-
Critical
-
Resolution: Cannot Reproduce
-
0.19.0
-
None
-
None
-
None
-
windows
Description
Unit test TestMiniMRDFSSort.testMapReduceSort fails on windows with a timeout
I see this on the console:
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:19,435 WARN mapred.ReduceTask (ReduceTask.java:run(928)) - attempt_200806252017_0003_r_000000_0 copy failed: attempt_200806252017_0003_m_000002_0 from localhost
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:19,435 WARN mapred.ReduceTask (ReduceTask.java:run(930)) - java.net.SocketTimeoutException: Read timed out
[junit] attempt_200806252017_0003_r_000000_0: at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
[junit] attempt_200806252017_0003_r_000000_0: at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
[junit] attempt_200806252017_0003_r_000000_0: at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
[junit] attempt_200806252017_0003_r_000000_0: at java.lang.reflect.Constructor.newInstance(Constructor.java:494)
[junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.protocol.http.HttpURLConnection$6.run(HttpURLConnection.java:1225)
[junit] attempt_200806252017_0003_r_000000_0: at java.security.AccessController.doPrivileged(Native Method)
[junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1219)
[junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:906)
[junit] attempt_200806252017_0003_r_000000_0: at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1217)
[junit] attempt_200806252017_0003_r_000000_0: at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1067)
[junit] attempt_200806252017_0003_r_000000_0: at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:976)
[junit] attempt_200806252017_0003_r_000000_0: at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:925)
[junit] attempt_200806252017_0003_r_000000_0: Caused by: java.net.SocketTimeoutException: Read timed out
[junit] attempt_200806252017_0003_r_000000_0: at java.net.SocketInputStream.socketRead0(Native Method)
[junit] attempt_200806252017_0003_r_000000_0: at java.net.SocketInputStream.read(SocketInputStream.java:129)
[junit] attempt_200806252017_0003_r_000000_0: at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
[junit] attempt_200806252017_0003_r_000000_0: at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
[junit] attempt_200806252017_0003_r_000000_0: at java.io.BufferedInputStream.read(BufferedInputStream.java:313)
[junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:681)
[junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:626)
[junit] attempt_200806252017_0003_r_000000_0: at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:957)
[junit] attempt_200806252017_0003_r_000000_0: ... 4 more
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:20,154 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1564)) - Task attempt_200806252017_0003_r_000000_0: Failed fetch #2 from attempt_200806252017_0003_m_000002_0
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:20,154 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1575)) - Failed to fetch map-output from attempt_200806252017_0003_m_000002_0 even after MAX_FETCH_RETRIES_PER_MAP retries... reporting to the JobTracker
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:20,154 WARN mapred.ReduceTask (ReduceTask.java:fetchOutputs(1636)) - attempt_200806252017_0003_r_000000_0 adding host localhost to penalty box, next contact in 8 seconds
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:21,201 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1427)) - attempt_200806252017_0003_r_000000_0: Got 5 map-outputs from previous failures
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:29:31,216 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1486)) - attempt_200806252017_0003_r_000000_0 Scheduled 1 of 5 known outputs (0 slow hosts and 4 dup hosts)
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:30:08,482 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1390)) - attempt_200806252017_0003_r_000000_0 Need another 20 map output(s) where 1 is already in progress
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:30:09,451 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1413)) - attempt_200806252017_0003_r_000000_0: Got 0 new map-outputs & number of known map outputs is 4
[junit] attempt_200806252017_0003_r_000000_0: 2008-06-25 20:30:09,451 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1486)) - attempt_200806252017_0003_r_000000_0 Scheduled 0 of 4 known outputs (0 slow hosts and 4 dup hosts)
[junit] 2008-06-25 20:31:00,779 INFO mapred.JobClient (JobClient.java:runJob(1037)) - Task Id : attempt_200806252017_0003_m_000002_0, Status : KILLED