Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-284

dfs timeout on open

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.3.1
    • Fix Version/s: 0.3.2
    • Component/s: None
    • Labels:
      None

      Description

      In my sort benchmark, I've started seeing hundred's of maps dying with timeout exceptions in the dfs.open() code:

      java.net.SocketTimeoutException: timed out waiting for rpc response at org.apache.hadoop.ipc.Client.call(Client.java:305) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:153) at org.apache.hadoop.dfs.$Proxy1.open(Unknown Source) at org.apache.hadoop.dfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:457) at org.apache.hadoop.dfs.DFSClient$DFSInputStream.(DFSClient.java:444) at org.apache.hadoop.dfs.DFSClient.open(DFSClient.java:207) at org.apache.hadoop.dfs.DistributedFileSystem.openRaw(DistributedFileSystem.java:90) at org.apache.hadoop.fs.FSDataInputStream$Checker.(FSDataInputStream.java:46) at org.apache.hadoop.fs.FSDataInputStream.(FSDataInputStream.java:228) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:157) at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:72) at org.apache.hadoop.dfs.DistributedFileSystem.copyToLocalFile(DistributedFileSystem.java:182) at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:535) at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:584) at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:395) at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:308) at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:424) at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:961)

        Attachments

          Activity

            People

            • Assignee:
              omalley Owen O'Malley
              Reporter:
              omalley Owen O'Malley
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: