Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6254

s3n fails with SocketTimeoutException

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.18.3, 0.19.2, 0.20.1
    • 0.21.0
    • fs/s3
    • None
    • Reviewed

    Description

      If a user's map function is CPU intensive and doesn't read from the input very quickly, compounded by the buffering of input, then S3 might think the connection has been lost and will close the connection. Then when the user attempts to read from the input again, they'll receive a SocketTimeoutException and the task will fail.

      Attachments

        1. HADOOP-6254.diff
          2 kB
          Andrew Hitchcock
        2. HADOOP-6254.diff
          5 kB
          Andrew Hitchcock
        3. HADOOP-6254-2.txt
          5 kB
          Andrew Hitchcock

        Issue Links

          Activity

            People

              anhi Andrew Hitchcock
              anhi Andrew Hitchcock
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: