Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.18.3, 0.19.2, 0.20.1
    • Fix Version/s: 0.21.0
    • Component/s: fs/s3
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      If a user's map function is CPU intensive and doesn't read from the input very quickly, compounded by the buffering of input, then S3 might think the connection has been lost and will close the connection. Then when the user attempts to read from the input again, they'll receive a SocketTimeoutException and the task will fail.

      1. HADOOP-6254-2.txt
        5 kB
        Andrew Hitchcock
      2. HADOOP-6254.diff
        5 kB
        Andrew Hitchcock
      3. HADOOP-6254.diff
        2 kB
        Andrew Hitchcock

        Activity

          People

          • Assignee:
            Andrew Hitchcock
            Reporter:
            Andrew Hitchcock
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development