Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.18.3, 0.19.2, 0.20.1
    • Fix Version/s: 0.21.0
    • Component/s: fs/s3
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      If a user's map function is CPU intensive and doesn't read from the input very quickly, compounded by the buffering of input, then S3 might think the connection has been lost and will close the connection. Then when the user attempts to read from the input again, they'll receive a SocketTimeoutException and the task will fail.

        Attachments

        1. HADOOP-6254-2.txt
          5 kB
          Andrew Hitchcock
        2. HADOOP-6254.diff
          5 kB
          Andrew Hitchcock
        3. HADOOP-6254.diff
          2 kB
          Andrew Hitchcock

          Issue Links

            Activity

              People

              • Assignee:
                anhi Andrew Hitchcock
                Reporter:
                anhi Andrew Hitchcock
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: