Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.3, 2.0.0-alpha
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: hdfs-client
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Incompatible change, Reviewed

      Description

      Hftp transfers >2GB hang after the transfer is complete. The problem appears to be caused by java internally using an int for the content length. When it overflows 2GB, it won't check the bounds of the reads on the input stream. The client continues reading after all data is received, and the client blocks until the server times out the connection – many minutes later. In conjunction with hftp timeouts, all transfers >2G fail with a read timeout.

      1. HDFS-3318-1.patch
        3 kB
        Daryn Sharp
      2. HDFS-3318.patch
        2 kB
        Daryn Sharp

        Issue Links

          Activity

          Allen Wittenauer made changes -
          Affects Version/s 0.24.0 [ 12317653 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue is related to HDFS-4715 [ HDFS-4715 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Arun C Murthy made changes -
          Fix Version/s 2.0.2-alpha [ 12322472 ]
          Eli Collins made changes -
          Link This issue relates to HDFS-3166 [ HDFS-3166 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue is related to HDFS-3577 [ HDFS-3577 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue breaks HDFS-3577 [ HDFS-3577 ]
          Eli Collins made changes -
          Link This issue relates to HDFS-1085 [ HDFS-1085 ]
          Eli Collins made changes -
          Link This issue is related to HDFS-3671 [ HDFS-3671 ]
          Eli Collins made changes -
          Hadoop Flags Reviewed [ 10343 ] Incompatible change,Reviewed [ 10342, 10343 ]
          Rahul Jain made changes -
          Link This issue is related to HDFS-3577 [ HDFS-3577 ]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 0.23.3 [ 12320052 ]
          Resolution Fixed [ 1 ]
          Daryn Sharp made changes -
          Attachment HDFS-3318-1.patch [ 12524289 ]
          Daryn Sharp made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Daryn Sharp made changes -
          Field Original Value New Value
          Attachment HDFS-3318.patch [ 12524067 ]
          Daryn Sharp created issue -

            People

            • Assignee:
              Daryn Sharp
              Reporter:
              Daryn Sharp
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development