Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-4551

Change WebHDFS buffersize behavior to improve default performance

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.1.2
    • Fix Version/s: 1.2.0
    • Component/s: webhdfs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently on 1.X branch, the buffer size used to copy bytes to network defaults to io.file.buffer.size. This causes performance problems if that buffersize is large.

      1. HDFS-4551.1.patch
        0.8 kB
        Mark Wagner

        Issue Links

          Activity

          Mark Wagner created issue -
          Mark Wagner made changes -
          Field Original Value New Value
          Assignee Mark Wagner [ mwagner ]
          Mark Wagner made changes -
          Attachment HDFS-4551.1.patch [ 12572019 ]
          Mark Wagner made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tsz Wo Nicholas Sze made changes -
          Hadoop Flags Reviewed [ 10343 ]
          Issue Type Bug [ 1 ] Improvement [ 4 ]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 1.2.0 [ 12321657 ]
          Resolution Fixed [ 1 ]
          Matt Foley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Carl Steinbach made changes -
          Link This issue relates to HDFS-4549 [ HDFS-4549 ]

            People

            • Assignee:
              Mark Wagner
              Reporter:
              Mark Wagner
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development