Uploaded image for project: 'Apache Knox'
  1. Apache Knox
  2. KNOX-1221

WebHDFS read/write performance limitations

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Information Provided
    • Affects Version/s: 0.9.0, 0.10.0, 0.11.0, 0.12.0, 0.13.0, 0.14.0, 1.0.0, 1.1.0
    • Fix Version/s: 1.2.0
    • Component/s: Server
    • Labels:
      None
    • Environment:

      Description

      If I use direct connection to WebHDFS from one node I have speed nearly several gigabites/sec when download or upload large files. But if I use knox I have ulpload/download speed only 100mbit/sec from the same node. Found that knox limits speed for one https session. As a workaround I upload large files through knox in parallel but it is not a good way.

      Couldn't find any configuration params that can control such behaviour. Is it a code limitation?

        Attachments

        1. gateway-site.xml
          4 kB
          Georgy
        2. rtk.xml
          2 kB
          Georgy

          Issue Links

            Activity

              People

              • Assignee:
                krisden Kevin Risden
                Reporter:
                maythes Georgy
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: