Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-941

Datanode xceiver protocol should allow reuse of a connection

    Details

    • Hadoop Flags:
      Reviewed

      Description

      Right now each connection into the datanode xceiver only processes one operation.

      In the case that an operation leaves the stream in a well-defined state (eg a client reads to the end of a block successfully) the same connection could be reused for a second operation. This should improve random read performance significantly.

      1. 941.22.txt
        63 kB
        stack
      2. 941.22.txt
        63 kB
        stack
      3. 941.22.v2.txt
        63 kB
        stack
      4. 941.22.v3.txt
        61 kB
        stack
      5. fix-close-delta.txt
        4 kB
        Todd Lipcon
      6. hdfs-941.txt
        60 kB
        Todd Lipcon
      7. hdfs-941.txt
        60 kB
        Todd Lipcon
      8. hdfs-941.txt
        58 kB
        Todd Lipcon
      9. hdfs-941.txt
        56 kB
        Todd Lipcon
      10. HDFS-941-1.patch
        42 kB
        bc Wong
      11. hdfs941-1.png
        7 kB
        Kihwal Lee
      12. HDFS-941-2.patch
        62 kB
        bc Wong
      13. HDFS-941-3.patch
        63 kB
        bc Wong
      14. HDFS-941-3.patch
        63 kB
        bc Wong
      15. HDFS-941-4.patch
        64 kB
        bc Wong
      16. HDFS-941-5.patch
        82 kB
        bc Wong
      17. HDFS-941-6.22.patch
        55 kB
        stack
      18. HDFS-941-6.patch
        55 kB
        bc Wong
      19. HDFS-941-6.patch
        55 kB
        bc Wong
      20. HDFS-941-6.patch
        55 kB
        bc Wong

        Issue Links

          Activity

          Todd Lipcon created issue -
          Todd Lipcon made changes -
          Field Original Value New Value
          Link This issue is blocked by HDFS-1001 [ HDFS-1001 ]
          Todd Lipcon made changes -
          Link This issue relates to HDFS-380 [ HDFS-380 ]
          bc Wong made changes -
          Attachment HDFS-941-1.patch [ 12438934 ]
          bc Wong made changes -
          Assignee bc Wong [ bcwalrus ]
          bc Wong made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          bc Wong made changes -
          Attachment HDFS-941-2.patch [ 12441231 ]
          bc Wong made changes -
          Attachment HDFS-941-3.patch [ 12443127 ]
          bc Wong made changes -
          Attachment HDFS-941-3.patch [ 12443215 ]
          bc Wong made changes -
          Attachment HDFS-941-4.patch [ 12443322 ]
          Jeff Hammerbacher made changes -
          Link This issue relates to HDFS-1148 [ HDFS-1148 ]
          Sanjay Radia made changes -
          Link This issue is related to HDFS-1599 [ HDFS-1599 ]
          Jason Rutherglen made changes -
          Link This issue blocks HBASE-3529 [ HBASE-3529 ]
          bc Wong made changes -
          Attachment HDFS-941-5.patch [ 12473851 ]
          Kihwal Lee made changes -
          Attachment hdfs941-1.png [ 12474539 ]
          Jason Rutherglen made changes -
          Link This issue is related to HBASE-3529 [ HBASE-3529 ]
          Jason Rutherglen made changes -
          Link This issue blocks HBASE-3529 [ HBASE-3529 ]
          bc Wong made changes -
          Attachment HDFS-941-6.patch [ 12475847 ]
          bc Wong made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          bc Wong made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          bc Wong made changes -
          Attachment HDFS-941-6.patch [ 12476021 ]
          bc Wong made changes -
          Attachment HDFS-941-6.patch [ 12476027 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481534 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481594 ]
          stack made changes -
          Attachment HDFS-941-6.22.patch [ 12481851 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481868 ]
          Todd Lipcon made changes -
          Attachment fix-close-delta.txt [ 12481895 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481896 ]
          Todd Lipcon made changes -
          Hadoop Flags [Reviewed]
          stack made changes -
          Attachment 941.22.txt [ 12481962 ]
          stack made changes -
          Attachment 941.22.txt [ 12481963 ]
          Kihwal Lee made changes -
          Link This issue relates to HDFS-2071 [ HDFS-2071 ]
          stack made changes -
          Attachment 941.22.v2.txt [ 12482475 ]
          stack made changes -
          Attachment 941.22.v3.txt [ 12482513 ]
          Todd Lipcon made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.22.0 [ 12314241 ]
          Resolution Fixed [ 1 ]
          Todd Lipcon made changes -
          Component/s performance [ 12316501 ]
          Konstantin Shvachko made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Todd Lipcon made changes -
          Link This issue is related to HDFS-3359 [ HDFS-3359 ]

            People

            • Assignee:
              bc Wong
              Reporter:
              Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              38 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development