Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-941

Datanode xceiver protocol should allow reuse of a connection

    Details

    • Hadoop Flags:
      Reviewed

      Description

      Right now each connection into the datanode xceiver only processes one operation.

      In the case that an operation leaves the stream in a well-defined state (eg a client reads to the end of a block successfully) the same connection could be reused for a second operation. This should improve random read performance significantly.

      1. HDFS-941-6.patch
        55 kB
        bc Wong
      2. HDFS-941-6.patch
        55 kB
        bc Wong
      3. HDFS-941-6.patch
        55 kB
        bc Wong
      4. HDFS-941-6.22.patch
        55 kB
        stack
      5. HDFS-941-5.patch
        82 kB
        bc Wong
      6. HDFS-941-4.patch
        64 kB
        bc Wong
      7. HDFS-941-3.patch
        63 kB
        bc Wong
      8. HDFS-941-3.patch
        63 kB
        bc Wong
      9. HDFS-941-2.patch
        62 kB
        bc Wong
      10. hdfs941-1.png
        7 kB
        Kihwal Lee
      11. HDFS-941-1.patch
        42 kB
        bc Wong
      12. hdfs-941.txt
        56 kB
        Todd Lipcon
      13. hdfs-941.txt
        58 kB
        Todd Lipcon
      14. hdfs-941.txt
        60 kB
        Todd Lipcon
      15. hdfs-941.txt
        60 kB
        Todd Lipcon
      16. fix-close-delta.txt
        4 kB
        Todd Lipcon
      17. 941.22.v3.txt
        61 kB
        stack
      18. 941.22.v2.txt
        63 kB
        stack
      19. 941.22.txt
        63 kB
        stack
      20. 941.22.txt
        63 kB
        stack

        Issue Links

          Activity

          Todd Lipcon created issue -
          Todd Lipcon made changes -
          Field Original Value New Value
          Link This issue is blocked by HDFS-1001 [ HDFS-1001 ]
          Todd Lipcon made changes -
          Link This issue relates to HDFS-380 [ HDFS-380 ]
          bc Wong made changes -
          Attachment HDFS-941-1.patch [ 12438934 ]
          bc Wong made changes -
          Assignee bc Wong [ bcwalrus ]
          bc Wong made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          bc Wong made changes -
          Attachment HDFS-941-2.patch [ 12441231 ]
          bc Wong made changes -
          Attachment HDFS-941-3.patch [ 12443127 ]
          bc Wong made changes -
          Attachment HDFS-941-3.patch [ 12443215 ]
          bc Wong made changes -
          Attachment HDFS-941-4.patch [ 12443322 ]
          Jeff Hammerbacher made changes -
          Link This issue relates to HDFS-1148 [ HDFS-1148 ]
          Sanjay Radia made changes -
          Link This issue is related to HDFS-1599 [ HDFS-1599 ]
          Jason Rutherglen made changes -
          Link This issue blocks HBASE-3529 [ HBASE-3529 ]
          bc Wong made changes -
          Attachment HDFS-941-5.patch [ 12473851 ]
          Kihwal Lee made changes -
          Attachment hdfs941-1.png [ 12474539 ]
          Jason Rutherglen made changes -
          Link This issue is related to HBASE-3529 [ HBASE-3529 ]
          Jason Rutherglen made changes -
          Link This issue blocks HBASE-3529 [ HBASE-3529 ]
          bc Wong made changes -
          Attachment HDFS-941-6.patch [ 12475847 ]
          bc Wong made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          bc Wong made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          bc Wong made changes -
          Attachment HDFS-941-6.patch [ 12476021 ]
          bc Wong made changes -
          Attachment HDFS-941-6.patch [ 12476027 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481534 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481594 ]
          stack made changes -
          Attachment HDFS-941-6.22.patch [ 12481851 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481868 ]
          Todd Lipcon made changes -
          Attachment fix-close-delta.txt [ 12481895 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481896 ]
          Todd Lipcon made changes -
          Hadoop Flags [Reviewed]
          stack made changes -
          Attachment 941.22.txt [ 12481962 ]
          stack made changes -
          Attachment 941.22.txt [ 12481963 ]
          Kihwal Lee made changes -
          Link This issue relates to HDFS-2071 [ HDFS-2071 ]
          stack made changes -
          Attachment 941.22.v2.txt [ 12482475 ]
          stack made changes -
          Attachment 941.22.v3.txt [ 12482513 ]
          Todd Lipcon made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.22.0 [ 12314241 ]
          Resolution Fixed [ 1 ]
          Todd Lipcon made changes -
          Component/s performance [ 12316501 ]
          Konstantin Shvachko made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Todd Lipcon made changes -
          Link This issue is related to HDFS-3359 [ HDFS-3359 ]

            People

            • Assignee:
              bc Wong
              Reporter:
              Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              38 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development