Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-941

Datanode xceiver protocol should allow reuse of a connection

    Details

    • Hadoop Flags:
      Reviewed

      Description

      Right now each connection into the datanode xceiver only processes one operation.

      In the case that an operation leaves the stream in a well-defined state (eg a client reads to the end of a block successfully) the same connection could be reused for a second operation. This should improve random read performance significantly.

      1. HDFS-941-1.patch
        42 kB
        bc Wong
      2. HDFS-941-2.patch
        62 kB
        bc Wong
      3. HDFS-941-3.patch
        63 kB
        bc Wong
      4. HDFS-941-3.patch
        63 kB
        bc Wong
      5. HDFS-941-4.patch
        64 kB
        bc Wong
      6. HDFS-941-5.patch
        82 kB
        bc Wong
      7. hdfs941-1.png
        7 kB
        Kihwal Lee
      8. HDFS-941-6.patch
        55 kB
        bc Wong
      9. HDFS-941-6.patch
        55 kB
        bc Wong
      10. HDFS-941-6.patch
        55 kB
        bc Wong
      11. hdfs-941.txt
        56 kB
        Todd Lipcon
      12. hdfs-941.txt
        58 kB
        Todd Lipcon
      13. HDFS-941-6.22.patch
        55 kB
        stack
      14. hdfs-941.txt
        60 kB
        Todd Lipcon
      15. fix-close-delta.txt
        4 kB
        Todd Lipcon
      16. hdfs-941.txt
        60 kB
        Todd Lipcon
      17. 941.22.txt
        63 kB
        stack
      18. 941.22.txt
        63 kB
        stack
      19. 941.22.v2.txt
        63 kB
        stack
      20. 941.22.v3.txt
        61 kB
        stack

        Issue Links

          Activity

          Todd Lipcon created issue -
          Todd Lipcon made changes -
          Field Original Value New Value
          Link This issue is blocked by HDFS-1001 [ HDFS-1001 ]
          Todd Lipcon made changes -
          Link This issue relates to HDFS-380 [ HDFS-380 ]
          bc Wong made changes -
          Attachment HDFS-941-1.patch [ 12438934 ]
          bc Wong made changes -
          Assignee bc Wong [ bcwalrus ]
          bc Wong made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          bc Wong made changes -
          Attachment HDFS-941-2.patch [ 12441231 ]
          bc Wong made changes -
          Attachment HDFS-941-3.patch [ 12443127 ]
          bc Wong made changes -
          Attachment HDFS-941-3.patch [ 12443215 ]
          bc Wong made changes -
          Attachment HDFS-941-4.patch [ 12443322 ]
          Jeff Hammerbacher made changes -
          Link This issue relates to HDFS-1148 [ HDFS-1148 ]
          Sanjay Radia made changes -
          Link This issue is related to HDFS-1599 [ HDFS-1599 ]
          Jason Rutherglen made changes -
          Link This issue blocks HBASE-3529 [ HBASE-3529 ]
          bc Wong made changes -
          Attachment HDFS-941-5.patch [ 12473851 ]
          Kihwal Lee made changes -
          Attachment hdfs941-1.png [ 12474539 ]
          Jason Rutherglen made changes -
          Link This issue is related to HBASE-3529 [ HBASE-3529 ]
          Jason Rutherglen made changes -
          Link This issue blocks HBASE-3529 [ HBASE-3529 ]
          bc Wong made changes -
          Attachment HDFS-941-6.patch [ 12475847 ]
          bc Wong made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          bc Wong made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          bc Wong made changes -
          Attachment HDFS-941-6.patch [ 12476021 ]
          bc Wong made changes -
          Attachment HDFS-941-6.patch [ 12476027 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481534 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481594 ]
          stack made changes -
          Attachment HDFS-941-6.22.patch [ 12481851 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481868 ]
          Todd Lipcon made changes -
          Attachment fix-close-delta.txt [ 12481895 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481896 ]
          Todd Lipcon made changes -
          Hadoop Flags [Reviewed]
          stack made changes -
          Attachment 941.22.txt [ 12481962 ]
          stack made changes -
          Attachment 941.22.txt [ 12481963 ]
          Kihwal Lee made changes -
          Link This issue relates to HDFS-2071 [ HDFS-2071 ]
          stack made changes -
          Attachment 941.22.v2.txt [ 12482475 ]
          stack made changes -
          Attachment 941.22.v3.txt [ 12482513 ]
          Todd Lipcon made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.22.0 [ 12314241 ]
          Resolution Fixed [ 1 ]
          Todd Lipcon made changes -
          Component/s performance [ 12316501 ]
          Konstantin Shvachko made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Todd Lipcon made changes -
          Link This issue is related to HDFS-3359 [ HDFS-3359 ]

            People

            • Assignee:
              bc Wong
              Reporter:
              Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              38 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development