Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-941

Datanode xceiver protocol should allow reuse of a connection

    Details

    • Hadoop Flags:
      Reviewed

      Description

      Right now each connection into the datanode xceiver only processes one operation.

      In the case that an operation leaves the stream in a well-defined state (eg a client reads to the end of a block successfully) the same connection could be reused for a second operation. This should improve random read performance significantly.

      1. 941.22.v3.txt
        61 kB
        stack
      2. 941.22.v2.txt
        63 kB
        stack
      3. 941.22.txt
        63 kB
        stack
      4. 941.22.txt
        63 kB
        stack
      5. hdfs-941.txt
        60 kB
        Todd Lipcon
      6. fix-close-delta.txt
        4 kB
        Todd Lipcon
      7. hdfs-941.txt
        60 kB
        Todd Lipcon
      8. HDFS-941-6.22.patch
        55 kB
        stack
      9. hdfs-941.txt
        58 kB
        Todd Lipcon
      10. hdfs-941.txt
        56 kB
        Todd Lipcon
      11. HDFS-941-6.patch
        55 kB
        bc Wong
      12. HDFS-941-6.patch
        55 kB
        bc Wong
      13. HDFS-941-6.patch
        55 kB
        bc Wong
      14. hdfs941-1.png
        7 kB
        Kihwal Lee
      15. HDFS-941-5.patch
        82 kB
        bc Wong
      16. HDFS-941-4.patch
        64 kB
        bc Wong
      17. HDFS-941-3.patch
        63 kB
        bc Wong
      18. HDFS-941-3.patch
        63 kB
        bc Wong
      19. HDFS-941-2.patch
        62 kB
        bc Wong
      20. HDFS-941-1.patch
        42 kB
        bc Wong

        Issue Links

          Activity

          Todd Lipcon made changes -
          Link This issue is related to HDFS-3359 [ HDFS-3359 ]
          Konstantin Shvachko made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Todd Lipcon made changes -
          Component/s performance [ 12316501 ]
          Todd Lipcon made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.22.0 [ 12314241 ]
          Resolution Fixed [ 1 ]
          stack made changes -
          Attachment 941.22.v3.txt [ 12482513 ]
          stack made changes -
          Attachment 941.22.v2.txt [ 12482475 ]
          Kihwal Lee made changes -
          Link This issue relates to HDFS-2071 [ HDFS-2071 ]
          stack made changes -
          Attachment 941.22.txt [ 12481963 ]
          stack made changes -
          Attachment 941.22.txt [ 12481962 ]
          Todd Lipcon made changes -
          Hadoop Flags [Reviewed]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481896 ]
          Todd Lipcon made changes -
          Attachment fix-close-delta.txt [ 12481895 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481868 ]
          stack made changes -
          Attachment HDFS-941-6.22.patch [ 12481851 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481594 ]
          Todd Lipcon made changes -
          Attachment hdfs-941.txt [ 12481534 ]
          bc Wong made changes -
          Attachment HDFS-941-6.patch [ 12476027 ]
          bc Wong made changes -
          Attachment HDFS-941-6.patch [ 12476021 ]
          bc Wong made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          bc Wong made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          bc Wong made changes -
          Attachment HDFS-941-6.patch [ 12475847 ]
          Jason Rutherglen made changes -
          Link This issue blocks HBASE-3529 [ HBASE-3529 ]
          Jason Rutherglen made changes -
          Link This issue is related to HBASE-3529 [ HBASE-3529 ]
          Kihwal Lee made changes -
          Attachment hdfs941-1.png [ 12474539 ]
          bc Wong made changes -
          Attachment HDFS-941-5.patch [ 12473851 ]
          Jason Rutherglen made changes -
          Link This issue blocks HBASE-3529 [ HBASE-3529 ]
          Sanjay Radia made changes -
          Link This issue is related to HDFS-1599 [ HDFS-1599 ]
          Jeff Hammerbacher made changes -
          Link This issue relates to HDFS-1148 [ HDFS-1148 ]
          bc Wong made changes -
          Attachment HDFS-941-4.patch [ 12443322 ]
          bc Wong made changes -
          Attachment HDFS-941-3.patch [ 12443215 ]
          bc Wong made changes -
          Attachment HDFS-941-3.patch [ 12443127 ]
          bc Wong made changes -
          Attachment HDFS-941-2.patch [ 12441231 ]
          bc Wong made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          bc Wong made changes -
          Assignee bc Wong [ bcwalrus ]
          bc Wong made changes -
          Attachment HDFS-941-1.patch [ 12438934 ]
          Todd Lipcon made changes -
          Link This issue relates to HDFS-380 [ HDFS-380 ]
          Todd Lipcon made changes -
          Field Original Value New Value
          Link This issue is blocked by HDFS-1001 [ HDFS-1001 ]
          Todd Lipcon created issue -

            People

            • Assignee:
              bc Wong
              Reporter:
              Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              38 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development