Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-6599

2.4 addBlock is 10 to 20 times slower compared to 0.23

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.3.0, 2.4.0
    • Fix Version/s: 2.5.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      From one of our busiest 0.23 clusters:

      "AddBlockAvgTime" : 0.9514711501719515
      "CreateAvgTime" : 1.7564162389174
      "CompleteAvgTime" : 1.3310406035056548
      "BlockReceivedAndDeletedAvgTime" : 0.661210005151392

      From a not-so-busy 2.4 cluster:

      "AddBlockAvgTime" : 10.083333333333334
      "CreateAvgTime" : 1.0
      "CompleteAvgTime" : 1.1111111111111112
      "BlockReceivedAndDeletedAvgTime" : 0.07692307692307694

      When the 2.4 cluster gets a moderate amount of write requests, the latency is terrible. E.g. addBlock goes upward of 60ms.

      1. HDFS-6599.patch
        20 kB
        Daryn Sharp

        Issue Links

          Activity

          Kihwal Lee created issue -
          Kihwal Lee made changes -
          Field Original Value New Value
          Affects Version/s 2.3.0 [ 12325255 ]
          Kihwal Lee made changes -
          Link This issue is broken by HDFS-5837 [ HDFS-5837 ]
          Daryn Sharp made changes -
          Assignee Daryn Sharp [ daryn ]
          Kihwal Lee made changes -
          Priority Critical [ 2 ] Blocker [ 1 ]
          Daryn Sharp made changes -
          Attachment HDFS-6599.patch [ 12654372 ]
          Daryn Sharp made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Daryn Sharp made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 3.0.0 [ 12320356 ]
          Fix Version/s 2.5.0 [ 12326264 ]
          Resolution Fixed [ 1 ]
          Karthik Kambatla (Inactive) made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Allen Wittenauer made changes -
          Fix Version/s 3.0.0 [ 12320356 ]

            People

            • Assignee:
              Daryn Sharp
              Reporter:
              Kihwal Lee
            • Votes:
              0 Vote for this issue
              Watchers:
              22 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development