Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2768

DFSIO write performance benchmark shows a regression

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.16.0
    • 0.16.0
    • None
    • None

    Description

      We are seeing a performance regression in DFSIO write benchmark, possibly due to Hadoop-1707.

      Here is the data:

      • Aggregate cluster throughput went from 0.30G to 0.14G with 39 concurrent clients, on 20 nodes
      • Aggregate cluster throughput went from 1.15G to 0.85G with 39 concurrent clients, on 100 nodes

      Attachments

        1. perf.patch
          2 kB
          Dhruba Borthakur
        2. perf.patch
          1 kB
          Dhruba Borthakur
        3. perf1.patch
          3 kB
          Dhruba Borthakur
        4. perf2.patch
          3 kB
          Dhruba Borthakur

        Activity

          People

            dhruba Dhruba Borthakur
            mukundm Mukund Madhugiri
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: