Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-5401

PerformanceEvaluation generates 10x the number of expected mappers

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.0.0
    • 2.0.0
    • test
    • None
    • Incompatible change, Reviewed
    • Changes how many tasks PE runs when clients are mapreduce. Now tasks == client count. Previous we hardcoded ten tasks per client instance.

    Description

      With a command line like 'hbase org.apache.hadoop.hbase.PerformanceEvaluation randomWrite 10' there are 100 mappers spawned, rather than the expected 10. The culprit appears to be the outer loop in writeInputFile which sets up 10 splits for every "asked-for client". I think the fix is just to remove that outer loop.

      Attachments

        1. HBASE-5401-V1.patch
          3 kB
          Yi Liang

        Activity

          People

            easyliangjob Yi Liang
            oliver@mineallmeyn.com Oliver Meyn
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: