Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-5401

PerformanceEvaluation generates 10x the number of expected mappers

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 2.0.0
    • Component/s: test
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Changes how many tasks PE runs when clients are mapreduce. Now tasks == client count. Previous we hardcoded ten tasks per client instance.

      Description

      With a command line like 'hbase org.apache.hadoop.hbase.PerformanceEvaluation randomWrite 10' there are 100 mappers spawned, rather than the expected 10. The culprit appears to be the outer loop in writeInputFile which sets up 10 splits for every "asked-for client". I think the fix is just to remove that outer loop.

        Attachments

          Activity

            People

            • Assignee:
              easyliangjob Yi Liang
              Reporter:
              oliver@mineallmeyn.com Oliver Meyn
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: