Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-9896

Add an option to have strict number of mapper per job in HBase Streaming

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Minor
    • Resolution: Not A Problem
    • 0.89-fb
    • 0.89-fb
    • mapreduce
    • None

    Description

      Currently there is only one configuration knob available for controlling the number of mappers per job in HBase Streaming. The current option is number of mappers per region. This options tries to maintain the locality for the mapper and the region servers.

      However, in certain certain scenarios where the table has a higher number of regions, the number of mapper/region can lead to explosion of the number of mappers. Hence, we need one more option to control the strict number of mappers per job.

      Attachments

        Activity

          People

            Unassigned Unassigned
            rshroff Rishit Shroff
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: