Uploaded image for project: 'Apache Blur'
  1. Apache Blur
  2. BLUR-90

Allow for more reducers in the BlurOutputFormat than shards in the table.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      Due to the hashing of the row id in the indexing process, the number of indexers can match the shard count or be a multiple of the shard count. For example if the number of shards in a table is 100 then then number of reducers can be multiples of 100 (100, 200, 300, 400, etc). This task is to build into the BlurOutputFormat the reducer multiplier.

      Attachments

        Activity

          People

            Unassigned Unassigned
            amccurry Aaron McCurry
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: