Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4502 Node-level aggregation with combining the result of maps
  3. MAPREDUCE-4865

Launching node-level combiner at the end stage of MapTask and ignoring aggregated inputs at ReduceTask

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • 3.0.0-alpha1
    • None
    • tasktracker
    • None

    Description

      MapTask needs to start node-level aggregation against local outputs at the end stage of MapTask after calling getAggregationTargets().

      This feature is implemented with Merger and CombinerRunner.

      Attachments

        Activity

          People

            ozawa Tsuyoshi Ozawa
            ozawa Tsuyoshi Ozawa
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated: