Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1463

Reducer should start faster for smaller jobs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • jobtracker
    • None

    Description

      Our users often complain about the slowness of smaller ad-hoc jobs.
      The overhead to wait for the reducers to start in this case is significant.
      It will be good if we can start the reducer sooner in this case.

      Attachments

        1. MAPREDUCE-1463-v3.patch
          3 kB
          Scott Chen
        2. MAPREDUCE-1463-v2.patch
          3 kB
          Scott Chen
        3. MAPREDUCE-1463-v1.patch
          2 kB
          Scott Chen

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-1184 mapred.reduce.slowstart.completed.maps is too low by default

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              schen Scott Chen
              schen Scott Chen
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated: