Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2734

DistCp with FairScheduler assign all map tasks in one TT

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Trivial Trivial
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: 2.3.0
    • Component/s: jobtracker
    • Labels:
      None

      Description

      1 Using FairScheduler.
      2 distcp a directory contains 5 files.

      The DistCp job will launch 5 map tasks, and FairScheduler assign them to one TaskTracker.
      It should be assigned different, like the original JobQueueScheduler.

        Activity

        Bochun Bai created issue -
        Bochun Bai made changes -
        Field Original Value New Value
        Priority Major [ 3 ] Trivial [ 5 ]
        Bochun Bai made changes -
        Assignee Bochun Bai [ sinofool ]
        Component/s jobtracker [ 12312907 ]
        Component/s distcp [ 12312902 ]
        Bochun Bai made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Release Note I can find this config is default to false in 2.3.0. It is fixed in YARN-302.
        Fix Version/s 2.3.0 [ 12325257 ]
        Resolution Fixed [ 1 ]
        Bochun Bai made changes -
        Release Note I can find this config is default to false in 2.3.0. It is fixed in YARN-302.

          People

          • Assignee:
            Bochun Bai
            Reporter:
            Bochun Bai
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development