Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4660

Update task placement policy for NetworkTopology with 'NodeGroup' layer

        Details

        • Type: New Feature New Feature
        • Status: Closed
        • Priority: Major Major
        • Resolution: Fixed
        • Affects Version/s: None
        • Fix Version/s: 1.2.0
        • Component/s: jobtracker, mrv1, scheduler
        • Labels:
          None
        • Target Version/s:
        • Hadoop Flags:
          Reviewed
        1. Text File
          MAPREDUCE-4660.patch
          38 kB
          Junping Du
        2. Text File
          MAPREDUCE-4660-v2.patch
          50 kB
          Junping Du
        3. Text File
          MAPREDUCE-4660-v3.patch
          39 kB
          Junping Du

          Issue Links

          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-8820 Backport HADOOP-8469 and HADOOP-8470: add "NodeGroup" layer in new NetworkTopology (also known as NetworkTopologyWithNodeGroup)

          • Major - Major loss of function.
          • Closed
          Is contained by

          Sub-task - The sub-task of the issue HADOOP-8817 Backport Network Topology Extension for Virtualization (HADOOP-8468) to branch-1

          • Major - Major loss of function.
          • Closed

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            Junping Du added a comment -

            Update patch to address recent changes on branch-1 in v2 patch.

            Show
            Junping Du added a comment - Update patch to address recent changes on branch-1 in v2 patch.
            Hide
            Permalink
            Junping Du added a comment -

            As HDFS-3942 is checked in to branch-1, so remove some overlap code in v3 patch.

            Show
            Junping Du added a comment - As HDFS-3942 is checked in to branch-1, so remove some overlap code in v3 patch.
            Hide
            Permalink
            Junping Du added a comment -

            The test-patch result is as following: the patch doesn't involve new unit test failure and findbugs warnings.

            +1 @author. The patch does not contain any @author tags.

            +1 tests included. The patch appears to include 8 new or modified tests.

            +1 javadoc. The javadoc tool did not generate any warning messages.

            +1 javac. The applied patch does not increase the total number of javac compiler warnings.

            -1 findbugs. The patch appears to introduce 225 new Findbugs (version 2.0.1) warnings.

            Show
            Junping Du added a comment - The test-patch result is as following: the patch doesn't involve new unit test failure and findbugs warnings. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 8 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 findbugs. The patch appears to introduce 225 new Findbugs (version 2.0.1) warnings.
            Hide
            Permalink
            Luke Lu added a comment -

            v3 patch lgtm. The findbugs warnings didn't increase due to this patch. +1. Will commit within 24 hours if there is no further objection.

            Show
            Luke Lu added a comment - v3 patch lgtm. The findbugs warnings didn't increase due to this patch. +1. Will commit within 24 hours if there is no further objection.
            Hide
            Permalink
            Luke Lu added a comment -

            Committed (after whitespace cleanup) to branch-1. Thanks Junping!

            Show
            Luke Lu added a comment - Committed (after whitespace cleanup) to branch-1. Thanks Junping!
            Hide
            Permalink
            Junping Du added a comment -

            Thanks Luke! A very trivial bug related in MAPREDUCE-4904, would you help to review it?

            Show
            Junping Du added a comment - Thanks Luke! A very trivial bug related in MAPREDUCE-4904 , would you help to review it?
            Hide
            Permalink
            Matt Foley added a comment -

            Closed upon release of Hadoop 1.2.0.

            Show
            Matt Foley added a comment - Closed upon release of Hadoop 1.2.0.

              People

              • Assignee:
                Junping Du
                Reporter:
                Junping Du
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Development