Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-8468 Umbrella of enhancements to support different failure and locality topologies
  3. HADOOP-12283

CLONE - Backport Network Topology Extension for Virtualization (HADOOP-8468) to branch-1

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.2.0
    • Component/s: ha, io
    • Labels:
    • Target Version/s:
    • Release Note:
      A new 4-layer network topology NetworkToplogyWithNodeGroup is available to make Hadoop more robust and efficient in virtualized environment.

      Description

      HADOOP-8468 propose network topology changes for running on virtualized infrastructure, which includes:
      1. Add "NodeGroup" layer in new NetworkTopology (also known as NetworkTopologyWithNodeGroup): HADOOP-8469, HADOOP-8470
      2. Update Replica Placement/Removal Policy to reflect new topology layer: HDFS-3498, HDFS-3601
      3. Update balancer policy:HDFS-3495
      4. Update Task Scheduling Policy to reflect new topology layer and support the case that compute nodes (NodeManager or TaskTracker) and data nodes are separated into different VMs, but still benefit from physical host locality: YARN-18, YARN-19.
      This JIRA will address the backport work on branch-1 which will be divided into 4 issues/patches in related jira issues.

        Attachments

        1. HADOOP-8817.patch
          156 kB
          RacingDawn
        2. HADOOP-8817-v4.patch
          170 kB
          RacingDawn
        3. HADOOP-8817-v3.patch
          172 kB
          RacingDawn
        4. HADOOP-8817-v2.patch
          172 kB
          RacingDawn

        Issue Links

          Activity

          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment