Hadoop Common
  1. Hadoop Common
  2. HADOOP-7030

Add TableMapping topology implementation to read host to rack mapping from a file

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.1, 0.20.2, 0.21.0
    • Fix Version/s: 2.0.0-alpha
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      The default ScriptBasedMapping implementation of DNSToSwitchMapping for determining cluster topology has some drawbacks. Principally, it forks to an OS-specific script.

      This issue proposes two new Java implementations of DNSToSwitchMapping. TableMapping reads a two column text file that maps an IP or hostname to a rack ID. Ip4RangeMapping reads a three column text file where each line represents a start and end IP range plus a rack ID.

      1. topology.patch
        22 kB
        Patrick Angeles
      2. HADOOP-7030.patch
        23 kB
        Patrick Angeles
      3. HADOOP-7030-2.patch
        29 kB
        Patrick Angeles
      4. HADOOP-7030.patch
        12 kB
        Tom White
      5. HADOOP-7030.patch
        13 kB
        Tom White
      6. HADOOP-7030.patch
        13 kB
        Tom White
      7. HADOOP-7030-branch-1.patch
        11 kB
        Tom White

        Issue Links

          Activity

          Matt Foley made changes -
          Target Version/s 1.1.1, 0.23.3 [ 12321658, 12320059 ] 0.23.3, 1.2.0 [ 12320059, 12321659 ]
          Steve Loughran made changes -
          Link This issue is related to HADOOP-8631 [ HADOOP-8631 ]
          Steve Loughran made changes -
          Link This issue is related to HADOOP-8628 [ HADOOP-8628 ]
          Steve Loughran made changes -
          Link This issue is related to HADOOP-8629 [ HADOOP-8629 ]
          Jeff Hammerbacher made changes -
          Link This issue relates to HADOOP-7423 [ HADOOP-7423 ]
          Matt Foley made changes -
          Target Version/s 1.1.0, 0.23.3 [ 12316501, 12320059 ] 1.1.1, 0.23.3 [ 12321658, 12320059 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Steve Loughran made changes -
          Link This issue is related to HADOOP-8231 [ HADOOP-8231 ]
          Steve Loughran made changes -
          Link This issue is duplicated by HADOOP-8091 [ HADOOP-8091 ]
          Arun C Murthy made changes -
          Fix Version/s 2.0.0 [ 12320352 ]
          Fix Version/s 0.23.3 [ 12320059 ]
          Tom White made changes -
          Attachment HADOOP-7030-branch-1.patch [ 12519739 ]
          Tom White made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Target Version/s 0.23.3, 1.1.0 [ 12320059, 12316501 ] 1.1.0, 0.23.3 [ 12316501, 12320059 ]
          Fix Version/s 0.23.3 [ 12320059 ]
          Resolution Fixed [ 1 ]
          Tom White made changes -
          Summary new topology mapping implementations Add TableMapping topology implementation to read host to rack mapping from a file
          Target Version/s 0.23.3, 1.1.0 [ 12320059, 12316501 ] 1.1.0, 0.23.3 [ 12316501, 12320059 ]
          Tom White made changes -
          Attachment HADOOP-7030.patch [ 12519688 ]
          Tom White made changes -
          Attachment HADOOP-7030.patch [ 12519484 ]
          Tom White made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Target Version/s 1.1.0, 0.23.3 [ 12316501, 12320059 ]
          Tom White made changes -
          Assignee Patrick Angeles [ patrickangeles ] Tom White [ tomwhite ]
          Tom White made changes -
          Attachment HADOOP-7030.patch [ 12519336 ]
          Aaron T. Myers made changes -
          Link This issue is related to HADOOP-8091 [ HADOOP-8091 ]
          Tom White made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Assignee Patrick Angeles [ patrickangeles ]
          Patrick Angeles made changes -
          Attachment HADOOP-7030-2.patch [ 12469308 ]
          Patrick Angeles made changes -
          Attachment HADOOP-7030.patch [ 12459427 ]
          Patrick Angeles made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Patrick Angeles made changes -
          Field Original Value New Value
          Attachment topology.patch [ 12459424 ]
          Patrick Angeles created issue -

            People

            • Assignee:
              Tom White
              Reporter:
              Patrick Angeles
            • Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development