Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4198

Update RackResolver and related tests to resolve host with new API from HADOOP-8304 (DNSToSwitchMapping should add interface to resolve individual host besides a list of host)

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: 1.0.0, 2.0.0-alpha
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      HADOOP-8304 (DNSToSwitchMapping should add interface to resolve individual host besides a list of host) will induce a new API to resolve individual host rather than a list of host. Here is update on MapReduce part to use new API.

      1. MAPREDUCE-4198-v2.patch
        4 kB
        Junping Du
      2. MAPREDUCE-4198.patch
        17 kB
        Junping Du

        Activity

        Junping Du created issue -
        Hide
        Junping Du added a comment -

        This code is separated from HADOOP-8304's original patch.

        Show
        Junping Du added a comment - This code is separated from HADOOP-8304 's original patch.
        Junping Du made changes -
        Field Original Value New Value
        Attachment MAPREDUCE-4198.patch [ 12524390 ]
        Junping Du made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Eli Collins made changes -
        Assignee Junping Du [ djp ]
        Hide
        Junping Du added a comment -

        Sorry. This code looks wrong. Let me check again.

        Show
        Junping Du added a comment - Sorry. This code looks wrong. Let me check again.
        Junping Du made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12524390/MAPREDUCE-4198.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 7 new or modified test files.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2312//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12524390/MAPREDUCE-4198.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 7 new or modified test files. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2312//console This message is automatically generated.
        Hide
        Junping Du added a comment -

        This is an update patch as previous one include whole changes with common

        Show
        Junping Du added a comment - This is an update patch as previous one include whole changes with common
        Junping Du made changes -
        Attachment MAPREDUCE-4198-v2.patch [ 12524391 ]
        Junping Du made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12524391/MAPREDUCE-4198-v2.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 2 new or modified test files.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        -1 javac. The patch appears to cause tar ant target to fail.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        -1 findbugs. The patch appears to cause Findbugs (version 1.3.9) to fail.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests:
        org.apache.hadoop.yarn.server.TestContainerManagerSecurity
        org.apache.hadoop.yarn.server.resourcemanager.security.TestApplicationTokens
        org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService
        org.apache.hadoop.yarn.server.resourcemanager.resourcetracker.TestNMExpiry
        org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization
        org.apache.hadoop.yarn.server.resourcemanager.TestApplicationACLs
        org.apache.hadoop.mapred.TestClientRedirect
        org.apache.hadoop.mapreduce.TestYarnClientProtocolProvider
        org.apache.hadoop.mapreduce.security.TestJHSSecurity

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2313//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2313//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12524391/MAPREDUCE-4198-v2.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 2 new or modified test files. +1 javadoc. The javadoc tool did not generate any warning messages. -1 javac. The patch appears to cause tar ant target to fail. +1 eclipse:eclipse. The patch built with eclipse:eclipse. -1 findbugs. The patch appears to cause Findbugs (version 1.3.9) to fail. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests: org.apache.hadoop.yarn.server.TestContainerManagerSecurity org.apache.hadoop.yarn.server.resourcemanager.security.TestApplicationTokens org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService org.apache.hadoop.yarn.server.resourcemanager.resourcetracker.TestNMExpiry org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization org.apache.hadoop.yarn.server.resourcemanager.TestApplicationACLs org.apache.hadoop.mapred.TestClientRedirect org.apache.hadoop.mapreduce.TestYarnClientProtocolProvider org.apache.hadoop.mapreduce.security.TestJHSSecurity +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2313//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2313//console This message is automatically generated.
        Hide
        Junping Du added a comment -

        This patch depends on new interface added in HADOOP-8304.

        Show
        Junping Du added a comment - This patch depends on new interface added in HADOOP-8304 .
        Hide
        Junping Du added a comment -

        From Hadoop-8304, the interfaces for resolving hosts is a tradeoff between convenient and compatible. Currently, our choice is to keep compatibility so close this issue as "Won't fix" now.

        Show
        Junping Du added a comment - From Hadoop-8304, the interfaces for resolving hosts is a tradeoff between convenient and compatible. Currently, our choice is to keep compatibility so close this issue as "Won't fix" now.
        Junping Du made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Won't Fix [ 2 ]

          People

          • Assignee:
            Junping Du
            Reporter:
            Junping Du
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development