Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4116

Missing POM dependency for hadoop-yarn-common

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Incomplete
    • Affects Version/s: 0.23.1, trunk
    • Fix Version/s: None
    • Component/s: build
    • Labels:
      None
    • Target Version/s:

      Description

      hadoop-yarn-common is missing dependency on hadoop-common. some things like Configured from it are used. This dependency should be added to POM

      1. yarn-pom.txt
        0.6 kB
        Radim Kolar

        Activity

        Hide
        Radim Kolar added a comment -

        This is problematic when building custom ResourceCalculatorPlugin which depends on yarn-common because class it is extending is in that module. Maven should pull dependencies automatically.

        [INFO] -------------------------------------------------------------
        [ERROR] COMPILATION ERROR :
        [INFO] -------------------------------------------------------------
        [ERROR] /usr/home/admin/repos/hadoop-freebsd/target/generated-sources/swg/FreeBSDResourceCalculator.java:[11,7] cannot access org.apache.hadoop.conf.Configured
        class file for org.apache.hadoop.conf.Configured not found
        public class FreeBSDResourceCalculator extends org.apache.hadoop.yarn.util.ResourceCalculatorPlugin {
        [ERROR] /usr/home/admin/repos/hadoop-freebsd/src/main/java/com/filez/hadoop/oldutil/FreeBSDResourceCalculator.java:[6,29] package org.apache.hadoop.util does not exist

        Show
        Radim Kolar added a comment - This is problematic when building custom ResourceCalculatorPlugin which depends on yarn-common because class it is extending is in that module. Maven should pull dependencies automatically. [INFO] ------------------------------------------------------------- [ERROR] COMPILATION ERROR : [INFO] ------------------------------------------------------------- [ERROR] /usr/home/admin/repos/hadoop-freebsd/target/generated-sources/swg/FreeBSDResourceCalculator.java: [11,7] cannot access org.apache.hadoop.conf.Configured class file for org.apache.hadoop.conf.Configured not found public class FreeBSDResourceCalculator extends org.apache.hadoop.yarn.util.ResourceCalculatorPlugin { [ERROR] /usr/home/admin/repos/hadoop-freebsd/src/main/java/com/filez/hadoop/oldutil/FreeBSDResourceCalculator.java: [6,29] package org.apache.hadoop.util does not exist
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12524850/yarn-pom.txt
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests:
        org.apache.hadoop.yarn.server.resourcemanager.security.TestApplicationTokens
        org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService
        org.apache.hadoop.yarn.server.resourcemanager.resourcetracker.TestNMExpiry
        org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization
        org.apache.hadoop.yarn.server.resourcemanager.TestApplicationACLs
        org.apache.hadoop.mapred.TestClientRedirect
        org.apache.hadoop.mapreduce.TestYarnClientProtocolProvider
        org.apache.hadoop.mapreduce.security.TestJHSSecurity

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2318//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2318//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12524850/yarn-pom.txt against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests: org.apache.hadoop.yarn.server.resourcemanager.security.TestApplicationTokens org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService org.apache.hadoop.yarn.server.resourcemanager.resourcetracker.TestNMExpiry org.apache.hadoop.yarn.server.resourcemanager.TestAMAuthorization org.apache.hadoop.yarn.server.resourcemanager.TestApplicationACLs org.apache.hadoop.mapred.TestClientRedirect org.apache.hadoop.mapreduce.TestYarnClientProtocolProvider org.apache.hadoop.mapreduce.security.TestJHSSecurity +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2318//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2318//console This message is automatically generated.
        Hide
        Radim Kolar added a comment -

        cuz this was not fixed for 7 months, i do not think that somebody cares. Is not that important for me to get it fixed, so i am closing it, reducing number of open tickets.

        Show
        Radim Kolar added a comment - cuz this was not fixed for 7 months, i do not think that somebody cares. Is not that important for me to get it fixed, so i am closing it, reducing number of open tickets.

          People

          • Assignee:
            Unassigned
            Reporter:
            Radim Kolar
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development