Hadoop Common
  1. Hadoop Common
  2. HADOOP-7626

Allow overwrite of HADOOP_CLASSPATH and HADOOP_OPTS

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.205.0
    • Fix Version/s: 0.20.205.0, 0.23.0
    • Component/s: scripts
    • Labels:
      None
    • Environment:

      Java, Linux

      Description

      Quote email from Ashutosh Chauhan:

      There is a bug in hadoop-env.sh which prevents hcatalog server to start in secure settings. Instead of adding classpath, it overrides them. I was not able to verify where the bug belongs to, in HMS or in hadoop scripts. Looks like hadoop-env.sh is generated from hadoop-env.sh.template in installation process by HMS. Hand crafted patch follows:

      - export HADOOP_CLASSPATH=$f

      +export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:$f

      -export HADOOP_OPTS="-Djava.net.preferIPv4Stack=true "

      +export HADOOP_OPTS="${HADOOP_OPTS} -Djava.net.preferIPv4Stack=true "

      1. HADOOP-7626-trunk.patch
        1 kB
        Eric Yang
      2. HADOOP-7626.patch
        1.0 kB
        Eric Yang

        Activity

        Hide
        Matt Foley added a comment -

        Closed upon release of 0.20.205.0

        Show
        Matt Foley added a comment - Closed upon release of 0.20.205.0
        Hide
        Matt Foley added a comment -

        Devaraj also committed to branch-0.20-security-205, as:

        r1170043 | ddas | 2011-09-12 22:17:09 -0700 (Mon, 12 Sep 2011) | 1 line

        Merge -r 1170041:1170042 from branch-0.20-security onto branch-0.20-security-205

        Show
        Matt Foley added a comment - Devaraj also committed to branch-0.20-security-205, as: r1170043 | ddas | 2011-09-12 22:17:09 -0700 (Mon, 12 Sep 2011) | 1 line Merge -r 1170041:1170042 from branch-0.20-security onto branch-0.20-security-205
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #792 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/792/)
        HADOOP-7626. Bugfix for a config generator. Contributed by Eric Yang.

        ddas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1170046
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #792 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/792/ ) HADOOP-7626 . Bugfix for a config generator. Contributed by Eric Yang. ddas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1170046 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #822 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/822/)
        HADOOP-7626. Bugfix for a config generator. Contributed by Eric Yang.

        ddas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1170046
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #822 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/822/ ) HADOOP-7626 . Bugfix for a config generator. Contributed by Eric Yang. ddas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1170046 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #891 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/891/)
        HADOOP-7626. Bugfix for a config generator. Contributed by Eric Yang.

        ddas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1170046
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #891 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/891/ ) HADOOP-7626 . Bugfix for a config generator. Contributed by Eric Yang. ddas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1170046 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #956 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/956/)
        HADOOP-7626. Bugfix for a config generator. Contributed by Eric Yang.

        ddas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1170046
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #956 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/956/ ) HADOOP-7626 . Bugfix for a config generator. Contributed by Eric Yang. ddas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1170046 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #879 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/879/)
        HADOOP-7626. Bugfix for a config generator. Contributed by Eric Yang.

        ddas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1170046
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #879 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/879/ ) HADOOP-7626 . Bugfix for a config generator. Contributed by Eric Yang. ddas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1170046 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Hide
        Devaraj Das added a comment -

        I committed this. Thanks, Eric!

        Show
        Devaraj Das added a comment - I committed this. Thanks, Eric!
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12494180/HADOOP-7626-trunk.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        -1 release audit. The applied patch generated 9 release audit warnings (more than the trunk's current 0 warnings).

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/169//testReport/
        Release audit warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/169//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt
        Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/169//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12494180/HADOOP-7626-trunk.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. -1 release audit. The applied patch generated 9 release audit warnings (more than the trunk's current 0 warnings). +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/169//testReport/ Release audit warnings: https://builds.apache.org/job/PreCommit-HADOOP-Build/169//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/169//console This message is automatically generated.
        Hide
        Eric Yang added a comment -

        Same patch for trunk.

        Show
        Eric Yang added a comment - Same patch for trunk.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12494137/HADOOP-7626.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/165//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12494137/HADOOP-7626.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/165//console This message is automatically generated.
        Hide
        Eric Yang added a comment -

        Fixed accidental environment shell variable expansion.

        Show
        Eric Yang added a comment - Fixed accidental environment shell variable expansion.

          People

          • Assignee:
            Eric Yang
            Reporter:
            Eric Yang
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development