Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.205.0, 0.23.0
    • Fix Version/s: 0.20.205.0, 0.23.0
    • Component/s: None
    • Labels:
      None

      Description

      hadoop rpm config template by default sets the HADOOP_SECURE_DN_USER, HADOOP_SECURE_DN_LOG_DIR & HADOOP_SECURE_DN_PID_DIR
      the above values should only be set for secured deployment ;

      1. On secure datanodes, user to run the datanode as after dropping privileges
        export HADOOP_SECURE_DN_USER=$ {HADOOP_HDFS_USER}

        # Where log files are stored. $HADOOP_HOME/logs by default.
        export HADOOP_LOG_DIR=${HADOOP_LOG_DIR}/$USER

        # Where log files are stored in the secure data environment.
        export HADOOP_SECURE_DN_LOG_DIR=${HADOOP_LOG_DIR}/${HADOOP_HDFS_USER}
      1. The directory where pid files are stored. /tmp by default.
        export HADOOP_PID_DIR=$ {HADOOP_PID_DIR}
        export HADOOP_SECURE_DN_PID_DIR=${HADOOP_PID_DIR}
      1. HADOOP-7658-trunk.patch
        2 kB
        Eric Yang
      2. HADOOP-7658.patch
        1 kB
        Eric Yang

        Activity

        Hide
        mattf Matt Foley added a comment -

        Closed upon release of 0.20.205.0

        Show
        mattf Matt Foley added a comment - Closed upon release of 0.20.205.0
        Hide
        hudson Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #850 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/850/)
        HADOOP-7658. Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh
        (Eric Yang)

        eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178646
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Show
        hudson Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #850 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/850/ ) HADOOP-7658 . Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh (Eric Yang) eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178646 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Hide
        hudson Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #29 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/29/)
        HADOOP-7658. Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh
        (Eric Yang)

        eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178645
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh
        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Show
        hudson Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #29 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/29/ ) HADOOP-7658 . Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh (Eric Yang) eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178645 Files : /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Hide
        hudson Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #820 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/820/)
        HADOOP-7658. Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh
        (Eric Yang)

        eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178646
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Show
        hudson Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #820 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/820/ ) HADOOP-7658 . Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh (Eric Yang) eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178646 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Hide
        hudson Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Build #36 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/36/)
        HADOOP-7658. Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh
        (Eric Yang)

        eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178645
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh
        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Show
        hudson Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #36 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/36/ ) HADOOP-7658 . Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh (Eric Yang) eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178645 Files : /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Hide
        hudson Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #1025 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1025/)
        HADOOP-7658. Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh
        (Eric Yang)

        eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178646
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Show
        hudson Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1025 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1025/ ) HADOOP-7658 . Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh (Eric Yang) eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178646 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Hide
        hudson Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #1083 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1083/)
        HADOOP-7658. Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh
        (Eric Yang)

        eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178646
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Show
        hudson Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1083 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1083/ ) HADOOP-7658 . Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh (Eric Yang) eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178646 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Hide
        hudson Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #1005 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1005/)
        HADOOP-7658. Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh
        (Eric Yang)

        eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178646
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh
        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Show
        hudson Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1005 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1005/ ) HADOOP-7658 . Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh (Eric Yang) eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178646 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh
        Hide
        eyang Eric Yang added a comment -

        I just committed this to trunk and branch 0.23. Thanks Giri.

        Show
        eyang Eric Yang added a comment - I just committed this to trunk and branch 0.23. Thanks Giri.
        Hide
        gkesavan Giridharan Kesavan added a comment -

        committed to 205 branch.

        Show
        gkesavan Giridharan Kesavan added a comment - committed to 205 branch.
        Hide
        gkesavan Giridharan Kesavan added a comment -

        +1

        Show
        gkesavan Giridharan Kesavan added a comment - +1
        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12495182/HADOOP-7658-trunk.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/207//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/207//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12495182/HADOOP-7658-trunk.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/207//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/207//console This message is automatically generated.
        Hide
        eyang Eric Yang added a comment -

        Same patch for trunk.

        Show
        eyang Eric Yang added a comment - Same patch for trunk.
        Hide
        eyang Eric Yang added a comment -

        Unset HADOOP_SECURE_DN_USER from hadoop-env.sh for non-secure deployment.

        Show
        eyang Eric Yang added a comment - Unset HADOOP_SECURE_DN_USER from hadoop-env.sh for non-secure deployment.

          People

          • Assignee:
            eyang Eric Yang
            Reporter:
            gkesavan Giridharan Kesavan
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development