Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10787

Rename/remove non-HADOOP_*, etc from the shell scripts

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 3.0.0-alpha1
    • Component/s: scripts
    • Labels:
    • Target Version/s:
    • Hadoop Flags:
      Incompatible change
    • Release Note:
      Hide
      <!-- markdown -->
      The following shell environment variables have been deprecated:

      | Old | New |
      |:---- |:---- |
      | DEFAULT\_LIBEXEC\_DIR | HADOOP\_DEFAULT\_LIBEXEC\_DIR |
      | SLAVE\_NAMES | HADOOP\_SLAVE\_NAMES |
      | TOOL\_PATH | HADOOP\_TOOLS\_PATH |

      In addition:

      * DEFAULT\_LIBEXEC\_DIR will NOT be automatically transitioned to HADOOP\_DEFAULT\_LIBEXEC\_DIR and will require changes to any scripts setting that value. A warning will be printed to the screen if DEFAULT\_LIBEXEC\_DIR has been configured.
      * HADOOP\_TOOLS\_PATH is now properly handled as a multi-valued, Java classpath-style variable. Prior, multiple values assigned to TOOL\_PATH would not work a predictable manner.
      Show
      <!-- markdown --> The following shell environment variables have been deprecated: | Old | New | |:---- |:---- | | DEFAULT\_LIBEXEC\_DIR | HADOOP\_DEFAULT\_LIBEXEC\_DIR | | SLAVE\_NAMES | HADOOP\_SLAVE\_NAMES | | TOOL\_PATH | HADOOP\_TOOLS\_PATH | In addition: * DEFAULT\_LIBEXEC\_DIR will NOT be automatically transitioned to HADOOP\_DEFAULT\_LIBEXEC\_DIR and will require changes to any scripts setting that value. A warning will be printed to the screen if DEFAULT\_LIBEXEC\_DIR has been configured. * HADOOP\_TOOLS\_PATH is now properly handled as a multi-valued, Java classpath-style variable. Prior, multiple values assigned to TOOL\_PATH would not work a predictable manner.

      Description

      We should make an effort to clean up the shell env var name space by removing unsafe variables. See comments for list.

      1. HADOOP-10787.00.patch
        32 kB
        Allen Wittenauer
      2. HADOOP-10787.01.patch
        35 kB
        Allen Wittenauer
      3. HADOOP-10787.02.patch
        37 kB
        Allen Wittenauer
      4. HADOOP-10787.03.patch
        39 kB
        Allen Wittenauer
      5. HADOOP-10787.04.patch
        39 kB
        Allen Wittenauer
      6. HADOOP-10787.05.patch
        41 kB
        Allen Wittenauer

        Issue Links

          Activity

          Hide
          aw Allen Wittenauer added a comment -

          This should be done after HADOOP-9902.

          Show
          aw Allen Wittenauer added a comment - This should be done after HADOOP-9902 .
          Hide
          aw Allen Wittenauer added a comment -

          List:

          • DEFAULT_LIBEXEC_DIR
          • TOOL_PATH
          • JAVA_HEAP_MAX (handled by HADOOP-10950)
          • SLAVE_NAMES? (just need to be made local?)
          • SLAVE_FILE? (just need to be made local?)

          Not to be removed:

          • HADOOP_*
          • YARN_*
          • MAPRED_*

          Non-Hadoop vars intentionally set/used:

          • JAVA_HOME
          • PDSH_SSH_ARGS_APPEND
          • LD_LIBRARY_PATH (for people who don't know how to use ld -R...)
          • JAVA_LIBRARY_PATH (ditto)
          • MALLOC_ARENA_MAX
          • EUID
          • JAVA (although maybe this should get changed to HADOOP_JAVA?)
          • JSVC_HOME
          • CLASSPATH
          • BASH_VERSINFO

          NOTE: list currently ignores the craziness that is httpfs, kms, etc.

          Show
          aw Allen Wittenauer added a comment - List: DEFAULT_LIBEXEC_DIR TOOL_PATH JAVA_HEAP_MAX (handled by HADOOP-10950 ) SLAVE_NAMES? (just need to be made local?) SLAVE_FILE? (just need to be made local?) Not to be removed: HADOOP_* YARN_* MAPRED_* Non-Hadoop vars intentionally set/used: JAVA_HOME PDSH_SSH_ARGS_APPEND LD_LIBRARY_PATH (for people who don't know how to use ld -R...) JAVA_LIBRARY_PATH (ditto) MALLOC_ARENA_MAX EUID JAVA (although maybe this should get changed to HADOOP_JAVA?) JSVC_HOME CLASSPATH BASH_VERSINFO NOTE: list currently ignores the craziness that is httpfs, kms, etc.
          Hide
          aw Allen Wittenauer added a comment -

          Now that everything has been converted to use the new framework, it's probably time to start work on this one...

          Show
          aw Allen Wittenauer added a comment - Now that everything has been converted to use the new framework, it's probably time to start work on this one...
          Hide
          aw Allen Wittenauer added a comment -

          Making this a blocker for 3.x, otherwise we'll be stuck with these for a very long time.

          Show
          aw Allen Wittenauer added a comment - Making this a blocker for 3.x, otherwise we'll be stuck with these for a very long time.
          Hide
          aw Allen Wittenauer added a comment -

          -00:

          • converted vars
          Show
          aw Allen Wittenauer added a comment - -00: converted vars
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 14m 59s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 javac 7m 36s There were no new javac warning messages.
          +1 javadoc 9m 35s There were no new javadoc warning messages.
          +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings.
          +1 shellcheck 0m 5s There were no new shellcheck (v0.3.3) issues.
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 20s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          +1 common tests 22m 25s Tests passed in hadoop-common.
          +1 common tests 1m 40s Tests passed in hadoop-kms.
          +1 tools/hadoop tests 0m 52s Tests passed in hadoop-sls.
          -1 hdfs tests 161m 4s Tests failed in hadoop-hdfs.
          +1 hdfs tests 3m 37s Tests passed in hadoop-hdfs-httpfs.
              224m 16s  



          Reason Tests
          Failed unit tests hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
            hadoop.hdfs.TestDistributedFileSystem



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12746261/HADOOP-10787.00.patch
          Optional Tests javadoc javac unit shellcheck
          git revision trunk / df1e8ce
          hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7307/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-kms test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7307/artifact/patchprocess/testrun_hadoop-kms.txt
          hadoop-sls test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7307/artifact/patchprocess/testrun_hadoop-sls.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7307/artifact/patchprocess/testrun_hadoop-hdfs.txt
          hadoop-hdfs-httpfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7307/artifact/patchprocess/testrun_hadoop-hdfs-httpfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7307/testReport/
          Java 1.7.0_55
          uname Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7307/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 14m 59s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 7m 36s There were no new javac warning messages. +1 javadoc 9m 35s There were no new javadoc warning messages. +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings. +1 shellcheck 0m 5s There were no new shellcheck (v0.3.3) issues. +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 20s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 common tests 22m 25s Tests passed in hadoop-common. +1 common tests 1m 40s Tests passed in hadoop-kms. +1 tools/hadoop tests 0m 52s Tests passed in hadoop-sls. -1 hdfs tests 161m 4s Tests failed in hadoop-hdfs. +1 hdfs tests 3m 37s Tests passed in hadoop-hdfs-httpfs.     224m 16s   Reason Tests Failed unit tests hadoop.hdfs.server.namenode.ha.TestStandbyIsHot   hadoop.hdfs.TestDistributedFileSystem Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12746261/HADOOP-10787.00.patch Optional Tests javadoc javac unit shellcheck git revision trunk / df1e8ce hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7307/artifact/patchprocess/testrun_hadoop-common.txt hadoop-kms test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7307/artifact/patchprocess/testrun_hadoop-kms.txt hadoop-sls test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7307/artifact/patchprocess/testrun_hadoop-sls.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7307/artifact/patchprocess/testrun_hadoop-hdfs.txt hadoop-hdfs-httpfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7307/artifact/patchprocess/testrun_hadoop-hdfs-httpfs.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7307/testReport/ Java 1.7.0_55 uname Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7307/console This message was automatically generated.
          Hide
          aw Allen Wittenauer added a comment -

          TOOL_PATH/HADOOP_TOOL_PATH is really treated like a DIR not a PATH. Should either rename that or actually make it work like a path.

          Show
          aw Allen Wittenauer added a comment - TOOL_PATH/HADOOP_TOOL_PATH is really treated like a DIR not a PATH. Should either rename that or actually make it work like a path.
          Hide
          aw Allen Wittenauer added a comment -

          -01:

          • turns HADOOP_TOOLS_PATH into an actual class path-type structure
          • add a function and a unit test to handle HADOOP_TOOLS_PATH
          Show
          aw Allen Wittenauer added a comment - -01: turns HADOOP_TOOLS_PATH into an actual class path-type structure add a function and a unit test to handle HADOOP_TOOLS_PATH
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 15m 31s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
          +1 javac 7m 59s There were no new javac warning messages.
          +1 javadoc 10m 13s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          -1 shellcheck 0m 5s The applied patch generated 1 new shellcheck (v0.3.3) issues (total was 20, now 21).
          +1 whitespace 0m 2s The patch has no lines that end in whitespace.
          +1 install 1m 31s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          -1 common tests 22m 41s Tests failed in hadoop-common.
          +1 common tests 1m 40s Tests passed in hadoop-kms.
          +1 tools/hadoop tests 1m 2s Tests passed in hadoop-sls.
          -1 hdfs tests 163m 13s Tests failed in hadoop-hdfs.
          +1 hdfs tests 3m 38s Tests passed in hadoop-hdfs-httpfs.
              228m 38s  



          Reason Tests
          Failed unit tests hadoop.ha.TestZKFailoverController
            hadoop.hdfs.server.blockmanagement.TestBlockManager
            hadoop.hdfs.server.namenode.TestLargeDirectoryDelete



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12753866/HADOOP-10787.01.patch
          Optional Tests javadoc javac unit shellcheck
          git revision trunk / d31a41c
          shellcheck https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/artifact/patchprocess/diffpatchshellcheck.txt
          hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-kms test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/artifact/patchprocess/testrun_hadoop-kms.txt
          hadoop-sls test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/artifact/patchprocess/testrun_hadoop-sls.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/artifact/patchprocess/testrun_hadoop-hdfs.txt
          hadoop-hdfs-httpfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/artifact/patchprocess/testrun_hadoop-hdfs-httpfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/testReport/
          Java 1.7.0_55
          uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 15m 31s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 7m 59s There were no new javac warning messages. +1 javadoc 10m 13s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. -1 shellcheck 0m 5s The applied patch generated 1 new shellcheck (v0.3.3) issues (total was 20, now 21). +1 whitespace 0m 2s The patch has no lines that end in whitespace. +1 install 1m 31s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. -1 common tests 22m 41s Tests failed in hadoop-common. +1 common tests 1m 40s Tests passed in hadoop-kms. +1 tools/hadoop tests 1m 2s Tests passed in hadoop-sls. -1 hdfs tests 163m 13s Tests failed in hadoop-hdfs. +1 hdfs tests 3m 38s Tests passed in hadoop-hdfs-httpfs.     228m 38s   Reason Tests Failed unit tests hadoop.ha.TestZKFailoverController   hadoop.hdfs.server.blockmanagement.TestBlockManager   hadoop.hdfs.server.namenode.TestLargeDirectoryDelete Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12753866/HADOOP-10787.01.patch Optional Tests javadoc javac unit shellcheck git revision trunk / d31a41c shellcheck https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/artifact/patchprocess/diffpatchshellcheck.txt hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/artifact/patchprocess/testrun_hadoop-common.txt hadoop-kms test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/artifact/patchprocess/testrun_hadoop-kms.txt hadoop-sls test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/artifact/patchprocess/testrun_hadoop-sls.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/artifact/patchprocess/testrun_hadoop-hdfs.txt hadoop-hdfs-httpfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/artifact/patchprocess/testrun_hadoop-hdfs-httpfs.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/testReport/ Java 1.7.0_55 uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7581/console This message was automatically generated.
          Hide
          aw Allen Wittenauer added a comment -

          -02:

          • fix the shellcheck errors
          Show
          aw Allen Wittenauer added a comment - -02: fix the shellcheck errors
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 15m 43s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
          +1 javac 8m 3s There were no new javac warning messages.
          +1 javadoc 10m 2s There were no new javadoc warning messages.
          +1 release audit 0m 25s The applied patch does not increase the total number of release audit warnings.
          +1 shellcheck 0m 6s There were no new shellcheck (v0.3.3) issues.
          +1 whitespace 0m 2s The patch has no lines that end in whitespace.
          +1 install 1m 31s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 common tests 22m 46s Tests passed in hadoop-common.
          +1 common tests 1m 38s Tests passed in hadoop-kms.
          +1 tools/hadoop tests 0m 54s Tests passed in hadoop-sls.
          -1 hdfs tests 163m 39s Tests failed in hadoop-hdfs.
          +1 hdfs tests 3m 38s Tests passed in hadoop-hdfs-httpfs.
              229m 5s  



          Reason Tests
          Failed unit tests hadoop.hdfs.server.blockmanagement.TestBlockManager
            hadoop.hdfs.web.TestWebHDFSOAuth2



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12753916/HADOOP-10787.02.patch
          Optional Tests javadoc javac unit shellcheck
          git revision trunk / 09c64ba
          hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7584/artifact/patchprocess/testrun_hadoop-common.txt
          hadoop-kms test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7584/artifact/patchprocess/testrun_hadoop-kms.txt
          hadoop-sls test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7584/artifact/patchprocess/testrun_hadoop-sls.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7584/artifact/patchprocess/testrun_hadoop-hdfs.txt
          hadoop-hdfs-httpfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7584/artifact/patchprocess/testrun_hadoop-hdfs-httpfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7584/testReport/
          Java 1.7.0_55
          uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7584/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 15m 43s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 8m 3s There were no new javac warning messages. +1 javadoc 10m 2s There were no new javadoc warning messages. +1 release audit 0m 25s The applied patch does not increase the total number of release audit warnings. +1 shellcheck 0m 6s There were no new shellcheck (v0.3.3) issues. +1 whitespace 0m 2s The patch has no lines that end in whitespace. +1 install 1m 31s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 common tests 22m 46s Tests passed in hadoop-common. +1 common tests 1m 38s Tests passed in hadoop-kms. +1 tools/hadoop tests 0m 54s Tests passed in hadoop-sls. -1 hdfs tests 163m 39s Tests failed in hadoop-hdfs. +1 hdfs tests 3m 38s Tests passed in hadoop-hdfs-httpfs.     229m 5s   Reason Tests Failed unit tests hadoop.hdfs.server.blockmanagement.TestBlockManager   hadoop.hdfs.web.TestWebHDFSOAuth2 Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12753916/HADOOP-10787.02.patch Optional Tests javadoc javac unit shellcheck git revision trunk / 09c64ba hadoop-common test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7584/artifact/patchprocess/testrun_hadoop-common.txt hadoop-kms test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7584/artifact/patchprocess/testrun_hadoop-kms.txt hadoop-sls test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7584/artifact/patchprocess/testrun_hadoop-sls.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7584/artifact/patchprocess/testrun_hadoop-hdfs.txt hadoop-hdfs-httpfs test log https://builds.apache.org/job/PreCommit-HADOOP-Build/7584/artifact/patchprocess/testrun_hadoop-hdfs-httpfs.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7584/testReport/ Java 1.7.0_55 uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7584/console This message was automatically generated.
          Hide
          vvasudev Varun Vasudev added a comment -

          Thank for the patches Allen Wittenauer. The latest patch doesn't apply to trunk. Can you please take a look?

          Also, mapred still has a reference to TOOL_PATH

            archive-logs)
              CLASS=org.apache.hadoop.tools.HadoopArchiveLogs
              hadoop_debug "Injecting TOOL_PATH into CLASSPATH"
              hadoop_add_classpath "${TOOL_PATH}"
              hadoop_debug "Appending HADOOP_CLIENT_OPTS onto HADOOP_OPTS"
              HADOOP_OPTS="${HADOOP_OPTS} ${HADOOP_CLIENT_OPTS}"
          
          Show
          vvasudev Varun Vasudev added a comment - Thank for the patches Allen Wittenauer . The latest patch doesn't apply to trunk. Can you please take a look? Also, mapred still has a reference to TOOL_PATH archive-logs) CLASS=org.apache.hadoop.tools.HadoopArchiveLogs hadoop_debug "Injecting TOOL_PATH into CLASSPATH" hadoop_add_classpath "${TOOL_PATH}" hadoop_debug "Appending HADOOP_CLIENT_OPTS onto HADOOP_OPTS" HADOOP_OPTS= "${HADOOP_OPTS} ${HADOOP_CLIENT_OPTS}"
          Hide
          aw Allen Wittenauer added a comment -

          -03:

          • rebase
          • fix some new tool path bits that were added since last patch creation
          Show
          aw Allen Wittenauer added a comment - -03: rebase fix some new tool path bits that were added since last patch creation
          Hide
          aw Allen Wittenauer added a comment -

          Thanks for the review. This should fix the issues you discovered.

          Show
          aw Allen Wittenauer added a comment - Thanks for the review. This should fix the issues you discovered.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 8s docker + precommit patch detected.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 shellcheck 0m 9s There were no new shellcheck issues.
          +1 whitespace 0m 0s Patch has no whitespace issues.
          -1 unit 1m 51s hadoop-common in the patch failed with JDK v1.8.0_60.
          +1 unit 0m 14s hadoop-kms in the patch passed with JDK v1.8.0_60.
          +1 unit 0m 43s hadoop-hdfs in the patch passed with JDK v1.8.0_60.
          +1 unit 0m 15s hadoop-hdfs-httpfs in the patch passed with JDK v1.8.0_60.
          +1 unit 0m 59s hadoop-yarn in the patch passed with JDK v1.8.0_60.
          +1 unit 2m 40s hadoop-mapreduce-project in the patch passed with JDK v1.8.0_60.
          +1 unit 0m 18s hadoop-sls in the patch passed with JDK v1.8.0_60.
          -1 unit 1m 39s hadoop-common in the patch failed with JDK v1.7.0_79.
          +1 unit 0m 13s hadoop-kms in the patch passed with JDK v1.7.0_79.
          +1 unit 0m 34s hadoop-hdfs in the patch passed with JDK v1.7.0_79.
          +1 unit 0m 14s hadoop-hdfs-httpfs in the patch passed with JDK v1.7.0_79.
          +1 unit 0m 51s hadoop-yarn in the patch passed with JDK v1.7.0_79.
          +1 unit 2m 32s hadoop-mapreduce-project in the patch passed with JDK v1.7.0_79.
          +1 unit 0m 13s hadoop-sls in the patch passed with JDK v1.7.0_79.
          +1 asflicense 0m 23s Patch does not generate ASF License warnings.
          14m 4s



          Reason Tests
          JDK v1.7.0_79 Failed TAP tests hadoop_add_to_classpath_toolspath.bats.tap
            hadoop_add_to_classpath_toolspath.bats.tap



          Subsystem Report/Notes
          Docker Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-10-27
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12769070/HADOOP-10787.03.patch
          JIRA Issue HADOOP-10787
          Optional Tests asflicense unit shellcheck
          uname Linux af46df5af291 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HADOOP-Build@2/patchprocess/apache-yetus-2392ab4/dev-support/personality/hadoop.sh
          git revision trunk / 68ce93c
          Default Java 1.7.0_79
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79
          shellcheck v0.4.1
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.8.0_60.txt
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.7.0_79.txt
          unit test logs https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.8.0_60.txt https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.7.0_79.txt
          JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/testReport/
          TAP logs https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/artifact/patchprocess/patch-hadoop-common-project_hadoop-common-jdk1.8.0_60.tap https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/artifact/patchprocess/patch-hadoop-common-project_hadoop-common-jdk1.7.0_79.tap
          modules C: hadoop-common-project/hadoop-common hadoop-common-project/hadoop-kms hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-mapreduce-project hadoop-tools/hadoop-sls hadoop-yarn-project/hadoop-yarn U: .
          Max memory used 88MB
          Powered by Apache Yetus http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 8s docker + precommit patch detected. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 shellcheck 0m 9s There were no new shellcheck issues. +1 whitespace 0m 0s Patch has no whitespace issues. -1 unit 1m 51s hadoop-common in the patch failed with JDK v1.8.0_60. +1 unit 0m 14s hadoop-kms in the patch passed with JDK v1.8.0_60. +1 unit 0m 43s hadoop-hdfs in the patch passed with JDK v1.8.0_60. +1 unit 0m 15s hadoop-hdfs-httpfs in the patch passed with JDK v1.8.0_60. +1 unit 0m 59s hadoop-yarn in the patch passed with JDK v1.8.0_60. +1 unit 2m 40s hadoop-mapreduce-project in the patch passed with JDK v1.8.0_60. +1 unit 0m 18s hadoop-sls in the patch passed with JDK v1.8.0_60. -1 unit 1m 39s hadoop-common in the patch failed with JDK v1.7.0_79. +1 unit 0m 13s hadoop-kms in the patch passed with JDK v1.7.0_79. +1 unit 0m 34s hadoop-hdfs in the patch passed with JDK v1.7.0_79. +1 unit 0m 14s hadoop-hdfs-httpfs in the patch passed with JDK v1.7.0_79. +1 unit 0m 51s hadoop-yarn in the patch passed with JDK v1.7.0_79. +1 unit 2m 32s hadoop-mapreduce-project in the patch passed with JDK v1.7.0_79. +1 unit 0m 13s hadoop-sls in the patch passed with JDK v1.7.0_79. +1 asflicense 0m 23s Patch does not generate ASF License warnings. 14m 4s Reason Tests JDK v1.7.0_79 Failed TAP tests hadoop_add_to_classpath_toolspath.bats.tap   hadoop_add_to_classpath_toolspath.bats.tap Subsystem Report/Notes Docker Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-10-27 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12769070/HADOOP-10787.03.patch JIRA Issue HADOOP-10787 Optional Tests asflicense unit shellcheck uname Linux af46df5af291 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HADOOP-Build@2/patchprocess/apache-yetus-2392ab4/dev-support/personality/hadoop.sh git revision trunk / 68ce93c Default Java 1.7.0_79 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79 shellcheck v0.4.1 unit https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.8.0_60.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.7.0_79.txt unit test logs https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.8.0_60.txt https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.7.0_79.txt JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/testReport/ TAP logs https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/artifact/patchprocess/patch-hadoop-common-project_hadoop-common-jdk1.8.0_60.tap https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/artifact/patchprocess/patch-hadoop-common-project_hadoop-common-jdk1.7.0_79.tap modules C: hadoop-common-project/hadoop-common hadoop-common-project/hadoop-kms hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-mapreduce-project hadoop-tools/hadoop-sls hadoop-yarn-project/hadoop-yarn U: . Max memory used 88MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7954/console This message was automatically generated.
          Hide
          vvasudev Varun Vasudev added a comment -

          Allen Wittenauer - any idea what's happening with the failing test?

          I tried to run it on my machine and here's what I get(all these runs were with the patch applied) -
          1) On my mac

               [exec] 1..3
               [exec] not ok 1 hadoop_add_common_to_classpath (negative)
               [exec] # (from function `freetheclasses' in file hadoop_add_common_to_classpath.bats, line 27,
               [exec] #  in test file hadoop_add_common_to_classpath.bats, line 45)
               [exec] #   `freetheclasses' failed
               [exec] # bindir: /Users/vvasudev/Workspace/apache/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # /var/folders/n1/klkrb91135d8s9xl7m4gcsgw0000gp/T/bats.39050.src: line 27: unset: `/Users/vvasudev/Workspace/current-hadoop': not a valid identifier
               [exec] not ok 2 hadoop_add_common_to_classpath (positive)
               [exec] # (from function `freetheclasses' in file hadoop_add_common_to_classpath.bats, line 27,
               [exec] #  in test file hadoop_add_common_to_classpath.bats, line 53)
               [exec] #   `freetheclasses' failed
               [exec] # bindir: /Users/vvasudev/Workspace/apache/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # /var/folders/n1/klkrb91135d8s9xl7m4gcsgw0000gp/T/bats.39050.src: line 27: unset: `/Users/vvasudev/Workspace/current-hadoop': not a valid identifier
               [exec] not ok 3 hadoop_add_common_to_classpath (build paths)
               [exec] # (from function `freetheclasses' in file hadoop_add_common_to_classpath.bats, line 27,
               [exec] #  in test file hadoop_add_common_to_classpath.bats, line 63)
               [exec] #   `freetheclasses' failed
               [exec] # bindir: /Users/vvasudev/Workspace/apache/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # /var/folders/n1/klkrb91135d8s9xl7m4gcsgw0000gp/T/bats.39050.src: line 27: unset: `/Users/vvasudev/Workspace/current-hadoop': not a valid identifier
               [exec] Running bats -t hadoop_add_javalibpath.bats
          

          2) On a Linux VM

               [exec] Running bats -t hadoop_add_to_classpath_toolspath.bats
               [exec] 1..5
               [exec] ok 1 hadoop_add_to_classpath_toolspath (nothing)
               [exec] ok 2 hadoop_add_to_classpath_toolspath (none)
               [exec] not ok 3 hadoop_add_to_classpath_toolspath (only)
               [exec] # (from function `hadoop_add_to_classpath_toolspath' in file ../../main/bin/hadoop-functions.sh, line 970,
               [exec] #  in test file hadoop_add_to_classpath_toolspath.bats, line 52)
               [exec] #   `hadoop_add_to_classpath_toolspath' failed
               [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # DEBUG: Adding HADOOP_TOOLS_PATH to CLASSPATH
               [exec] not ok 4 hadoop_add_to_classpath_toolspath (1+1)
               [exec] # (from function `hadoop_add_to_classpath_toolspath' in file ../../main/bin/hadoop-functions.sh, line 970,
               [exec] #  in test file hadoop_add_to_classpath_toolspath.bats, line 61)
               [exec] #   `hadoop_add_to_classpath_toolspath' failed
               [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # DEBUG: Adding HADOOP_TOOLS_PATH to CLASSPATH
               [exec] ok 5 hadoop_add_to_classpath_toolspath (3+2)
               [exec] Running bats -t hadoop_add_to_classpath_userpath.bats
               [exec] 1..7
               [exec] not ok 1 hadoop_add_to_classpath_userpath (nothing)
               [exec] # (from function `freetheclasses' in file hadoop_add_to_classpath_userpath.bats, line 25,
               [exec] #  in test file hadoop_add_to_classpath_userpath.bats, line 38)
               [exec] #   `freetheclasses' failed
               [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # /tmp/bats.24440.src: line 25: unset: `/var/hadoop/tez-conf:/var/hadoop/tez-0.7.0-minimal/*:/var/hadoop/tez-0.7.0-minimal/lib/*': not a valid identifier
               [exec] not ok 2 hadoop_add_to_classpath_userpath (none)
               [exec] # (from function `freetheclasses' in file hadoop_add_to_classpath_userpath.bats, line 25,
               [exec] #  in test file hadoop_add_to_classpath_userpath.bats, line 44)
               [exec] #   `freetheclasses' failed
               [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # /tmp/bats.24440.src: line 25: unset: `/var/hadoop/tez-conf:/var/hadoop/tez-0.7.0-minimal/*:/var/hadoop/tez-0.7.0-minimal/lib/*': not a valid identifier
               [exec] not ok 3 hadoop_add_to_classpath_userpath (only)
               [exec] # (from function `freetheclasses' in file hadoop_add_to_classpath_userpath.bats, line 25,
               [exec] #  in test file hadoop_add_to_classpath_userpath.bats, line 51)
               [exec] #   `freetheclasses' failed
               [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # /tmp/bats.24440.src: line 25: unset: `/var/hadoop/tez-conf:/var/hadoop/tez-0.7.0-minimal/*:/var/hadoop/tez-0.7.0-minimal/lib/*': not a valid identifier
               [exec] not ok 4 hadoop_add_to_classpath_userpath (classloader)
               [exec] # (from function `freetheclasses' in file hadoop_add_to_classpath_userpath.bats, line 25,
               [exec] #  in test file hadoop_add_to_classpath_userpath.bats, line 59)
               [exec] #   `freetheclasses' failed
               [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # /tmp/bats.24440.src: line 25: unset: `/var/hadoop/tez-conf:/var/hadoop/tez-0.7.0-minimal/*:/var/hadoop/tez-0.7.0-minimal/lib/*': not a valid identifier
               [exec] not ok 5 hadoop_add_to_classpath_userpath (1+1 dupe)
               [exec] # (from function `freetheclasses' in file hadoop_add_to_classpath_userpath.bats, line 25,
               [exec] #  in test file hadoop_add_to_classpath_userpath.bats, line 68)
               [exec] #   `freetheclasses' failed
               [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # /tmp/bats.24440.src: line 25: unset: `/var/hadoop/tez-conf:/var/hadoop/tez-0.7.0-minimal/*:/var/hadoop/tez-0.7.0-minimal/lib/*': not a valid identifier
               [exec] not ok 6 hadoop_add_to_classpath_userpath (3+2 after)
               [exec] # (from function `freetheclasses' in file hadoop_add_to_classpath_userpath.bats, line 25,
               [exec] #  in test file hadoop_add_to_classpath_userpath.bats, line 79)
               [exec] #   `freetheclasses' failed
               [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # /tmp/bats.24440.src: line 25: unset: `/var/hadoop/tez-conf:/var/hadoop/tez-0.7.0-minimal/*:/var/hadoop/tez-0.7.0-minimal/lib/*': not a valid identifier
               [exec] not ok 7 hadoop_add_to_classpath_userpath (3+2 before)
               [exec] # (from function `freetheclasses' in file hadoop_add_to_classpath_userpath.bats, line 25,
               [exec] #  in test file hadoop_add_to_classpath_userpath.bats, line 90)
               [exec] #   `freetheclasses' failed
               [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # /tmp/bats.24440.src: line 25: unset: `/var/hadoop/tez-conf:/var/hadoop/tez-0.7.0-minimal/*:/var/hadoop/tez-0.7.0-minimal/lib/*': not a valid identifier
               [exec] Running bats -t hadoop_basic_init.bats
          
          Show
          vvasudev Varun Vasudev added a comment - Allen Wittenauer - any idea what's happening with the failing test? I tried to run it on my machine and here's what I get(all these runs were with the patch applied) - 1) On my mac [exec] 1..3 [exec] not ok 1 hadoop_add_common_to_classpath (negative) [exec] # (from function `freetheclasses' in file hadoop_add_common_to_classpath.bats, line 27, [exec] # in test file hadoop_add_common_to_classpath.bats, line 45) [exec] # `freetheclasses' failed [exec] # bindir: /Users/vvasudev/Workspace/apache/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # / var /folders/n1/klkrb91135d8s9xl7m4gcsgw0000gp/T/bats.39050.src: line 27: unset: `/Users/vvasudev/Workspace/current-hadoop': not a valid identifier [exec] not ok 2 hadoop_add_common_to_classpath (positive) [exec] # (from function `freetheclasses' in file hadoop_add_common_to_classpath.bats, line 27, [exec] # in test file hadoop_add_common_to_classpath.bats, line 53) [exec] # `freetheclasses' failed [exec] # bindir: /Users/vvasudev/Workspace/apache/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # / var /folders/n1/klkrb91135d8s9xl7m4gcsgw0000gp/T/bats.39050.src: line 27: unset: `/Users/vvasudev/Workspace/current-hadoop': not a valid identifier [exec] not ok 3 hadoop_add_common_to_classpath (build paths) [exec] # (from function `freetheclasses' in file hadoop_add_common_to_classpath.bats, line 27, [exec] # in test file hadoop_add_common_to_classpath.bats, line 63) [exec] # `freetheclasses' failed [exec] # bindir: /Users/vvasudev/Workspace/apache/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # / var /folders/n1/klkrb91135d8s9xl7m4gcsgw0000gp/T/bats.39050.src: line 27: unset: `/Users/vvasudev/Workspace/current-hadoop': not a valid identifier [exec] Running bats -t hadoop_add_javalibpath.bats 2) On a Linux VM [exec] Running bats -t hadoop_add_to_classpath_toolspath.bats [exec] 1..5 [exec] ok 1 hadoop_add_to_classpath_toolspath (nothing) [exec] ok 2 hadoop_add_to_classpath_toolspath (none) [exec] not ok 3 hadoop_add_to_classpath_toolspath (only) [exec] # (from function `hadoop_add_to_classpath_toolspath' in file ../../main/bin/hadoop-functions.sh, line 970, [exec] # in test file hadoop_add_to_classpath_toolspath.bats, line 52) [exec] # `hadoop_add_to_classpath_toolspath' failed [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # DEBUG: Adding HADOOP_TOOLS_PATH to CLASSPATH [exec] not ok 4 hadoop_add_to_classpath_toolspath (1+1) [exec] # (from function `hadoop_add_to_classpath_toolspath' in file ../../main/bin/hadoop-functions.sh, line 970, [exec] # in test file hadoop_add_to_classpath_toolspath.bats, line 61) [exec] # `hadoop_add_to_classpath_toolspath' failed [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # DEBUG: Adding HADOOP_TOOLS_PATH to CLASSPATH [exec] ok 5 hadoop_add_to_classpath_toolspath (3+2) [exec] Running bats -t hadoop_add_to_classpath_userpath.bats [exec] 1..7 [exec] not ok 1 hadoop_add_to_classpath_userpath (nothing) [exec] # (from function `freetheclasses' in file hadoop_add_to_classpath_userpath.bats, line 25, [exec] # in test file hadoop_add_to_classpath_userpath.bats, line 38) [exec] # `freetheclasses' failed [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # /tmp/bats.24440.src: line 25: unset: `/ var /hadoop/tez-conf:/ var /hadoop/tez-0.7.0-minimal/*:/ var /hadoop/tez-0.7.0-minimal/lib/*': not a valid identifier [exec] not ok 2 hadoop_add_to_classpath_userpath (none) [exec] # (from function `freetheclasses' in file hadoop_add_to_classpath_userpath.bats, line 25, [exec] # in test file hadoop_add_to_classpath_userpath.bats, line 44) [exec] # `freetheclasses' failed [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # /tmp/bats.24440.src: line 25: unset: `/ var /hadoop/tez-conf:/ var /hadoop/tez-0.7.0-minimal/*:/ var /hadoop/tez-0.7.0-minimal/lib/*': not a valid identifier [exec] not ok 3 hadoop_add_to_classpath_userpath (only) [exec] # (from function `freetheclasses' in file hadoop_add_to_classpath_userpath.bats, line 25, [exec] # in test file hadoop_add_to_classpath_userpath.bats, line 51) [exec] # `freetheclasses' failed [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # /tmp/bats.24440.src: line 25: unset: `/ var /hadoop/tez-conf:/ var /hadoop/tez-0.7.0-minimal/*:/ var /hadoop/tez-0.7.0-minimal/lib/*': not a valid identifier [exec] not ok 4 hadoop_add_to_classpath_userpath (classloader) [exec] # (from function `freetheclasses' in file hadoop_add_to_classpath_userpath.bats, line 25, [exec] # in test file hadoop_add_to_classpath_userpath.bats, line 59) [exec] # `freetheclasses' failed [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # /tmp/bats.24440.src: line 25: unset: `/ var /hadoop/tez-conf:/ var /hadoop/tez-0.7.0-minimal/*:/ var /hadoop/tez-0.7.0-minimal/lib/*': not a valid identifier [exec] not ok 5 hadoop_add_to_classpath_userpath (1+1 dupe) [exec] # (from function `freetheclasses' in file hadoop_add_to_classpath_userpath.bats, line 25, [exec] # in test file hadoop_add_to_classpath_userpath.bats, line 68) [exec] # `freetheclasses' failed [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # /tmp/bats.24440.src: line 25: unset: `/ var /hadoop/tez-conf:/ var /hadoop/tez-0.7.0-minimal/*:/ var /hadoop/tez-0.7.0-minimal/lib/*': not a valid identifier [exec] not ok 6 hadoop_add_to_classpath_userpath (3+2 after) [exec] # (from function `freetheclasses' in file hadoop_add_to_classpath_userpath.bats, line 25, [exec] # in test file hadoop_add_to_classpath_userpath.bats, line 79) [exec] # `freetheclasses' failed [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # /tmp/bats.24440.src: line 25: unset: `/ var /hadoop/tez-conf:/ var /hadoop/tez-0.7.0-minimal/*:/ var /hadoop/tez-0.7.0-minimal/lib/*': not a valid identifier [exec] not ok 7 hadoop_add_to_classpath_userpath (3+2 before) [exec] # (from function `freetheclasses' in file hadoop_add_to_classpath_userpath.bats, line 25, [exec] # in test file hadoop_add_to_classpath_userpath.bats, line 90) [exec] # `freetheclasses' failed [exec] # bindir: /home/varun/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # /tmp/bats.24440.src: line 25: unset: `/ var /hadoop/tez-conf:/ var /hadoop/tez-0.7.0-minimal/*:/ var /hadoop/tez-0.7.0-minimal/lib/*': not a valid identifier [exec] Running bats -t hadoop_basic_init.bats
          Hide
          aw Allen Wittenauer added a comment - - edited

          This is bizarre. I can't duplicate these errors, even using the Yetus dockerfile used during the precommit test. I'll have to dig into this.

          EDIT: just realized I never ran --run-tests locally. Hang on. lol

          Show
          aw Allen Wittenauer added a comment - - edited This is bizarre. I can't duplicate these errors, even using the Yetus dockerfile used during the precommit test. I'll have to dig into this. EDIT: just realized I never ran --run-tests locally. Hang on. lol
          Hide
          aw Allen Wittenauer added a comment -

          OK, got it.

          This is the same damn weirdism that impacts bash v4.x but not v3.x in set -e mode. The fix is simple and I'll upload a new patch here in a sec.

          Show
          aw Allen Wittenauer added a comment - OK, got it. This is the same damn weirdism that impacts bash v4.x but not v3.x in set -e mode. The fix is simple and I'll upload a new patch here in a sec.
          Hide
          aw Allen Wittenauer added a comment -

          -04:

          • in set -e mode, let QATESTMODE pass through unscathed.
          Show
          aw Allen Wittenauer added a comment - -04: in set -e mode, let QATESTMODE pass through unscathed.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 10s docker + precommit patch detected.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 shellcheck 0m 10s There were no new shellcheck issues.
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 unit 2m 10s hadoop-common in the patch passed with JDK v1.8.0_60.
          +1 unit 0m 11s hadoop-kms in the patch passed with JDK v1.8.0_60.
          +1 unit 0m 39s hadoop-hdfs in the patch passed with JDK v1.8.0_60.
          +1 unit 0m 14s hadoop-hdfs-httpfs in the patch passed with JDK v1.8.0_60.
          +1 unit 1m 10s hadoop-yarn in the patch passed with JDK v1.8.0_60.
          -1 unit 2m 44s hadoop-mapreduce-project in the patch failed with JDK v1.8.0_60.
          +1 unit 0m 15s hadoop-sls in the patch passed with JDK v1.8.0_60.
          +1 unit 1m 50s hadoop-common in the patch passed with JDK v1.7.0_79.
          +1 unit 0m 14s hadoop-kms in the patch passed with JDK v1.7.0_79.
          +1 unit 0m 33s hadoop-hdfs in the patch passed with JDK v1.7.0_79.
          +1 unit 0m 15s hadoop-hdfs-httpfs in the patch passed with JDK v1.7.0_79.
          +1 unit 0m 53s hadoop-yarn in the patch passed with JDK v1.7.0_79.
          -1 unit 2m 42s hadoop-mapreduce-project in the patch failed with JDK v1.7.0_79.
          +1 unit 0m 13s hadoop-sls in the patch passed with JDK v1.7.0_79.
          +1 asflicense 0m 29s Patch does not generate ASF License warnings.
          15m 7s



          Subsystem Report/Notes
          Docker Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-10-28
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12769328/HADOOP-10787.04.patch
          JIRA Issue HADOOP-10787
          Optional Tests asflicense unit shellcheck
          uname Linux f49d1203a5e6 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HADOOP-Build/patchprocess/apache-yetus-67f42f1/precommit/personality/hadoop.sh
          git revision trunk / 27414da
          Default Java 1.7.0_79
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79
          shellcheck v0.4.1
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/7965/artifact/patchprocess/patch-unit-hadoop-mapreduce-project-jdk1.8.0_60.txt
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/7965/artifact/patchprocess/patch-unit-hadoop-mapreduce-project-jdk1.7.0_79.txt
          JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7965/testReport/
          modules C: hadoop-common-project/hadoop-common hadoop-common-project/hadoop-kms hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-mapreduce-project hadoop-tools/hadoop-sls hadoop-yarn-project/hadoop-yarn U: .
          Max memory used 88MB
          Powered by Apache Yetus http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7965/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 10s docker + precommit patch detected. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 shellcheck 0m 10s There were no new shellcheck issues. +1 whitespace 0m 0s Patch has no whitespace issues. +1 unit 2m 10s hadoop-common in the patch passed with JDK v1.8.0_60. +1 unit 0m 11s hadoop-kms in the patch passed with JDK v1.8.0_60. +1 unit 0m 39s hadoop-hdfs in the patch passed with JDK v1.8.0_60. +1 unit 0m 14s hadoop-hdfs-httpfs in the patch passed with JDK v1.8.0_60. +1 unit 1m 10s hadoop-yarn in the patch passed with JDK v1.8.0_60. -1 unit 2m 44s hadoop-mapreduce-project in the patch failed with JDK v1.8.0_60. +1 unit 0m 15s hadoop-sls in the patch passed with JDK v1.8.0_60. +1 unit 1m 50s hadoop-common in the patch passed with JDK v1.7.0_79. +1 unit 0m 14s hadoop-kms in the patch passed with JDK v1.7.0_79. +1 unit 0m 33s hadoop-hdfs in the patch passed with JDK v1.7.0_79. +1 unit 0m 15s hadoop-hdfs-httpfs in the patch passed with JDK v1.7.0_79. +1 unit 0m 53s hadoop-yarn in the patch passed with JDK v1.7.0_79. -1 unit 2m 42s hadoop-mapreduce-project in the patch failed with JDK v1.7.0_79. +1 unit 0m 13s hadoop-sls in the patch passed with JDK v1.7.0_79. +1 asflicense 0m 29s Patch does not generate ASF License warnings. 15m 7s Subsystem Report/Notes Docker Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-10-28 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12769328/HADOOP-10787.04.patch JIRA Issue HADOOP-10787 Optional Tests asflicense unit shellcheck uname Linux f49d1203a5e6 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HADOOP-Build/patchprocess/apache-yetus-67f42f1/precommit/personality/hadoop.sh git revision trunk / 27414da Default Java 1.7.0_79 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79 shellcheck v0.4.1 unit https://builds.apache.org/job/PreCommit-HADOOP-Build/7965/artifact/patchprocess/patch-unit-hadoop-mapreduce-project-jdk1.8.0_60.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/7965/artifact/patchprocess/patch-unit-hadoop-mapreduce-project-jdk1.7.0_79.txt JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7965/testReport/ modules C: hadoop-common-project/hadoop-common hadoop-common-project/hadoop-kms hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-mapreduce-project hadoop-tools/hadoop-sls hadoop-yarn-project/hadoop-yarn U: . Max memory used 88MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7965/console This message was automatically generated.
          Hide
          vvasudev Varun Vasudev added a comment -

          Allen Wittenauer - the issue still exists on my mac and the linux vm.

          On my mac -

          hadoop-common vvasudev$ pwd
          /Users/vvasudev/Workspace/apache/hadoop/hadoop-common-project/hadoop-common
          hadoop-common vvasudev$ mvn clean package install -DskipTests  -Dmaven.javadoc.skip=true
          

          results in

               [exec] 1..3
               [exec] not ok 1 hadoop_add_common_to_classpath (negative)
               [exec] # (from function `freetheclasses' in file hadoop_add_common_to_classpath.bats, line 27,
               [exec] #  in test file hadoop_add_common_to_classpath.bats, line 45)
               [exec] #   `freetheclasses' failed
               [exec] # bindir: /Users/vvasudev/Workspace/apache/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # /var/folders/n1/klkrb91135d8s9xl7m4gcsgw0000gp/T/bats.97469.src: line 27: unset: `/Users/vvasudev/Workspace/current-hadoop': not a valid identifier
               [exec] not ok 2 hadoop_add_common_to_classpath (positive)
               [exec] # (from function `freetheclasses' in file hadoop_add_common_to_classpath.bats, line 27,
               [exec] #  in test file hadoop_add_common_to_classpath.bats, line 53)
               [exec] #   `freetheclasses' failed
               [exec] # bindir: /Users/vvasudev/Workspace/apache/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # /var/folders/n1/klkrb91135d8s9xl7m4gcsgw0000gp/T/bats.97469.src: line 27: unset: `/Users/vvasudev/Workspace/current-hadoop': not a valid identifier
               [exec] not ok 3 hadoop_add_common_to_classpath (build paths)
               [exec] # (from function `freetheclasses' in file hadoop_add_common_to_classpath.bats, line 27,
               [exec] #  in test file hadoop_add_common_to_classpath.bats, line 63)
               [exec] #   `freetheclasses' failed
               [exec] # bindir: /Users/vvasudev/Workspace/apache/hadoop/hadoop-common-project/hadoop-common/src/test/scripts
               [exec] # /var/folders/n1/klkrb91135d8s9xl7m4gcsgw0000gp/T/bats.97469.src: line 27: unset: `/Users/vvasudev/Workspace/current-hadoop': not a valid identifier
               [exec] Running bats -t hadoop_add_javalibpath.bats
          

          which means that I can't run a build with bats enabled(even if I skip tests).

          In my .profile, I have

          export HADOOP_INSTALL=/Users/vvasudev/Workspace/current-hadoop
          

          The bash version is -

          hadoop-common vvasudev$ bash --version
          GNU bash, version 3.2.57(1)-release (x86_64-apple-darwin14)
          Copyright (C) 2007 Free Software Foundation, Inc.
          hadoop-common vvasudev$
          

          The root cause seems to the function freetheclasses in hadoop_add_common_to_classpath.bats - the unset in that function gives the error.

          Show
          vvasudev Varun Vasudev added a comment - Allen Wittenauer - the issue still exists on my mac and the linux vm. On my mac - hadoop-common vvasudev$ pwd /Users/vvasudev/Workspace/apache/hadoop/hadoop-common-project/hadoop-common hadoop-common vvasudev$ mvn clean package install -DskipTests -Dmaven.javadoc.skip= true results in [exec] 1..3 [exec] not ok 1 hadoop_add_common_to_classpath (negative) [exec] # (from function `freetheclasses' in file hadoop_add_common_to_classpath.bats, line 27, [exec] # in test file hadoop_add_common_to_classpath.bats, line 45) [exec] # `freetheclasses' failed [exec] # bindir: /Users/vvasudev/Workspace/apache/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # / var /folders/n1/klkrb91135d8s9xl7m4gcsgw0000gp/T/bats.97469.src: line 27: unset: `/Users/vvasudev/Workspace/current-hadoop': not a valid identifier [exec] not ok 2 hadoop_add_common_to_classpath (positive) [exec] # (from function `freetheclasses' in file hadoop_add_common_to_classpath.bats, line 27, [exec] # in test file hadoop_add_common_to_classpath.bats, line 53) [exec] # `freetheclasses' failed [exec] # bindir: /Users/vvasudev/Workspace/apache/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # / var /folders/n1/klkrb91135d8s9xl7m4gcsgw0000gp/T/bats.97469.src: line 27: unset: `/Users/vvasudev/Workspace/current-hadoop': not a valid identifier [exec] not ok 3 hadoop_add_common_to_classpath (build paths) [exec] # (from function `freetheclasses' in file hadoop_add_common_to_classpath.bats, line 27, [exec] # in test file hadoop_add_common_to_classpath.bats, line 63) [exec] # `freetheclasses' failed [exec] # bindir: /Users/vvasudev/Workspace/apache/hadoop/hadoop-common-project/hadoop-common/src/test/scripts [exec] # / var /folders/n1/klkrb91135d8s9xl7m4gcsgw0000gp/T/bats.97469.src: line 27: unset: `/Users/vvasudev/Workspace/current-hadoop': not a valid identifier [exec] Running bats -t hadoop_add_javalibpath.bats which means that I can't run a build with bats enabled(even if I skip tests). In my .profile, I have export HADOOP_INSTALL=/Users/vvasudev/Workspace/current-hadoop The bash version is - hadoop-common vvasudev$ bash --version GNU bash, version 3.2.57(1)-release (x86_64-apple-darwin14) Copyright (C) 2007 Free Software Foundation, Inc. hadoop-common vvasudev$ The root cause seems to the function freetheclasses in hadoop_add_common_to_classpath.bats - the unset in that function gives the error.
          Hide
          aw Allen Wittenauer added a comment -

          which means that I can't run a build with bats enabled(even if I skip tests).

          This is HADOOP-12492 .

          GNU bash, version 3.2.57(1)-release (x86_64-apple-darwin14)

          So bash on Yosemite.

          The root cause seems to the function freetheclasses in hadoop_add_common_to_classpath.bats - the unset in that function gives the error.

          ... which is odd, given that same construct is used all over the place. I'll dig a little deeper.

          Thanks.

          Show
          aw Allen Wittenauer added a comment - which means that I can't run a build with bats enabled(even if I skip tests). This is HADOOP-12492 . GNU bash, version 3.2.57(1)-release (x86_64-apple-darwin14) So bash on Yosemite. The root cause seems to the function freetheclasses in hadoop_add_common_to_classpath.bats - the unset in that function gives the error. ... which is odd, given that same construct is used all over the place. I'll dig a little deeper. Thanks.
          Hide
          aw Allen Wittenauer added a comment - - edited

          OK, I see the bug here too. I'll fix it...

          Show
          aw Allen Wittenauer added a comment - - edited OK, I see the bug here too. I'll fix it...
          Hide
          aw Allen Wittenauer added a comment -

          -05:

          • fixes
          Show
          aw Allen Wittenauer added a comment - -05: fixes
          Hide
          hadoopqa Hadoop QA added a comment -
          +1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 6s docker + precommit patch detected.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 3 new or modified test files.
          +1 shellcheck 0m 8s There were no new shellcheck issues.
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 unit 1m 45s hadoop-common in the patch passed with JDK v1.8.0_60.
          +1 unit 0m 16s hadoop-kms in the patch passed with JDK v1.8.0_60.
          +1 unit 0m 36s hadoop-hdfs in the patch passed with JDK v1.8.0_60.
          +1 unit 0m 14s hadoop-hdfs-httpfs in the patch passed with JDK v1.8.0_60.
          +1 unit 0m 53s hadoop-yarn in the patch passed with JDK v1.8.0_60.
          +1 unit 2m 41s hadoop-mapreduce-project in the patch passed with JDK v1.8.0_60.
          +1 unit 0m 25s hadoop-sls in the patch passed with JDK v1.8.0_60.
          +1 unit 1m 37s hadoop-common in the patch passed with JDK v1.7.0_79.
          +1 unit 0m 13s hadoop-kms in the patch passed with JDK v1.7.0_79.
          +1 unit 0m 33s hadoop-hdfs in the patch passed with JDK v1.7.0_79.
          +1 unit 0m 15s hadoop-hdfs-httpfs in the patch passed with JDK v1.7.0_79.
          +1 unit 0m 50s hadoop-yarn in the patch passed with JDK v1.7.0_79.
          +1 unit 2m 31s hadoop-mapreduce-project in the patch passed with JDK v1.7.0_79.
          +1 unit 0m 14s hadoop-sls in the patch passed with JDK v1.7.0_79.
          +1 asflicense 0m 25s Patch does not generate ASF License warnings.
          13m 51s



          Subsystem Report/Notes
          Docker Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-10-31
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12769924/HADOOP-10787.05.patch
          JIRA Issue HADOOP-10787
          Optional Tests asflicense unit shellcheck
          uname Linux 7e983530cd29 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HADOOP-Build/patchprocess/apache-yetus-e77b1ce/precommit/personality/hadoop.sh
          git revision trunk / a4a6b5b
          Default Java 1.7.0_79
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79
          shellcheck v0.4.1
          JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7985/testReport/
          modules C: hadoop-common-project/hadoop-common hadoop-common-project/hadoop-kms hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-mapreduce-project hadoop-tools/hadoop-sls hadoop-yarn-project/hadoop-yarn U: .
          Max memory used 87MB
          Powered by Apache Yetus http://yetus.apache.org
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7985/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 6s docker + precommit patch detected. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 3 new or modified test files. +1 shellcheck 0m 8s There were no new shellcheck issues. +1 whitespace 0m 0s Patch has no whitespace issues. +1 unit 1m 45s hadoop-common in the patch passed with JDK v1.8.0_60. +1 unit 0m 16s hadoop-kms in the patch passed with JDK v1.8.0_60. +1 unit 0m 36s hadoop-hdfs in the patch passed with JDK v1.8.0_60. +1 unit 0m 14s hadoop-hdfs-httpfs in the patch passed with JDK v1.8.0_60. +1 unit 0m 53s hadoop-yarn in the patch passed with JDK v1.8.0_60. +1 unit 2m 41s hadoop-mapreduce-project in the patch passed with JDK v1.8.0_60. +1 unit 0m 25s hadoop-sls in the patch passed with JDK v1.8.0_60. +1 unit 1m 37s hadoop-common in the patch passed with JDK v1.7.0_79. +1 unit 0m 13s hadoop-kms in the patch passed with JDK v1.7.0_79. +1 unit 0m 33s hadoop-hdfs in the patch passed with JDK v1.7.0_79. +1 unit 0m 15s hadoop-hdfs-httpfs in the patch passed with JDK v1.7.0_79. +1 unit 0m 50s hadoop-yarn in the patch passed with JDK v1.7.0_79. +1 unit 2m 31s hadoop-mapreduce-project in the patch passed with JDK v1.7.0_79. +1 unit 0m 14s hadoop-sls in the patch passed with JDK v1.7.0_79. +1 asflicense 0m 25s Patch does not generate ASF License warnings. 13m 51s Subsystem Report/Notes Docker Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-10-31 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12769924/HADOOP-10787.05.patch JIRA Issue HADOOP-10787 Optional Tests asflicense unit shellcheck uname Linux 7e983530cd29 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HADOOP-Build/patchprocess/apache-yetus-e77b1ce/precommit/personality/hadoop.sh git revision trunk / a4a6b5b Default Java 1.7.0_79 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79 shellcheck v0.4.1 JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7985/testReport/ modules C: hadoop-common-project/hadoop-common hadoop-common-project/hadoop-kms hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-mapreduce-project hadoop-tools/hadoop-sls hadoop-yarn-project/hadoop-yarn U: . Max memory used 87MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7985/console This message was automatically generated.
          Hide
          vvasudev Varun Vasudev added a comment -

          +1. Committed to trunk. Thanks Allen Wittenauer!

          Show
          vvasudev Varun Vasudev added a comment - +1. Committed to trunk. Thanks Allen Wittenauer !
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8753 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8753/)
          HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. (vvasudev: rev 73b9c7b82b0f607a5328ad7dc4170da3ac0c1af3)

          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          • hadoop-tools/hadoop-sls/src/main/bin/rumen2sls.sh
          • hadoop-mapreduce-project/bin/mapred
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh
          • hadoop-common-project/hadoop-common/src/main/conf/hadoop-user-functions.sh.example
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-layout.sh.example
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_to_classpath_toolspath.bats
          • hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          • hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh
          • hadoop-common-project/hadoop-common/src/main/bin/slaves.sh
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_common_to_classpath.bats
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemons.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh
          • hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh
          • hadoop-tools/hadoop-sls/src/main/bin/slsrun.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_basic_init.bats
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/distribute-exclude.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
          • hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn
          • hadoop-common-project/hadoop-common/src/main/bin/rcc
          • hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/sbin/httpfs.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh
          • hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemon.sh
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/bin/start-all.sh
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8753 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8753/ ) HADOOP-10787 . Rename/remove non-HADOOP_*, etc from the shell scripts. (vvasudev: rev 73b9c7b82b0f607a5328ad7dc4170da3ac0c1af3) hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh hadoop-tools/hadoop-sls/src/main/bin/rumen2sls.sh hadoop-mapreduce-project/bin/mapred hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh hadoop-common-project/hadoop-common/src/main/conf/hadoop-user-functions.sh.example hadoop-common-project/hadoop-common/src/main/bin/hadoop-layout.sh.example hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_to_classpath_toolspath.bats hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh hadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh hadoop-common-project/hadoop-common/src/main/bin/slaves.sh hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_common_to_classpath.bats hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemons.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh hadoop-tools/hadoop-sls/src/main/bin/slsrun.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-common-project/hadoop-common/src/test/scripts/hadoop_basic_init.bats hadoop-hdfs-project/hadoop-hdfs/src/main/bin/distribute-exclude.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh hadoop-yarn-project/hadoop-yarn/bin/yarn hadoop-common-project/hadoop-common/src/main/bin/rcc hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/sbin/httpfs.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemon.sh hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/bin/start-all.sh
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #637 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/637/)
          HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. (vvasudev: rev 73b9c7b82b0f607a5328ad7dc4170da3ac0c1af3)

          • hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          • hadoop-yarn-project/hadoop-yarn/bin/yarn
          • hadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_to_classpath_toolspath.bats
          • hadoop-common-project/hadoop-common/src/main/bin/slaves.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-layout.sh.example
          • hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/bin/start-all.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemons.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_common_to_classpath.bats
          • hadoop-mapreduce-project/bin/mapred
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh
          • hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_basic_init.bats
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
          • hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/distribute-exclude.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh
          • hadoop-tools/hadoop-sls/src/main/bin/rumen2sls.sh
          • hadoop-tools/hadoop-sls/src/main/bin/slsrun.sh
          • hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh
          • hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/sbin/httpfs.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemon.sh
          • hadoop-common-project/hadoop-common/src/main/bin/rcc
          • hadoop-common-project/hadoop-common/src/main/conf/hadoop-user-functions.sh.example
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #637 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/637/ ) HADOOP-10787 . Rename/remove non-HADOOP_*, etc from the shell scripts. (vvasudev: rev 73b9c7b82b0f607a5328ad7dc4170da3ac0c1af3) hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs hadoop-yarn-project/hadoop-yarn/bin/yarn hadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_to_classpath_toolspath.bats hadoop-common-project/hadoop-common/src/main/bin/slaves.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-layout.sh.example hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/bin/start-all.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemons.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_common_to_classpath.bats hadoop-mapreduce-project/bin/mapred hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh hadoop-common-project/hadoop-common/src/test/scripts/hadoop_basic_init.bats hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/distribute-exclude.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh hadoop-tools/hadoop-sls/src/main/bin/rumen2sls.sh hadoop-tools/hadoop-sls/src/main/bin/slsrun.sh hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/sbin/httpfs.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemon.sh hadoop-common-project/hadoop-common/src/main/bin/rcc hadoop-common-project/hadoop-common/src/main/conf/hadoop-user-functions.sh.example
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2567 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2567/)
          HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. (vvasudev: rev 73b9c7b82b0f607a5328ad7dc4170da3ac0c1af3)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
          • hadoop-tools/hadoop-sls/src/main/bin/slsrun.sh
          • hadoop-common-project/hadoop-common/src/main/conf/hadoop-user-functions.sh.example
          • hadoop-tools/hadoop-sls/src/main/bin/rumen2sls.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_common_to_classpath.bats
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh
          • hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_to_classpath_toolspath.bats
          • hadoop-mapreduce-project/bin/mapred
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/distribute-exclude.sh
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh
          • hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-layout.sh.example
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/sbin/httpfs.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_basic_init.bats
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh
          • hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemon.sh
          • hadoop-common-project/hadoop-common/src/main/bin/start-all.sh
          • hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemons.sh
          • hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn
          • hadoop-common-project/hadoop-common/src/main/bin/rcc
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh
          • hadoop-common-project/hadoop-common/src/main/bin/slaves.sh
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2567 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2567/ ) HADOOP-10787 . Rename/remove non-HADOOP_*, etc from the shell scripts. (vvasudev: rev 73b9c7b82b0f607a5328ad7dc4170da3ac0c1af3) hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh hadoop-tools/hadoop-sls/src/main/bin/slsrun.sh hadoop-common-project/hadoop-common/src/main/conf/hadoop-user-functions.sh.example hadoop-tools/hadoop-sls/src/main/bin/rumen2sls.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_common_to_classpath.bats hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_to_classpath_toolspath.bats hadoop-mapreduce-project/bin/mapred hadoop-hdfs-project/hadoop-hdfs/src/main/bin/distribute-exclude.sh hadoop-common-project/hadoop-common/CHANGES.txt hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-layout.sh.example hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/sbin/httpfs.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh hadoop-common-project/hadoop-common/src/test/scripts/hadoop_basic_init.bats hadoop-hdfs-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemon.sh hadoop-common-project/hadoop-common/src/main/bin/start-all.sh hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh hadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemons.sh hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh hadoop-yarn-project/hadoop-yarn/bin/yarn hadoop-common-project/hadoop-common/src/main/bin/rcc hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh hadoop-common-project/hadoop-common/src/main/bin/slaves.sh
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk #1360 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1360/)
          HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. (vvasudev: rev 73b9c7b82b0f607a5328ad7dc4170da3ac0c1af3)

          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_to_classpath_toolspath.bats
          • hadoop-yarn-project/hadoop-yarn/bin/yarn
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-layout.sh.example
          • hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/sbin/httpfs.sh
          • hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemons.sh
          • hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh
          • hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh
          • hadoop-common-project/hadoop-common/src/main/bin/slaves.sh
          • hadoop-tools/hadoop-sls/src/main/bin/slsrun.sh
          • hadoop-mapreduce-project/bin/mapred
          • hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_common_to_classpath.bats
          • hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh
          • hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh
          • hadoop-common-project/hadoop-common/src/main/bin/start-all.sh
          • hadoop-common-project/hadoop-common/src/main/bin/rcc
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_basic_init.bats
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          • hadoop-tools/hadoop-sls/src/main/bin/rumen2sls.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemon.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/distribute-exclude.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh
          • hadoop-common-project/hadoop-common/src/main/conf/hadoop-user-functions.sh.example
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #1360 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1360/ ) HADOOP-10787 . Rename/remove non-HADOOP_*, etc from the shell scripts. (vvasudev: rev 73b9c7b82b0f607a5328ad7dc4170da3ac0c1af3) hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_to_classpath_toolspath.bats hadoop-yarn-project/hadoop-yarn/bin/yarn hadoop-common-project/hadoop-common/src/main/bin/hadoop-layout.sh.example hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/sbin/httpfs.sh hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemons.sh hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh hadoop-common-project/hadoop-common/src/main/bin/slaves.sh hadoop-tools/hadoop-sls/src/main/bin/slsrun.sh hadoop-mapreduce-project/bin/mapred hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_common_to_classpath.bats hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh hadoop-common-project/hadoop-common/src/main/bin/start-all.sh hadoop-common-project/hadoop-common/src/main/bin/rcc hadoop-common-project/hadoop-common/src/test/scripts/hadoop_basic_init.bats hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs hadoop-tools/hadoop-sls/src/main/bin/rumen2sls.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemon.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh hadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/distribute-exclude.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh hadoop-common-project/hadoop-common/src/main/conf/hadoop-user-functions.sh.example hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-common-project/hadoop-common/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #626 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/626/)
          HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. (vvasudev: rev 73b9c7b82b0f607a5328ad7dc4170da3ac0c1af3)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/distribute-exclude.sh
          • hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh
          • hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          • hadoop-mapreduce-project/bin/mapred
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_to_classpath_toolspath.bats
          • hadoop-tools/hadoop-sls/src/main/bin/slsrun.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemons.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
          • hadoop-common-project/hadoop-common/src/main/bin/rcc
          • hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/sbin/httpfs.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh
          • hadoop-tools/hadoop-sls/src/main/bin/rumen2sls.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh
          • hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn
          • hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemon.sh
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_basic_init.bats
          • hadoop-common-project/hadoop-common/src/main/bin/start-all.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-layout.sh.example
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_common_to_classpath.bats
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh
          • hadoop-common-project/hadoop-common/src/main/conf/hadoop-user-functions.sh.example
          • hadoop-common-project/hadoop-common/src/main/bin/slaves.sh
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #626 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/626/ ) HADOOP-10787 . Rename/remove non-HADOOP_*, etc from the shell scripts. (vvasudev: rev 73b9c7b82b0f607a5328ad7dc4170da3ac0c1af3) hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/distribute-exclude.sh hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs hadoop-mapreduce-project/bin/mapred hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_to_classpath_toolspath.bats hadoop-tools/hadoop-sls/src/main/bin/slsrun.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemons.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh hadoop-common-project/hadoop-common/src/main/bin/rcc hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/sbin/httpfs.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh hadoop-common-project/hadoop-common/CHANGES.txt hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh hadoop-tools/hadoop-sls/src/main/bin/rumen2sls.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh hadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh hadoop-yarn-project/hadoop-yarn/bin/yarn hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemon.sh hadoop-common-project/hadoop-common/src/test/scripts/hadoop_basic_init.bats hadoop-common-project/hadoop-common/src/main/bin/start-all.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-layout.sh.example hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_common_to_classpath.bats hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh hadoop-common-project/hadoop-common/src/main/conf/hadoop-user-functions.sh.example hadoop-common-project/hadoop-common/src/main/bin/slaves.sh
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #570 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/570/)
          HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. (vvasudev: rev 73b9c7b82b0f607a5328ad7dc4170da3ac0c1af3)

          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          • hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh
          • hadoop-mapreduce-project/bin/mapred
          • hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
          • hadoop-tools/hadoop-sls/src/main/bin/slsrun.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh
          • hadoop-common-project/hadoop-common/src/main/bin/slaves.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_common_to_classpath.bats
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemons.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_to_classpath_toolspath.bats
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemon.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-layout.sh.example
          • hadoop-common-project/hadoop-common/src/main/conf/hadoop-user-functions.sh.example
          • hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh
          • hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh
          • hadoop-common-project/hadoop-common/src/main/bin/rcc
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_basic_init.bats
          • hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/sbin/httpfs.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh
          • hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh
          • hadoop-tools/hadoop-sls/src/main/bin/rumen2sls.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/distribute-exclude.sh
          • hadoop-common-project/hadoop-common/src/main/bin/start-all.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #570 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/570/ ) HADOOP-10787 . Rename/remove non-HADOOP_*, etc from the shell scripts. (vvasudev: rev 73b9c7b82b0f607a5328ad7dc4170da3ac0c1af3) hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh hadoop-mapreduce-project/bin/mapred hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh hadoop-tools/hadoop-sls/src/main/bin/slsrun.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh hadoop-common-project/hadoop-common/src/main/bin/slaves.sh hadoop-yarn-project/hadoop-yarn/bin/yarn hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_common_to_classpath.bats hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemons.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_to_classpath_toolspath.bats hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemon.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-layout.sh.example hadoop-common-project/hadoop-common/src/main/conf/hadoop-user-functions.sh.example hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh hadoop-common-project/hadoop-common/src/main/bin/rcc hadoop-common-project/hadoop-common/src/test/scripts/hadoop_basic_init.bats hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/sbin/httpfs.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh hadoop-tools/hadoop-sls/src/main/bin/rumen2sls.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/distribute-exclude.sh hadoop-common-project/hadoop-common/src/main/bin/start-all.sh hadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh hadoop-common-project/hadoop-common/CHANGES.txt hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2508 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2508/)
          HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. (vvasudev: rev 73b9c7b82b0f607a5328ad7dc4170da3ac0c1af3)

          • hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh
          • hadoop-common-project/hadoop-common/src/main/bin/slaves.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
          • hadoop-tools/hadoop-sls/src/main/bin/slsrun.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-layout.sh.example
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop
          • hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh
          • hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
          • hadoop-common-project/hadoop-common/src/main/bin/rcc
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemon.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/distribute-exclude.sh
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_common_to_classpath.bats
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_basic_init.bats
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh
          • hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh
          • hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh
          • hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_to_classpath_toolspath.bats
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemons.sh
          • hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh
          • hadoop-tools/hadoop-sls/src/main/bin/rumen2sls.sh
          • hadoop-common-project/hadoop-common/src/main/conf/hadoop-user-functions.sh.example
          • hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh
          • hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/sbin/httpfs.sh
          • hadoop-mapreduce-project/bin/mapred
          • hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh
          • hadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh
          • hadoop-common-project/hadoop-common/src/main/bin/start-all.sh
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2508 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2508/ ) HADOOP-10787 . Rename/remove non-HADOOP_*, etc from the shell scripts. (vvasudev: rev 73b9c7b82b0f607a5328ad7dc4170da3ac0c1af3) hadoop-common-project/hadoop-kms/src/main/sbin/kms.sh hadoop-common-project/hadoop-common/src/main/bin/slaves.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh hadoop-tools/hadoop-sls/src/main/bin/slsrun.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-layout.sh.example hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh hadoop-common-project/hadoop-common/src/main/bin/rcc hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemon.sh hadoop-yarn-project/hadoop-yarn/bin/yarn hadoop-hdfs-project/hadoop-hdfs/src/main/bin/distribute-exclude.sh hadoop-common-project/hadoop-common/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_common_to_classpath.bats hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh hadoop-common-project/hadoop-common/src/test/scripts/hadoop_basic_init.bats hadoop-hdfs-project/hadoop-hdfs/src/main/bin/refresh-namenodes.sh hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh hadoop-common-project/hadoop-common/src/test/scripts/hadoop_add_to_classpath_toolspath.bats hadoop-common-project/hadoop-common/src/main/bin/hadoop-daemons.sh hadoop-common-project/hadoop-common/src/main/bin/hadoop-functions.sh hadoop-tools/hadoop-sls/src/main/bin/rumen2sls.sh hadoop-common-project/hadoop-common/src/main/conf/hadoop-user-functions.sh.example hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/sbin/httpfs.sh hadoop-mapreduce-project/bin/mapred hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh hadoop-yarn-project/hadoop-yarn/bin/yarn-daemons.sh hadoop-common-project/hadoop-common/src/main/bin/start-all.sh

            People

            • Assignee:
              aw Allen Wittenauer
              Reporter:
              aw Allen Wittenauer
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development