Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11357

Print information of the build enviornment in test-patch.sh

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: scripts
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Currently test-patch.sh lacks of information such as java version during the build, thus debugging problem like HADOOP-10530 becomes difficult.

      This jira proposes to print out more information in test-patch.sh to simplify debugging.

      1. HADOOP-11357-00.patch
        0.9 kB
        Allen Wittenauer

        Activity

        Hide
        ozawa Tsuyoshi Ozawa added a comment -

        +1 for adding this feature.

        Show
        ozawa Tsuyoshi Ozawa added a comment - +1 for adding this feature.
        Hide
        cmccabe Colin P. McCabe added a comment -

        To be fair, we do print the executor that was used, and you can usually ask the infra people what is installed on that executor. However, +1 for the idea of just printing java -version or something to make it absolutely clear. That would be nice. It might also clarify some things like are we running in 32 bit mode or 64 bit mode when running unit tests.

        Show
        cmccabe Colin P. McCabe added a comment - To be fair, we do print the executor that was used, and you can usually ask the infra people what is installed on that executor. However, +1 for the idea of just printing java -version or something to make it absolutely clear. That would be nice. It might also clarify some things like are we running in 32 bit mode or 64 bit mode when running unit tests.
        Hide
        cnauroth Chris Nauroth added a comment -

        A couple of other potentially helpful things:

        • Dump all environment variables.
        • uname -a
        Show
        cnauroth Chris Nauroth added a comment - A couple of other potentially helpful things: Dump all environment variables. uname -a
        Hide
        aw Allen Wittenauer added a comment -

        Revisiting this one.

        There is currently some secret info sitting in the env vars on the Jenkins hosts that we really shouldn't expose. But dumping uname -a and java -version is pretty simple with the new table-based structure.

        Show
        aw Allen Wittenauer added a comment - Revisiting this one. There is currently some secret info sitting in the env vars on the Jenkins hosts that we really shouldn't expose. But dumping uname -a and java -version is pretty simple with the new table-based structure.
        Hide
        hadoopqa Hadoop QA added a comment -

        A patch to test-patch or smart-apply-patch has been detected.
        Re-executing against the patched versions to perform further tests.
        The console is at https://builds.apache.org/job/PreCommit-HADOOP-Build/6181/console in case of problems.

        Show
        hadoopqa Hadoop QA added a comment - A patch to test-patch or smart-apply-patch has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HADOOP-Build/6181/console in case of problems.
        Hide
        hadoopqa Hadoop QA added a comment -



        +1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 0s dev-support patch detected.
        0 pre-patch 0m 0s Pre-patch trunk compilation is healthy.
        0 @author 0m 0s Skipping @author checks as test-patch has been patched.
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 release audit 0m 15s The applied patch does not increase the total number of release audit warnings.
        0 shellcheck 0m 15s Shellcheck was not available.
            0m 17s  



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12728185/HADOOP-11357-00.patch
        Optional Tests shellcheck
        git revision trunk / a00e001
        Java 1.7.0_55
        uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/6181/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s dev-support patch detected. 0 pre-patch 0m 0s Pre-patch trunk compilation is healthy. 0 @author 0m 0s Skipping @author checks as test-patch has been patched. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 release audit 0m 15s The applied patch does not increase the total number of release audit warnings. 0 shellcheck 0m 15s Shellcheck was not available.     0m 17s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12728185/HADOOP-11357-00.patch Optional Tests shellcheck git revision trunk / a00e001 Java 1.7.0_55 uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/6181/console This message was automatically generated.
        Hide
        cnauroth Chris Nauroth added a comment -

        +1 for the patch. Thank you, Allen.

        Show
        cnauroth Chris Nauroth added a comment - +1 for the patch. Thank you, Allen.
        Hide
        aw Allen Wittenauer added a comment -

        committed

        Show
        aw Allen Wittenauer added a comment - committed
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #7681 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7681/)
        HADOOP-11357. Print information of the build enviornment in test-patch.sh (aw) (aw: rev 8847777ae428dac52cf65cedd360e3702dd75e2f)

        • hadoop-common-project/hadoop-common/CHANGES.txt
        • dev-support/test-patch.sh
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7681 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7681/ ) HADOOP-11357 . Print information of the build enviornment in test-patch.sh (aw) (aw: rev 8847777ae428dac52cf65cedd360e3702dd75e2f) hadoop-common-project/hadoop-common/CHANGES.txt dev-support/test-patch.sh
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk #2108 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2108/)
        HADOOP-11357. Print information of the build enviornment in test-patch.sh (aw) (aw: rev 8847777ae428dac52cf65cedd360e3702dd75e2f)

        • dev-support/test-patch.sh
        • hadoop-common-project/hadoop-common/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2108 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2108/ ) HADOOP-11357 . Print information of the build enviornment in test-patch.sh (aw) (aw: rev 8847777ae428dac52cf65cedd360e3702dd75e2f) dev-support/test-patch.sh hadoop-common-project/hadoop-common/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #167 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/167/)
        HADOOP-11357. Print information of the build enviornment in test-patch.sh (aw) (aw: rev 8847777ae428dac52cf65cedd360e3702dd75e2f)

        • hadoop-common-project/hadoop-common/CHANGES.txt
        • dev-support/test-patch.sh
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #167 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/167/ ) HADOOP-11357 . Print information of the build enviornment in test-patch.sh (aw) (aw: rev 8847777ae428dac52cf65cedd360e3702dd75e2f) hadoop-common-project/hadoop-common/CHANGES.txt dev-support/test-patch.sh
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk #910 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/910/)
        HADOOP-11357. Print information of the build enviornment in test-patch.sh (aw) (aw: rev 8847777ae428dac52cf65cedd360e3702dd75e2f)

        • hadoop-common-project/hadoop-common/CHANGES.txt
        • dev-support/test-patch.sh
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #910 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/910/ ) HADOOP-11357 . Print information of the build enviornment in test-patch.sh (aw) (aw: rev 8847777ae428dac52cf65cedd360e3702dd75e2f) hadoop-common-project/hadoop-common/CHANGES.txt dev-support/test-patch.sh
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #176 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/176/)
        HADOOP-11357. Print information of the build enviornment in test-patch.sh (aw) (aw: rev 8847777ae428dac52cf65cedd360e3702dd75e2f)

        • dev-support/test-patch.sh
        • hadoop-common-project/hadoop-common/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #176 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/176/ ) HADOOP-11357 . Print information of the build enviornment in test-patch.sh (aw) (aw: rev 8847777ae428dac52cf65cedd360e3702dd75e2f) dev-support/test-patch.sh hadoop-common-project/hadoop-common/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #177 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/177/)
        HADOOP-11357. Print information of the build enviornment in test-patch.sh (aw) (aw: rev 8847777ae428dac52cf65cedd360e3702dd75e2f)

        • dev-support/test-patch.sh
        • hadoop-common-project/hadoop-common/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #177 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/177/ ) HADOOP-11357 . Print information of the build enviornment in test-patch.sh (aw) (aw: rev 8847777ae428dac52cf65cedd360e3702dd75e2f) dev-support/test-patch.sh hadoop-common-project/hadoop-common/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk #2126 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2126/)
        HADOOP-11357. Print information of the build enviornment in test-patch.sh (aw) (aw: rev 8847777ae428dac52cf65cedd360e3702dd75e2f)

        • dev-support/test-patch.sh
        • hadoop-common-project/hadoop-common/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2126 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2126/ ) HADOOP-11357 . Print information of the build enviornment in test-patch.sh (aw) (aw: rev 8847777ae428dac52cf65cedd360e3702dd75e2f) dev-support/test-patch.sh hadoop-common-project/hadoop-common/CHANGES.txt

          People

          • Assignee:
            aw Allen Wittenauer
            Reporter:
            wheat9 Haohui Mai
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development