Bigtop
  1. Bigtop
  2. BIGTOP-831

Hadoop branch-2 (and trunk?) are failing when built with JDK7u11

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.5.0
    • Fix Version/s: 0.8.0
    • Component/s: General, RPM
    • Environment:

      CentOS6.3 x64

      Description

      While building 0.5 with JDK7u11 I got this weird error (see the first comment). Looks like an issue with javadoc.

        Issue Links

          Activity

          Hide
          Konstantin Boudnik added a comment -

          [ERROR] Exit code: 1 - /home/user/jenkins/workspace/BigTop-RPM/label/centos-6-x86_64-HAD-1-buildbot/bigtop-repo/build/hadoop/rpm/BUILD/hadoop-2.0.2-alpha-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/source/JvmMetricsInfo.java:31: error: unmappable character for encoding ANSI_X3.4-1968
          [ERROR] JvmMetrics("JVM related metrics etc."), // record info??
          [ERROR] ^
          [ERROR] /home/user/jenkins/workspace/BigTop-RPM/label/centos-6-x86_64-HAD-1-buildbot/bigtop-repo/build/hadoop/rpm/BUILD/hadoop-2.0.2-alpha-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/source/JvmMetricsInfo.java:31: error: unmappable character for encoding ANSI_X3.4-1968
          [ERROR] JvmMetrics("JVM related metrics etc."), // record info??
          [ERROR] ^
          [ERROR]
          [ERROR] Command line was: /home/user/jenkins/tools/hudson.model.JDK/JDK7/jre/../bin/javadoc -J-Xmx1024m @options @packages
          [ERROR]

          Show
          Konstantin Boudnik added a comment - [ERROR] Exit code: 1 - /home/user/jenkins/workspace/BigTop-RPM/label/centos-6-x86_64-HAD-1-buildbot/bigtop-repo/build/hadoop/rpm/BUILD/hadoop-2.0.2-alpha-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/source/JvmMetricsInfo.java:31: error: unmappable character for encoding ANSI_X3.4-1968 [ERROR] JvmMetrics("JVM related metrics etc."), // record info?? [ERROR] ^ [ERROR] /home/user/jenkins/workspace/BigTop-RPM/label/centos-6-x86_64-HAD-1-buildbot/bigtop-repo/build/hadoop/rpm/BUILD/hadoop-2.0.2-alpha-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/source/JvmMetricsInfo.java:31: error: unmappable character for encoding ANSI_X3.4-1968 [ERROR] JvmMetrics("JVM related metrics etc."), // record info?? [ERROR] ^ [ERROR] [ERROR] Command line was: /home/user/jenkins/tools/hudson.model.JDK/JDK7/jre/../bin/javadoc -J-Xmx1024m @options @packages [ERROR]
          Hide
          Konstantin Boudnik added a comment -

          All locales were set to en_US

          Show
          Konstantin Boudnik added a comment - All locales were set to en_US
          Hide
          Mikhail Antonov added a comment -

          Still observed on fc19 with open jdk 1.7.0_45

          Show
          Mikhail Antonov added a comment - Still observed on fc19 with open jdk 1.7.0_45
          Hide
          Mikhail Antonov added a comment - - edited

          Seems to be caused by unicode-only symbols in hadoop-common:

          [mantonov@localhost bigtop]$ grep -Rl "ß" ./ | grep '\.java'
          ./build/hadoop/rpm/BUILD/hadoop-2.0.6-alpha-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/source/JvmMetricsInfo.java
          ./build/hadoop/rpm/BUILD/hadoop-2.0.6-alpha-src/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestGlobPattern.java
          [mantonov@localhost bigtop]$

          Show
          Mikhail Antonov added a comment - - edited Seems to be caused by unicode-only symbols in hadoop-common: [mantonov@localhost bigtop] $ grep -Rl "ß" ./ | grep '\.java' ./build/hadoop/rpm/BUILD/hadoop-2.0.6-alpha-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/source/JvmMetricsInfo.java ./build/hadoop/rpm/BUILD/hadoop-2.0.6-alpha-src/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestGlobPattern.java [mantonov@localhost bigtop] $
          Hide
          Mikhail Antonov added a comment -

          With fix made locally for maven encoding (hadoop-wise), this error has gone away.

          However, bigtop trunk still doesn't build on my machine with two problems (unrelated to this one).

          ) Ivy config for hive metastore looks incorrect. See http://dougchang333.blogspot.com/2013/11/hive-011-build-error-hive-metastore.html (instuction provided here helped, thanks Doug)

          2) hive-jdbc still doesn't compile: https://issues.apache.org/jira/browse/HIVE-3197

          errors like:

          Project: jdbc
          [javac] Compiling 28 source files to /projects/apache/bigtop/build/hive/rpm/BUILD/hive-0.11.0/src/build/jdbc/classes
          [javac] /projects/apache/bigtop/build/hive/rpm/BUILD/hive-0.11.0/src/jdbc/src/java/org/apache/hive/jdbc/HiveCallableStatement.java:48: error: HiveCallableStatement is not abstract and does not override abstract method <T>getObject(String,Class<T>) in CallableStatement
          [javac] public class HiveCallableStatement implements java.sql.CallableStatement {

          Show
          Mikhail Antonov added a comment - With fix made locally for maven encoding (hadoop-wise), this error has gone away. However, bigtop trunk still doesn't build on my machine with two problems (unrelated to this one). ) Ivy config for hive metastore looks incorrect. See http://dougchang333.blogspot.com/2013/11/hive-011-build-error-hive-metastore.html (instuction provided here helped, thanks Doug) 2) hive-jdbc still doesn't compile: https://issues.apache.org/jira/browse/HIVE-3197 errors like: Project: jdbc [javac] Compiling 28 source files to /projects/apache/bigtop/build/hive/rpm/BUILD/hive-0.11.0/src/build/jdbc/classes [javac] /projects/apache/bigtop/build/hive/rpm/BUILD/hive-0.11.0/src/jdbc/src/java/org/apache/hive/jdbc/HiveCallableStatement.java:48: error: HiveCallableStatement is not abstract and does not override abstract method <T>getObject(String,Class<T>) in CallableStatement [javac] public class HiveCallableStatement implements java.sql.CallableStatement {
          Hide
          Konstantin Boudnik added a comment -

          Hive doesn't build with JDK7 at all - we have put in about 20 patches to make it happen, so don't bother with the whole stack being buildable with JDK7.

          Could you please propose the patch to the Hadoop community and link this JIRA to it?

          Show
          Konstantin Boudnik added a comment - Hive doesn't build with JDK7 at all - we have put in about 20 patches to make it happen, so don't bother with the whole stack being buildable with JDK7. Could you please propose the patch to the Hadoop community and link this JIRA to it?
          Hide
          Mikhail Antonov added a comment -

          I sure will after some more local testing.

          Show
          Mikhail Antonov added a comment - I sure will after some more local testing.
          Hide
          Mikhail Antonov added a comment -
          Show
          Mikhail Antonov added a comment - https://issues.apache.org/jira/browse/HADOOP-10167 , patch is there
          Hide
          Konstantin Boudnik added a comment -

          BTW, u11 is pretty old. The current is like u51 or so

          Show
          Konstantin Boudnik added a comment - BTW, u11 is pretty old. The current is like u51 or so
          Hide
          Mikhail Antonov added a comment - - edited

          u11 was original version it was observed at. I've seen the same at the latest openjdk 7 back on December 11, 2013.

          Show
          Mikhail Antonov added a comment - - edited u11 was original version it was observed at. I've seen the same at the latest openjdk 7 back on December 11, 2013.
          Hide
          Konstantin Boudnik added a comment -

          HADOOP-10167 has been committed for a while. Do you still see the issue? If not - please close the ticket.

          Show
          Konstantin Boudnik added a comment - HADOOP-10167 has been committed for a while. Do you still see the issue? If not - please close the ticket.
          Hide
          Mikhail Antonov added a comment -

          I will test on jdk 7 and close this jira if the issue isn't observed anymore.

          Show
          Mikhail Antonov added a comment - I will test on jdk 7 and close this jira if the issue isn't observed anymore.

            People

            • Assignee:
              Mikhail Antonov
              Reporter:
              Konstantin Boudnik
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:

                Development