[HIVE-3632] Upgrade datanucleus to support JDK7

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.9.1, 0.10.0, 0.11.0
• Fix Version/s: 0.12.0
• Component/s: Metastore
• Assignee: Xuefu Zhang
• Reporter: Chris Drome
• Created: 29/Oct/12 05:41
• Updated: 15/Oct/13 23:29
• Resolved: 26/Jul/13 15:35

Description

I found serious problems with datanucleus code when using JDK7, resulting in some sort of exception being thrown when datanucleus code is entered.

I tried source=1.7, target=1.7 with JDK7 as well as source=1.6, target=1.6 with JDK7 and there was no visible difference in that the same unit tests failed.

I tried upgrading datanucleus to 3.0.1, as per HIVE-2084.patch, which did not fix the failing tests.

I tried upgrading datanucleus to 3.1-release, as per the advise of http://www.datanucleus.org/servlet/jira/browse/NUCENHANCER-86, which suggests using ASMv4 will allow datanucleus to work with JDK7. I was not successful with this either.

I tried upgrading datanucleus to 3.1.2. I was not successful with this either.

Regarding datanucleus support for JDK7+, there is the following JIRA

http://www.datanucleus.org/servlet/jira/browse/NUCENHANCER-81

which suggests that they don't plan to actively support JDK7+ bytecode any time soon.

I also tested the following JVM parameters found on

http://veerasundar.com/blog/2012/01/java-lang-verifyerror-expecting-a-stackmap-frame-at-branch-target-jdk-7/

with no success either.

This will become a more serious problem as people move to newer JVMs. If there are other who have solved this issue, please post how this was done. Otherwise, it is a topic that I would like to raise for discussion.

Test Properties:
CLEAR LIBRARY CACHE

Issue Links

• breaks: HIVE-5218 datanucleus does not work with MS SQLServer in Hive metastore
• breaks: HIVE-4942 Fix eclipse template files to use correct datanucleus libs
• is blocked by: HIVE-4900 Fix the mismatched column names in package.jdo
• is depended upon by: HIVE-4583 Make Hive compile and run with JDK7
• is related to: HIVE-2609 NPE when pruning partitions by thrift method get_partitions_by_filter
• is related to: HIVE-2084 Upgrade datanucleus from 2.0.3 to a more recent version (3.?)