[#HIVE-445] Upgrade JPOX to datanuclues plugins

Hadoop Hive

Upgrade JPOX to datanuclues plugins

Created: 25/Apr/09 01:42 AM Updated: 02/Jul/09 06:01 PM

Return to search

Component/s:

Metastore

Affects Version/s:

0.4.0

Fix Version/s:

0.4.0

Time Tracking:

Not Specified

File Attachments:

File Name	Date Attached	Attached By	Size
datanucleus-core-1.1.2.jar	2009-04-25 05:32 AM	Prasad Chakka	1.82 MB
datanucleus-enhancer-1.1.2.jar	2009-04-25 05:32 AM	Prasad Chakka	172 kB
datanucleus-rdbms-1.1.2.jar	2009-04-25 05:33 AM	Prasad Chakka	1.10 MB
hive-445.2.patch	2009-04-25 05:45 AM	Prasad Chakka	3 kB
hive-445.3.patch	2009-07-02 02:48 AM	Prasad Chakka	93 kB
hive-445.4.patch	2009-07-02 02:57 AM	Prasad Chakka	93 kB
hive-445.patch	2009-04-25 05:32 AM	Prasad Chakka	92 kB
jdo2-api-2.3-SNAPSHOT.jar	2009-04-25 05:33 AM	Prasad Chakka	175 kB

Issue Links:

Blocker

This issue blocks:

~~HIVE-592~~ renaming internal table should rename HDFS and also change path of the table and partitions accordingly.

Hadoop Flags:	Reviewed
Release Note:	~~HIVE-445~~. Upgrade JPOX to datanuclues plugins. (Prasad Chakka via zshao)
Resolution Date:	02/Jul/09 06:01 PM

Description

« Hide

JPOX is renamed as datanucleus and there have been lot of changes to the class names and jars. If we want any improvements we need to migrate to the new version.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

[ Permlink | « Hide ]

Prasad Chakka added a comment - 25/Apr/09 01:42 AM

There are some instructions here on the bottom of this link
http://www.datanucleus.org/products/accessplatform_1_0/migration.html

[ Permlink | « Hide ]

Prasad Chakka added a comment - 25/Apr/09 01:43 AM

http://www.datanucleus.org/products/accessplatform_1_1/migration.html

[ Permlink | « Hide ]

Prasad Chakka added a comment - 25/Apr/09 05:32 AM

patch to upgrade.. everything seems to work fine except that the model enhancer is run through special ant target which has to be supplied from commandline using ant -lib lib/datanucleus-enhancer-1.1.2.jar which can be a pain. need to find a way to do this better.

[ Permlink | « Hide ]

Prasad Chakka added a comment - 25/Apr/09 05:33 AM

jpox-*.jar and jdo2-api-2.1.jar should be removed

[ Permlink | « Hide ]

Prasad Chakka added a comment - 25/Apr/09 05:45 AM

this fixes the classpath issue

[ Permlink | « Hide ]

Zheng Shao added a comment - 27/Apr/09 06:17 PM

Talked with Prasad offline. Prasad will do more tests before this will be committed.

[ Permlink | « Hide ]

Prasad Chakka added a comment - 27/Apr/09 06:23 PM

all unit tests pass but i have not yet tested this for backward compatibility. otherwise it is good

[ Permlink | « Hide ]

Prasad Chakka added a comment - 02/Jul/09 12:56 AM

we need latest version of jpox to change locations easily. with current version i am hitting a bug in jpox that is fixed in the latest version.

[ Permlink | « Hide ]

Prasad Chakka added a comment - 02/Jul/09 12:57 AM

can any one check this in?

[ Permlink | « Hide ]

Zheng Shao added a comment - 02/Jul/09 01:16 AM

~~HIVE-445~~.2.patch is generate from metastore directory not the root.

Also ~~HIVE-445~~.2 patch contains some of the changes of ~~HIVE-445~~.patch. I am seeing:

[zshao@ xxx] patch -p0 -i ../hive-445.2.patch
patching file src/test/org/apache/hadoop/hive/metastore/TestHiveMetaStore.java
Reversed (or previously applied) patch detected! Assume -R? [n]

[ Permlink | « Hide ]

Prasad Chakka added a comment - 02/Jul/09 01:17 AM

ok will upload patch soon

[ Permlink | « Hide ]

Prasad Chakka added a comment - 02/Jul/09 02:51 AM

need to specify '-lib ./lib' option to ant to compile

[ Permlink | « Hide ]

Prasad Chakka added a comment - 02/Jul/09 02:57 AM

this patch doesn't require the -lib option.

[ Permlink | « Hide ]

Zheng Shao added a comment - 02/Jul/09 09:02 AM

Just to double check: hive-445.4.patch and all jars are what we want. Correct?

[ Permlink | « Hide ]

Prasad Chakka added a comment - 02/Jul/09 02:43 PM

yes.

[ Permlink | « Hide ]

Zheng Shao added a comment - 02/Jul/09 06:01 PM

Committed. Thanks Prasad.