[SPARK-19321] Support Hive 2.x's metastore - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Duplicate
Affects Version/s: None
Fix Version/s: None
Component/s: SQL
Labels:
None

Description

It will be good to make Spark work with Hive 2.x's metastores.

We need to add needed shim classes in https://github.com/apache/spark/blob/master/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala. Make IsolatedClientLoader recognize new versions of metastores (https://github.com/apache/spark/blob/master/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala). Finally, we want to add tests in https://github.com/apache/spark/blob/master/sql/hive/src/test/scala/org/apache/spark/sql/hive/client/VersionsSuite.scala.

Attachments

Issue Links

duplicates

SPARK-13446 Spark need to support reading data from Hive 2.0.0 metastore

Resolved

Activity

People

Assignee:: Unassigned

Reporter:: Yin Huai

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 21/Jan/17 02:39

Updated:: 21/Jan/17 13:52

Resolved:: 21/Jan/17 13:52