[SPARK-13129] Spark SQL can't query hive table, which is create by Hive HCatalog Streaming API

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 1.6.0
• Component/s: SQL
• Labels: hive orc sparksql

Environment

hadoop version: 2.5.0-cdh5.3.2
hive version: 0.13.1
spark version: 1.6.0

• Assignee: Unassigned
• Reporter: Tao Li
• Created: 02/Feb/16 05:06
• Updated: 07/Feb/16 09:16
• Resolved: 07/Feb/16 09:16

Description

I create a Hive table using Hive HCatalog Streaming API.
https://cwiki.apache.org/confluence/display/Hive/Streaming+Data+Ingest

The hive table is streaming data ingested by flume hive sink. And I can query the hive table using hive command line.

But I can't query the hive table using spark-sql command line. Is it spark sql's bug or a unimplemented feature?

The hive storage file is ORC format with ACID support.
http://orc.apache.org/docs/acid.html