Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13129

Spark SQL can't query hive table, which is create by Hive HCatalog Streaming API

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Problem
    • Affects Version/s: 1.6.0
    • Fix Version/s: None
    • Component/s: SQL
    • Labels:
    • Environment:

      hadoop version: 2.5.0-cdh5.3.2
      hive version: 0.13.1
      spark version: 1.6.0

      Description

      I create a Hive table using Hive HCatalog Streaming API.
      https://cwiki.apache.org/confluence/display/Hive/Streaming+Data+Ingest

      The hive table is streaming data ingested by flume hive sink. And I can query the hive table using hive command line.

      But I can't query the hive table using spark-sql command line. Is it spark sql's bug or a unimplemented feature?

      The hive storage file is ORC format with ACID support.
      http://orc.apache.org/docs/acid.html

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              litao1990 Tao Li
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: