Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-521

INFORMATION_SCHEMA breaks if you have hive table with unsupported datatypes

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.4.0
    • Metadata
    • None

    Description

      repro:
      Create some hive tables having datatypes which are valid in drill. Ie no struct, arrays etc.

      Select * from INFORMATION_SCHEMA.TABLES works at this point.

      Create a hive table containing complex data types: Example:

      CREATE TABLE test_serializer(string1 STRING,
      int1 INT,
      tinyint1 TINYINT,
      smallint1 SMALLINT,
      bigint1 BIGINT,
      boolean1 BOOLEAN,
      float1 FLOAT,
      double1 DOUBLE,
      list1 ARRAY<STRING>,
      map1 MAP<STRING,INT>,
      struct1 STRUCT<sint:INT,sboolean:BOOLEAN,sstring:STRING>,
      enum1 STRING,
      nullableint INT,
      bytes1 BINARY,
      fixed1 BINARY)
      ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' COLLECTION ITEMS TERMINATED BY ':' MAP KEYS TERMINATED BY '#' LINES TERMINATED BY '\n'
      STORED AS TEXTFILE;

      After this INFORMATION_SCHEMA queries fail with
      message: "Failure while parsing sql. < ValidationException:[ java.lang.RuntimeException: Unknown or unsupported hive type ] < RuntimeException:[ Unknown or unsupported hive type ]"

      Attachments

        1. DRILL-521-1.patch
          16 kB
          Venki Korukanti

        Activity

          People

            vkorukanti Venki Korukanti
            inramana Ramana Inukonda Nagaraj
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: