Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6794

select * from parquet hive table containing map columns runs into exception

    XMLWordPrintableJSON

Details

    Description

      select * from parquet hive table containing map columns run into exception "FAILED: RuntimeException java.lang.ClassCastException: parquet.hive.serde.DeepParquetHiveMapInspector cannot be cast to parquet.hive.serde.StandardParquetHiveMapInspector"

      To reproduce, use the following steps (both regular_map_table and parquet_map_table contains schema "c1 , c2 int"):

      hive> insert overwrite table parquet_map_table select * from regular_map_table;
      hive> select * from parquet_map_table; (the first query to select * works fine )

      OK

      {"key1":"value1"}

      1

      {"key2":"value2"}

      2

      {"key3":"value3"}

      3
      Time taken: 2.669 seconds, Fetched: 3 row(s)
      hive> select * from parquet_map_table; (the second and all subsequent exact same query breaks)

      FAILED: RuntimeException java.lang.ClassCastException: parquet.hive.serde.DeepParquetHiveMapInspector cannot be cast to parquet.hive.serde.StandardParquetHiveMapInspector

      Interestingly "select c1 from parquet_map_column" query works fine though.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              tongjie Tongjie Chen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: