Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21702

Queries with filter on a partition column fail when using standalone metastore

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Resolved
    • 3.1.0
    • None
    • None
    • HDP 3.1 on AWS (Hive 3.1.0)
      Standalone metastore on an EC2 instance (using hive-standalone-metastore-3.1.0.3.1.0.0-78.jar)

    Description

      Queries with filter on a partition column fail when using standalone metastore

      Example (Hiveserver2 is pointing to a standalone metastore instance)
      create table test_a_src (id integer, value varchar(255), run_id varchar(14)) row format delimited fields terminated by ','stored as textfile;

      create table test_a (id integer, value varchar(255)) partitioned by (run_id varchar(14))row format delimited fields terminated by ','stored as textfile;

      <Upload a csv file to test_a_src data directory - test file is }}{{attached>

      insert into test_a select * from test_a_src;

      select id from test_a where run_id = '20190502123500';
      Error: Error while compiling statement: FAILED: SemanticException MetaException(message:java.lang.UnsupportedOperationException) (state=42000,code=40000)

      The same queries work fine when using the embedded metastore. Filters on any other column work fine as well. The problem is with partition columns.

      An excerpt from hiveserver2.log is attached.

      Attachments

        1. hiveserver_ex.log
          13 kB
          Igor Bezuglyi
        2. metastore.log
          153 kB
          Igor Bezuglyi
        3. table_data_a.csv
          33 kB
          Igor Bezuglyi

        Activity

          People

            Rajkumar Singh Rajkumar Singh
            brenagwynn Igor Bezuglyi
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: