Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4323

Hive Native Reader : A simple count(*) throws Incoming batch has an empty schema error

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 1.5.0
    • Fix Version/s: 1.6.0
    • Component/s: Storage - Hive
    • Labels:
      None

      Description

      git.commit.id.abbrev=3d0b4b0

      A simple count query does not work when hive native reader is enabled

      0: jdbc:drill:zk=10.10.100.190:5181> select count(*) from customer;
      +---------+
      | EXPR$0  |
      +---------+
      | 100000  |
      +---------+
      1 row selected (3.074 seconds)
      0: jdbc:drill:zk=10.10.100.190:5181> alter session set `store.hive.optimize_scan_with_native_readers` = true;
      +-------+--------------------------------------------------------+
      |  ok   |                        summary                         |
      +-------+--------------------------------------------------------+
      | true  | store.hive.optimize_scan_with_native_readers updated.  |
      +-------+--------------------------------------------------------+
      1 row selected (0.2 seconds)
      0: jdbc:drill:zk=10.10.100.190:5181> select count(*) from customer;
      Error: SYSTEM ERROR: IllegalStateException: Incoming batch [#1341, ProjectRecordBatch] has an empty schema. This is not allowed.
      
      Fragment 0:0
      
      [Error Id: 4c867440-0fd3-4eda-922f-0f5eadcb1463 on qa-node191.qa.lab:31010] (state=,code=0)
      

      Hive DDL for the table :

      create table customer
      (
          c_customer_sk int,
          c_customer_id string,
          c_current_cdemo_sk int,
          c_current_hdemo_sk int,
          c_current_addr_sk int,
          c_first_shipto_date_sk int,
          c_first_sales_date_sk int,
          c_salutation string,
          c_first_name string,
          c_last_name string,
          c_preferred_cust_flag string,
          c_birth_day int,
          c_birth_month int,
          c_birth_year int,
          c_birth_country string,
          c_login string,
          c_email_address string,
          c_last_review_date string
      )
      STORED AS PARQUET
      LOCATION '/drill/testdata/customer'
      

      Attached the log file with the stacktrace

        Attachments

        1. error.log
          61 kB
          Rahul Kumar Challapalli

          Activity

            People

            • Assignee:
              seanhychu Sean Hsuan-Yi Chu
              Reporter:
              rkins Rahul Kumar Challapalli
              Reviewer:
              Rahul Kumar Challapalli
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: