Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4323

Hive Native Reader : A simple count(*) throws Incoming batch has an empty schema error

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 1.5.0
    • 1.6.0
    • Storage - Hive
    • None

    Description

      git.commit.id.abbrev=3d0b4b0

      A simple count query does not work when hive native reader is enabled

      0: jdbc:drill:zk=10.10.100.190:5181> select count(*) from customer;
      +---------+
      | EXPR$0  |
      +---------+
      | 100000  |
      +---------+
      1 row selected (3.074 seconds)
      0: jdbc:drill:zk=10.10.100.190:5181> alter session set `store.hive.optimize_scan_with_native_readers` = true;
      +-------+--------------------------------------------------------+
      |  ok   |                        summary                         |
      +-------+--------------------------------------------------------+
      | true  | store.hive.optimize_scan_with_native_readers updated.  |
      +-------+--------------------------------------------------------+
      1 row selected (0.2 seconds)
      0: jdbc:drill:zk=10.10.100.190:5181> select count(*) from customer;
      Error: SYSTEM ERROR: IllegalStateException: Incoming batch [#1341, ProjectRecordBatch] has an empty schema. This is not allowed.
      
      Fragment 0:0
      
      [Error Id: 4c867440-0fd3-4eda-922f-0f5eadcb1463 on qa-node191.qa.lab:31010] (state=,code=0)
      

      Hive DDL for the table :

      create table customer
      (
          c_customer_sk int,
          c_customer_id string,
          c_current_cdemo_sk int,
          c_current_hdemo_sk int,
          c_current_addr_sk int,
          c_first_shipto_date_sk int,
          c_first_sales_date_sk int,
          c_salutation string,
          c_first_name string,
          c_last_name string,
          c_preferred_cust_flag string,
          c_birth_day int,
          c_birth_month int,
          c_birth_year int,
          c_birth_country string,
          c_login string,
          c_email_address string,
          c_last_review_date string
      )
      STORED AS PARQUET
      LOCATION '/drill/testdata/customer'
      

      Attached the log file with the stacktrace

      Attachments

        1. error.log
          61 kB
          Rahul Kumar Challapalli

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            seanhychu Sean Hsuan-Yi Chu
            rkins Rahul Kumar Challapalli
            Rahul Kumar Challapalli Rahul Kumar Challapalli
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment