Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-1623

COUNT (*) query with a filter does not work over partitioned data in text and json formats

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • None
    • 0.7.0
    • None
    • None

    Description

      git.commit.id.abbrev=6dca24a

      The below 2 queries fail. The underlying data is partitioned and is one level deep.

      Text Query :

      select count(*) from lineitem_text where dir0=1993;
      
      Query failed: Failure while running fragment. Readers needs at least a column to read. [499ab624-616a-409a-a93c-c1dc9a0d31b1]
      
      Error: exception while executing query: Failure while trying to get next result batch. (state=,code=0)
      

      Json Query :

      select count(*) from orders_json where dir0=1993
      
      Query failed: Failure while running fragment. json record reader requires at least a column [dc7cfa54-6d6f-4bf3-a0f2-38da9e58ace9]
      
      Error: exception while executing query: Failure while trying to get next result batch. (state=,code=0)
      

      When I tested this against parquet and hive they seem to be having no issues.

      Attached the data, logs and plans for the above 2 queries

      Attachments

        1. lineitem_text.zip
          1.96 MB
          Rahul Kumar Challapalli
        2. orders_json.zip
          564 kB
          Rahul Kumar Challapalli
        3. json.plan
          8 kB
          Rahul Kumar Challapalli
        4. text.plan
          8 kB
          Rahul Kumar Challapalli
        5. json.error
          13 kB
          Rahul Kumar Challapalli
        6. text.error
          12 kB
          Rahul Kumar Challapalli

        Issue Links

          Activity

            People

              Unassigned Unassigned
              rkins Rahul Kumar Challapalli
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: