Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-2606

Casting a column from hbase to boolean after a join with parquet makes DRILL unresponsive

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.8.0
    • 0.9.0
    • Execution - Flow
    • None

    Description

      Small scale repro without HBase:

      alter session set `planner.slice_target`=1;
      select cast(cast(bool_col  as varchar(100)) as boolean) from dfs.`/Users/hadoop/Downloads/fewtypes_null.parquet` order by int_col;
      

      git.commit.id.abbrev=4d398ed

      The below query never returns and causes Sqlline to hang. DRILL also becomes unresponsive after executing this query. So I have to restart drill for sqlline to even come up.

      select cast(cast(o.types.bool_col as varchar(100)) as boolean) bool_col
      from dfs.`cross-sources`.`fewtypes_null.parquet` p
      inner join hbase.fewtypes_null o
          on p.int_col = cast(cast(o.types.int_col as varchar(100)) as int)
      

      This issue is similar to DRILL-2605. However in this case I did not use a view and some this causes drill/sqlline to become unresponsive where in DRILL-2605 we just get back an error.

      I attached the data files, data loading script, and the error log. Let me know if you need anything else.

      Attachments

        1. error.log
          17 kB
          Rahul Kumar Challapalli
        2. dataload.hql
          1 kB
          Rahul Kumar Challapalli
        3. fewtypes_null_hbase.tbl
          2 kB
          Rahul Kumar Challapalli
        4. fewtypes_null.parquet
          2 kB
          Rahul Kumar Challapalli
        5. DRILL-2606-1.patch
          3 kB
          Venki Korukanti
        6. DRILL-2606-2.patch
          5 kB
          Venki Korukanti

        Issue Links

          Activity

            People

              vkorukanti Venki Korukanti
              rkins Rahul Kumar Challapalli
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: