Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-5037

NPE in Parquet Decimal Converter with the complex parquet reader

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.9.0
    • 1.12.0
    • Storage - Parquet
    • None

    Description

      git.commit.id.abbrev=4b1902c

      The below query fails when we enable the new parquet reader

      Query :

      alter session set `store.parquet.use_new_reader` = true;
       select
                       count(*)			as count_star,
       		sum(a.d18)		as sum_d18,
       		--round(avg(a.d18))	as round_avg_d18,
       		cast(avg(a.d18) as bigint)	as round_avg_d18,
       		--trunc(avg(a.d18))	as trunc_avg_d18,
       		cast(avg(a.d18) as bigint)	as trunc_avg_d18,
       		--sum(case when a.d18 = 0 then 100 else round(a.d18/12) end) as case_in_sum_d18,
       		cast(sum(case when a.d18 = 0 then 100 else round(a.d18/12) end) as bigint) as case_in_sum_d18,
       		--coalesce(sum(case when a.d18 = 0 then 100 else round(a.d18/12) end), 0) as case_in_sum_d18
       		cast(coalesce(sum(case when a.d18 = 0 then 100 else round(a.d18/12) end), 0) as bigint) as case_in_sum_d18
       
      from
       		alltypes_with_nulls a
      		left outer join alltypes_with_nulls b on (a.c_integer = b.c_integer)
      		left outer join alltypes_with_nulls c on (b.c_integer = c.c_integer)
      group by
        		a.c_varchar
       		,b.c_varchar
       		,c.c_varchar
       		,a.c_integer
       		,b.c_integer
       		,c.c_integer
       		,a.d9
       		,b.d9
       		,c.d9
       		,a.d18
       		,b.d18
       		,c.d18
       		,a.d28
       		,b.d28
       		,c.d28
       		,a.d38
       		,b.d38
       		,c.d38
       		,a.c_date
       		,b.c_date
       		,c.c_date
       		,a.c_date
       		,b.c_date
       		,c.c_date
       		,a.c_time
      
       order by
        		a.c_varchar
       		,b.c_varchar
       		,c.c_varchar
       		,a.c_integer
       		,b.c_integer
       		,c.c_integer
       		,a.d9
       		,b.d9
       		,c.d9
       		,a.d18
       		,b.d18
       		,c.d18
       		,a.d28
       		,b.d28
       		,c.d28
       		,a.d38
       		,b.d38
       		,c.d38
       		,a.c_date
       		,b.c_date
       		,c.c_date
       		,a.c_date
       		,b.c_date
       		,c.c_date
       		,a.c_time
      

      I attached the data set and error from the log file

      Attachments

        1. drill5037.parquet
          10 kB
          Rahul Kumar Challapalli
        2. 0001-Fix-the-DecimalX-writer-invocation-in-DrillParquetGr.patch
          2 kB
          Guillaume Balaine

        Activity

          People

            Unassigned Unassigned
            rkins Rahul Kumar Challapalli
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: