Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-1121

IllegalStateException upon JOIN of DECIMAL columns with different precision

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 2.0
    • Impala 2.0
    • None
    • None

    Description

      This is using CDH4, I didnt try CDH5.

      A JOIN on DECIMAL columns seems to work if they are of the same (integral, fractional) values but if they differ, then a IllegalStateException occurs.

      [localhost:21000] > create table foo (c decimal(2,1));
      Query: create table foo (c decimal(2,1))
      
      Returned 0 row(s) in 0.11s
      WARNINGS: DECIMAL columns are not supported by every component of CDH4, particularly Hive. Impala can read and write these columns, but Hive cannot. This means data written in this table might not be readable by the other components.
      
      
      [localhost:21000] > create table bar (c decimal(3,1));
      Query: create table bar (c decimal(3,1))
      
      Returned 0 row(s) in 0.11s
      WARNINGS: DECIMAL columns are not supported by every component of CDH4, particularly Hive. Impala can read and write these columns, but Hive cannot. This means data written in this table might not be readable by the other components.
      
      
      [localhost:21000] > select * from foo f join bar b on b.c = f.c;
      Query: select * from foo f join bar b on b.c = f.c
      ERROR: IllegalStateException: null
      
      
      [localhost:21000] > create table baz (c decimal(3,1));
      Query: create table baz (c decimal(3,1))
      
      Returned 0 row(s) in 0.07s
      WARNINGS: DECIMAL columns are not supported by every component of CDH4, particularly Hive. Impala can read and write these columns, but Hive cannot. This means data written in this table might not be readable by the other components.
      
      
      [localhost:21000] > select * from bar b join baz z on z.c = b.c;
      Query: select * from bar b join baz z on z.c = b.c
      
      Returned 0 row(s) in 1.70s
      

      Attachments

        Activity

          People

            nong_impala_60e1 Nong Li
            caseyc casey
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: