Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-1429

data type confusion between kudu and impala tables

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Duplicate
    • 0.8.0
    • 0.9.0
    • impala
    • None

    Description

      CREATE TABLE ppo_test1 (
      ts_id SMALLINT,
      input_seq BIGINT,
      output_seq BIGINT,
      d_id INT,
      input_id SMALLINT,
      output_id SMALLINT,
      input_value DOUBLE,
      audit_id INT,
      is_uo TINYINT
      ) TBLPROPERTIES (
      'kudu.master_addresses'='master:7051',
      'kudu.num_tablet_replicas'='3',
      'kudu.key_columns'='ts_id,input_seq,output_seq',
      'kudu.table_name'='ppo_test1',
      'storage_handler'='com.cloudera.kudu.hive.KuduStorageHandler');

      CREATE TABLE temp_4141 (
      input_seq BIGINT,
      output_seq BIGINT,
      d_id INT,
      input_id SMALLINT,
      output_id SMALLINT,
      input_value DOUBLE,
      audit_id INT,
      is_uo BOOLEAN,
      ts_id SMALLINT
      ) ROW FORMAT DELIMITED FIELDS TERMINATED BY '|' STORED AS TEXTFILE;

      [impala07:21000] > select * from ppo_test1;
      Query: select * from ppo_test1
      ---------------------------------------------------------------------------------------------

      ts_id input_seq output_seq d_id input_id output_id input_value audit_id is_uo

      ---------------------------------------------------------------------------------------------

      253 158236666882949127 158800218131791879 7 562 564 1432.777832 441 0
      253 158236666882949128 158800218131791880 8 562 564 111 325 0
      253 158236666882949129 158800218131791881 9 562 564 1403.632446 441 0
      253 158236666882949130 158800218131791882 10 562 564 1452.579346 441 0
      253 158236666882949131 158800218131791883 11 562 564 1545.86084 441 0
      295 158518141859661663 158518923543709535 1887 563 563 1394.196899 591 0
      295 159925516743214944 159926298427262816 1888 568 568 1317.554688 591 0
      295 164429116370585440 164429898054633312 1888 584 584 1313.598755 591 0
      295 164992066324006752 164992848008054624 1888 586 586 1313.598511 591 0

      ---------------------------------------------------------------------------------------------
      Fetched 9 row(s) in 0.17s
      [impala07:21000] > select * from temp_4141;
      Query: select * from temp_4141
      ----------------------------------------------------------------------------------------

      input_seq output_seq d_id input_id output_id input_value audit_id is_uo ts_id

      ----------------------------------------------------------------------------------------

      164992066324006752 164992848008054624 1888 586 586 1313.598511 965 false 295
      164429116370585440 164429898054633312 1888 584 584 1313.598755 965 false 295
      159925516743214944 159926298427262816 1888 568 568 1317.554688 965 false 295
      160488466696636256 160489248380684128 1888 570 570 1314.795288 965 false 295
      158518141859661663 158518923543709535 1887 563 563 1394.196899 965 false 295

      ----------------------------------------------------------------------------------------
      Fetched 5 row(s) in 0.93s
      [impala07:21000] > DELETE ppo from ppo_test1 ppo where output_seq in (select distinct output_seq FROM temp_4141);
      Query: delete ppo from ppo_test1 ppo where output_seq in (select distinct output_seq FROM temp_4141)
      WARNINGS:
      Could not add Kudu WriteOp.: Invalid argument: invalid type int64 provided for column 'ts_id' (expected int16)

      Could not add Kudu WriteOp.: Invalid argument: invalid type int64 provided for column 'ts_id' (expected int16)

      [impala07:21000] >

      Attachments

        Activity

          People

            caseyching Casey Ching
            nickwolf7 nick
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: