Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-4173

Fix inverted index query issue

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.2.0
    • None
    • None

    Description

       select query with filter column which is present in inverted_index column does not return any value

      From Spark beeline/SQL/Shell execute the following queries

      drop table if exists uniqdata6;

      CREATE TABLE uniqdata6(cust_id int,cust_name string,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double, INTEGER_COLUMN1 int)stored as carbondata TBLPROPERTIES ('sort_columns'='CUST_ID,CUST_NAME', 'inverted_index'='CUST_ID,CUST_NAME','sort_scope'='global_sort');

      LOAD DATA INPATH 'hdfs://hacluster/chetan/2000_UniqData.csv' into table uniqdata6 OPTIONS ('FILEHEADER'='CUST_ID,CUST_NAME ,ACTIVE_EMUI_VERSION,DOB,DOJ, BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1, Double_COLUMN2,INTEGER_COLUMN1','BAD_RECORDS_ACTION'='FORCE');

      select cust_name from uniqdata6 limit 5;

      select * from uniqdata6 where CUST_NAME='CUST_NAME_00002';

      select * from uniqdata6 where CUST_NAME='CUST_NAME_00003';

       

      [Expected Result] :- select query with filter column which is present in inverted_index column should return correct value

      [Actual Issue] : - select query with filter column which is present in inverted_index column does not return any value

      Attachments

        Activity

          People

            Unassigned Unassigned
            Shreelekhya SHREELEKHYA GAMPA
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 3h
                3h