Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-678

Corr function is not working for double datatype.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Trivial
    • Resolution: Fixed
    • 1.0.0-incubating
    • 1.1.0
    • sql
    • None
    • Spark 1.6

    Description

      We have created a table uniqdata_h and then we upload data in this table then we perform select query having data-type double then it displays null value but when we perform select query with integer or bigint data-type it displays a value.
      "Double" data-type is not working.

      CREATE QUERY :
      0: jdbc:hive2://localhost:10000> CREATE TABLE uniqdata_h (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 int) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',';
      ---------+

      result

      ---------+
      ---------+
      No rows selected (4.249 seconds)

      LOAD 1 :
      0: jdbc:hive2://localhost:10000> load data local inpath '/opt/Carbon/CarbonData/TestData/Data/uniqdata/2000_UniqData.csv' into table uniqdata_h;
      ---------+

      Result

      ---------+
      ---------+
      No rows selected (1.176 seconds)

      LOAD 2 :
      0: jdbc:hive2://localhost:10000> load data local inpath '/opt/Carbon/CarbonData/TestData/Data/uniqdata/4000_UniqData.csv' into table uniqdata_h;
      ---------+

      Result

      ---------+
      ---------+
      No rows selected (0.485 seconds)

      LOAD 3 :
      0: jdbc:hive2://localhost:10000> load data local inpath '/opt/Carbon/CarbonData/TestData/Data/uniqdata/5000_UniqData.csv' into table uniqdata_h;
      ---------+

      Result

      ---------+
      ---------+
      No rows selected (0.365 seconds)

      LOAD 4 :
      0: jdbc:hive2://localhost:10000> load data local inpath '/opt/Carbon/CarbonData/TestData/Data/uniqdata/6000_UniqData.csv' into table uniqdata_h;
      ---------+

      Result

      ---------+
      ---------+
      No rows selected (0.594 seconds)

      LOAD 5 :
      0: jdbc:hive2://localhost:10000> load data local inpath '/opt/Carbon/CarbonData/TestData/Data/uniqdata/7000_UniqData.csv' into table uniqdata_h;
      ---------+

      Result

      ---------+
      ---------+
      No rows selected (0.753 seconds)

      LOAD 6 :
      0: jdbc:hive2://localhost:10000> load data local inpath '/opt/Carbon/CarbonData/TestData/Data/uniqdata/3000_1_UniqData.csv' into table uniqdata_h;
      ---------+

      Result

      ---------+
      ---------+
      No rows selected (0.417 seconds)

      SELECT QUERY : double data-type displays NULL value
      0: jdbc:hive2://localhost:10000> select corr(Double_COLUMN1,Double_COLUMN1) as a from uniqdata_h ;
      -------+

      a

      -------+

      NULL

      -------+

      whereas select query with integer & bigdata type displays some value.

      0: jdbc:hive2://localhost:10000> select corr(integer_COLUMN1,bigint_COLUMN1) as a from uniqdata_h ;
      ---------------------+

      a

      ---------------------+

      1.0000000000000002

      ---------------------+
      1 row selected (0.54 seconds)

      Attachments

        1. 7000_UniqData.csv
          1.44 MB
          SWATI RAO
        2. 6000_UniqData.csv
          1.23 MB
          SWATI RAO
        3. 5000_UniqData.csv
          1.02 MB
          SWATI RAO
        4. 4000_UniqData.csv
          836 kB
          SWATI RAO
        5. 3000_1_UniqData.csv
          630 kB
          SWATI RAO
        6. 2000_UniqData.csv
          416 kB
          SWATI RAO

        Activity

          People

            Unassigned Unassigned
            swati.rao SWATI RAO
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: