Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-1421

Auto Compaction Failing in CarbonData Loading

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.2.0
    • Component/s: data-load
    • Labels:
      None

      Description

      I ran the create query followed by multiple load queries and the auto-compaction is failing.

      0: jdbc:hive2://localhost:10000> LOAD DATA inpath 'hdfs://localhost:54310/data/4000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1');
      ---------+

      Result

      ---------+
      ---------+
      No rows selected (1.183 seconds)
      0: jdbc:hive2://localhost:10000> LOAD DATA inpath 'hdfs://localhost:54310/data/5000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1');
      Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. Please check logs. (state=,code=0)
      0: jdbc:hive2://localhost:10000> LOAD DATA inpath 'hdfs://localhost:54310/data/7000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1');
      Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. Please check logs. (state=,code=0)
      0: jdbc:hive2://localhost:10000>
      0: jdbc:hive2://localhost:10000>
      0: jdbc:hive2://localhost:10000>
      0: jdbc:hive2://localhost:10000>
      0: jdbc:hive2://localhost:10000>
      0: jdbc:hive2://localhost:10000>
      0: jdbc:hive2://localhost:10000>
      0: jdbc:hive2://localhost:10000> show segments for table uniqdata;
      ----------------------------------------------------------------------------

      SegmentSequenceId Status Load Start Time Load End Time

      ----------------------------------------------------------------------------

      4 Success 2017-08-29 10:37:13.053 2017-08-29 10:37:13.888
      3 Success 2017-08-29 10:36:57.851 2017-08-29 10:36:59.08
      2 Success 2017-08-29 10:36:49.439 2017-08-29 10:36:50.373
      1 Success 2017-08-29 10:36:37.365 2017-08-29 10:36:38.768
      0 Success 2017-08-29 10:36:21.011 2017-08-29 10:36:26.1

      ----------------------------------------------------------------------------
      5 rows selected (0.099 seconds)
      0: jdbc:hive2://localhost:10000> LOAD DATA inpath 'hdfs://localhost:54310/data/7000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1');
      Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. Please check logs. (state=,code=0)
      0: jdbc:hive2://localhost:10000> show segments for table uniqdata;
      ----------------------------------------------------------------------------

      SegmentSequenceId Status Load Start Time Load End Time

      ----------------------------------------------------------------------------

      5 Success 2017-08-29 10:38:15.727 2017-08-29 10:38:16.548
      4 Success 2017-08-29 10:37:13.053 2017-08-29 10:37:13.888
      3 Success 2017-08-29 10:36:57.851 2017-08-29 10:36:59.08
      2 Success 2017-08-29 10:36:49.439 2017-08-29 10:36:50.373
      1 Success 2017-08-29 10:36:37.365 2017-08-29 10:36:38.768
      0 Success 2017-08-29 10:36:21.011 2017-08-29 10:36:26.1

      ----------------------------------------------------------------------------

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              pallavisingh_09 Pallavi Singh
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: