Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-1422

Major and Minor Compaction Failing

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.2.0
    • Component/s: None
    • Labels:
      None

      Description

      The major and minor compaction is failing.

      The Compaction is failing in the default scenario where the table property dictionary_include is not specified which is the default behaviour.
      Please find the error logs below :

      0: jdbc:hive2://localhost:10000> show segments for table uniqdata;
      ----------------------------------------------------------------------------

      SegmentSequenceId Status Load Start Time Load End Time

      ----------------------------------------------------------------------------

      9 Success 2017-08-29 11:17:29.927 2017-08-29 11:17:30.555
      8 Success 2017-08-29 11:17:27.572 2017-08-29 11:17:28.363
      7 Success 2017-08-29 11:17:23.583 2017-08-29 11:17:25.112
      6 Success 2017-08-29 11:17:07.966 2017-08-29 11:17:09.322
      5 Success 2017-08-29 10:38:15.727 2017-08-29 10:38:16.548
      4 Success 2017-08-29 10:37:13.053 2017-08-29 10:37:13.888
      3 Success 2017-08-29 10:36:57.851 2017-08-29 10:36:59.08
      2 Success 2017-08-29 10:36:49.439 2017-08-29 10:36:50.373
      1 Success 2017-08-29 10:36:37.365 2017-08-29 10:36:38.768
      0 Success 2017-08-29 10:36:21.011 2017-08-29 10:36:26.1

      ----------------------------------------------------------------------------
      10 rows selected (0.081 seconds)
      0: jdbc:hive2://localhost:10000> ALTER TABLE uniqdata COMPACT 'MINOR';
      Error: java.lang.RuntimeException: Compaction failed. Please check logs for more info. Exception in compaction java.lang.Exception: Compaction Failure in Merger Rdd. (state=,code=0)
      0: jdbc:hive2://localhost:10000> ALTER TABLE uniqdata COMPACT 'MAJOR';
      Error: java.lang.RuntimeException: Compaction failed. Please check logs for more info. Exception in compaction java.lang.Exception: Compaction Failure in Merger Rdd. (state=,code=0)
      0: jdbc:hive2://localhost:10000>

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ravi.pesala Ravindra Pesala
                Reporter:
                pallavisingh_09 Pallavi Singh
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 10m
                  1h 10m