Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14571

Document configuration hive.msck.repair.batch.size

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.3.0
    • Documentation
    • None

    Description

      Update here https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-RecoverPartitions(MSCKREPAIRTABLE)

      When there is a large number of untracked partitions for the MSCK REPAIR TABLE command, there is a provision to run the msck repair table batch wise to avoid OOME. By giving the configured batch size for the property hive.msck.repair.batch.size it can run in the batches internally. The default value of the property is zero, it means it will execute all the partitions at one short.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-12077 MSCK Repair table should fix partitions in batches

          • Major - Major loss of function.
          • Closed

          Activity

            People

              chinnalalam Chinna Rao Lalam
              chinnalalam Chinna Rao Lalam
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: