Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20707

Automatic partition management

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.0.0
    • Fix Version/s: 4.0.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      In current scenario, to add partitions for external tables to metastore, MSCK REPAIR command has to be executed manually. To avoid this manual step, external tables can be specified a table property based on which a background metastore thread can sync partitions periodically. Tables can also be specified with partition retention period. Any partition whose age exceeds the retention period will be dropped automatically.

        Attachments

        1. HIVE-20707.1.patch
          223 kB
          Prasanth Jayachandran
        2. HIVE-20707.2.patch
          304 kB
          Prasanth Jayachandran
        3. HIVE-20702.3.patch
          303 kB
          Prasanth Jayachandran
        4. HIVE-20707.4.patch
          306 kB
          Prasanth Jayachandran
        5. HIVE-20707.5.patch
          306 kB
          Prasanth Jayachandran
        6. HIVE-20707.6.patch
          376 kB
          Prasanth Jayachandran
        7. HIVE-20707.6.patch
          376 kB
          Prasanth Jayachandran
        8. HIVE-20707.7.patch
          308 kB
          Prasanth Jayachandran
        9. HIVE-20707-branch-3.patch
          316 kB
          Prasanth Jayachandran

          Issue Links

            Activity

              People

              • Assignee:
                prasanth_j Prasanth Jayachandran
                Reporter:
                prasanth_j Prasanth Jayachandran
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: