Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-3646

Add 'IGNORE PROTECTION' predicate for dropping partitions

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.11.0
    • CLI
    • None
    • Reviewed
    • Hide
      This is a feature which enables us to ignore protection for partitions when dropping them, if specified. The use case is moving partitions between clusters. Unprotecting and reprotecting tables is non-atomic and thus prone to leaving table metadata in a dirty state.
      Show
      This is a feature which enables us to ignore protection for partitions when dropping them, if specified. The use case is moving partitions between clusters. Unprotecting and reprotecting tables is non-atomic and thus prone to leaving table metadata in a dirty state.

    Description

      There are cases where it is desirable to move partitions between clusters. Having to undo protection and then re-protect tables in order to delete partitions from a source are multi-step and can leave us in a failed open state where partition and table metadata is dirty. By implementing an 'rm -rf'-like functionality, we can perform these operations atomically.

      Attachments

        1. HIVE-3646.1.patch.txt
          9 kB
          Andrew Chalfant
        2. HIVE-3646.2.patch.txt
          10 kB
          Andrew Chalfant
        3. HIVE-3646.3.patch.txt
          10 kB
          Andrew Chalfant

        Activity

          People

            chalfant Andrew Chalfant
            chalfant Andrew Chalfant
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 1m
                1m
                Remaining:
                Remaining Estimate - 1m
                1m
                Logged:
                Time Spent - Not Specified
                Not Specified