Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-3646

Add 'IGNORE PROTECTION' predicate for dropping partitions

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11.0
    • Component/s: CLI
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      This is a feature which enables us to ignore protection for partitions when dropping them, if specified. The use case is moving partitions between clusters. Unprotecting and reprotecting tables is non-atomic and thus prone to leaving table metadata in a dirty state.
      Show
      This is a feature which enables us to ignore protection for partitions when dropping them, if specified. The use case is moving partitions between clusters. Unprotecting and reprotecting tables is non-atomic and thus prone to leaving table metadata in a dirty state.

      Description

      There are cases where it is desirable to move partitions between clusters. Having to undo protection and then re-protect tables in order to delete partitions from a source are multi-step and can leave us in a failed open state where partition and table metadata is dirty. By implementing an 'rm -rf'-like functionality, we can perform these operations atomically.

        Attachments

        1. HIVE-3646.1.patch.txt
          9 kB
          Andrew Chalfant
        2. HIVE-3646.2.patch.txt
          10 kB
          Andrew Chalfant
        3. HIVE-3646.3.patch.txt
          10 kB
          Andrew Chalfant

          Activity

            People

            • Assignee:
              chalfant Andrew Chalfant
              Reporter:
              chalfant Andrew Chalfant
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Due:
                Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 1m
                1m
                Remaining:
                Remaining Estimate - 1m
                1m
                Logged:
                Time Spent - Not Specified
                Not Specified