[HIVE-9674] *DropPartitionEvent should handle partition-sets. - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 0.14.0
Fix Version/s: 1.2.0
Component/s: Metastore
Labels:
None

Description

Dropping a set of N partitions from a table currently results in N DropPartitionEvents (and N PreDropPartitionEvents) being fired serially. This is wasteful, especially so for large N. It also makes it impossible to even try to run authorization-checks on all partitions in a batch.

Taking the cue from ~~HIVE-9609~~, we should compose an Iterable<Partition> in the event, and expose them via an Iterator.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-9674.2.patch
20/Feb/15 02:10
15 kB
Mithun Radhakrishnan
HIVE-9674.3.patch
08/Apr/15 23:57
15 kB
Mithun Radhakrishnan
HIVE-9674.4.patch
20/Apr/15 08:30
16 kB
Sushanth Sowmyan
HIVE-9674.5.patch
28/Apr/15 16:37
16 kB
Sushanth Sowmyan

Issue Links

is depended upon by

HIVE-10250 Optimize AuthorizationPreEventListener to reuse TableWrapper objects

Open

HIVE-9681 Extend HiveAuthorizationProvider to support partition-sets.

Closed

relates to

HIVE-10395 PreAddPartitionEvent should also be updated to use Iterator semantics

Open

Activity

People

Assignee:: Mithun Radhakrishnan

Reporter:: Mithun Radhakrishnan

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 12/Feb/15 19:52

Updated:: 18/May/15 19:55

Resolved:: 29/Apr/15 06:39