Type: New Feature
Affects Version/s: None
Fix Version/s: 0.8.0
One requirement for
HIVE-787 is that users would like to run a command whenever a new partition of a Hive table gets created.
There are several ways to achieve this functionality:
A. Probe and wait: We can have the scripts running in a loop checking if a new partition is created.
Pros: easy to write, easy to control
Cons: will introduce another delay based on the probing interval.
B. Triggered: The command is registered inside the hive metastore. Whenever a partition gets created, we run the registered command.
Several questions around option B are:
1. whether to support registration of HiveQL or shell command;
2. which machine/environment to run the command;
3. what to do if the registered command failed.