Details
-
New Feature
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
The rules operator should recieve tuples the tuple will provide a key. The key is used to lookup the rules to be applied to the tuple. The key is looked up in a cache if the key is not present the rules are loaded using a rules loader. The rules could be loaded from hdfs or a database. Entries in the cache can have expiration times so that rules are forced to be updated. If the tuple fails the rule a failure object is emitted.
The failure object will also have a key. The failure object can be passed to another operator for persistence and filtering (the same failure may be triggered multiple times and we may only want to report it once).