Details
-
Bug
-
Status: To Do
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Grok patterns are kept in HDFS and referenced by path in a Zookeeper config property. There is no way to update a pattern and have that change seen in the ParserBolt without restarting the topology.
As discussed on the dev list, a better approach is to instead store the grok patterns directly in zookeeper. The requirements mentioned in that discussion:
- pattern files removed from HDFS and classpath
- update to grok pattern in zookeeper is immediately applied in bolt
- ability to easily edit the pattern