Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
0.4.0
-
None
-
None
-
None
Description
We have nearly two dozen different demux implementations that generate data that is eventually saved into MySQL. On top of this, each different data type has about twenty or more columns in its resulting table. Specifying all of these in a single mdl.xml file has caused us some headaches, so we looked into how we could split mdl.xml into smaller, more manageable chunks. The patch (forthcoming) simply iterates over the files in $CHUKWA_CONF_DIR and if the file name ends with "mdl.xml", it will be added as a resource to the Configuration object used (mdl.xml is loaded first and the others are loaded subsequently, ensuring that mdl.xml is not then loaded again).
One likely concern is that this doesn't follow the default/site method of specifying overrides. Also, the ordering of the configuration files' inclusionis based on the JVM and/or platform implementation of java.io.File.listFiles.
Regardless, this made it very simple to isolate the files needed by each data type and update them as needed.