Details
-
Improvement
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
None
-
None
-
None
-
Patch
Description
We would like to make it possible for jobs to include their configuration as a default resource loaded as a default in ConfigUtil (when available)
That would allow a job to include a job-conf.xml resource file allowing to configure a job without having to set configuration file from inside the code (making it a bit easier to track for configuration changes).
FYI We are also using this to inject useful configuration parameters (code version, main class, parameters, launch time) in order to get these insights in job.xml files in order to process these data later on (with rumen for example).
Here is the proposed patch on our fork that I would like to propose upstream:https://github.com/criteo-forks/hadoop-common/pull/2/commits/9bb3f7ad95989bcd9a433331be4fcc0633c2c0b3
Thanks,