Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13384

Add a job-conf.xml as a default resource file to load in configuration utils

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • conf
    • None
    • Patch

    Description

      We would like to make it possible for jobs to include their configuration as a default resource loaded as a default in ConfigUtil (when available)

      That would allow a job to include a job-conf.xml resource file allowing to configure a job without having to set configuration file from inside the code (making it a bit easier to track for configuration changes).

      FYI We are also using this to inject useful configuration parameters (code version, main class, parameters, launch time) in order to get these insights in job.xml files in order to process these data later on (with rumen for example).

      Here is the proposed patch on our fork that I would like to propose upstream:https://github.com/criteo-forks/hadoop-common/pull/2/commits/9bb3f7ad95989bcd9a433331be4fcc0633c2c0b3

      Thanks,

      Attachments

        1. HADOOP-13384-001.patch
          0.9 kB
          Francois Visconte

        Activity

          People

            Unassigned Unassigned
            f.visconte Francois Visconte
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: