Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13384

Add a job-conf.xml as a default resource file to load in configuration utils

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: conf
    • Labels:
      None
    • Flags:
      Patch

      Description

      We would like to make it possible for jobs to include their configuration as a default resource loaded as a default in ConfigUtil (when available)

      That would allow a job to include a job-conf.xml resource file allowing to configure a job without having to set configuration file from inside the code (making it a bit easier to track for configuration changes).

      FYI We are also using this to inject useful configuration parameters (code version, main class, parameters, launch time) in order to get these insights in job.xml files in order to process these data later on (with rumen for example).

      Here is the proposed patch on our fork that I would like to propose upstream:https://github.com/criteo-forks/hadoop-common/pull/2/commits/9bb3f7ad95989bcd9a433331be4fcc0633c2c0b3

      Thanks,

        Attachments

        1. HADOOP-13384-001.patch
          0.9 kB
          Francois Visconte

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              f.visconte Francois Visconte
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: