Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3583

Pull out configuration element names from inline code to interface classes for use across Hadoop and other apps

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 0.18.0
    • None
    • conf
    • None

    Description

      If we had different interfaces for the different configuration names as a set of constants, instead of using inline strings

      1. we could detect naming inconsistencies (and spelling errors) faster
      2. it would be easier for other applications (downstream, such as HBase) or tools that set the parameters) to actually set the parameters.
      3. It would be eaiser to change the names, if desired.
      4. it would be easy to detect all usages within a single project.

      The interface classes could be hand generated (turn existing references into constants), or they could be auto-generated from an XML template. The latter would work if the default values included a definition of every possible supported attribute, somehow grouped so that jobconf values could be kept separate from dfs constants.

      There is an incomplete hand-generated example at

      http://smartfrog.svn.sourceforge.net/viewvc/smartfrog/trunk/core/components/hadoop/src/org/smartfrog/services/hadoop/conf/ConfigurationAttributes.java?view=markup

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: