Hadoop Common
  1. Hadoop Common
  2. HADOOP-7287

Configuration deprecation mechanism doesn't work properly for GenericOptionsParser/Tools

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.22.0, 0.23.0
    • Fix Version/s: 0.22.0, 0.23.0
    • Component/s: conf
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      For example, you can't use -D options on the "hadoop fs" command line in order to specify the deprecated names of configuration options. The issue is that the ordering is:

      • JVM starts
      • GenericOptionsParser creates a Configuration object and calls set() for each of the options specified on command line
      • DistributedFileSystem or other class eventually instantiates HdfsConfiguration which adds the deprecations
      • Some class calls conf.get("new key") and sees the default instead of the version set on the command line
      1. hadoop-7287-testcase.txt
        0.7 kB
        Todd Lipcon
      2. hadoop-7287-trunk.0.patch
        3 kB
        Aaron T. Myers
      3. hadoop-7287-still-broken.txt
        5 kB
        Todd Lipcon
      4. hadoop-7287-trunk.1.patch
        5 kB
        Aaron T. Myers
      5. hadoop-7287-trunk.2.patch
        6 kB
        Aaron T. Myers

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Aaron T. Myers
              Reporter:
              Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development