Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-7287

Configuration deprecation mechanism doesn't work properly for GenericOptionsParser/Tools

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.22.0, 0.23.0
    • Fix Version/s: 0.22.0, 0.23.0
    • Component/s: conf
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      For example, you can't use -D options on the "hadoop fs" command line in order to specify the deprecated names of configuration options. The issue is that the ordering is:

      • JVM starts
      • GenericOptionsParser creates a Configuration object and calls set() for each of the options specified on command line
      • DistributedFileSystem or other class eventually instantiates HdfsConfiguration which adds the deprecations
      • Some class calls conf.get("new key") and sees the default instead of the version set on the command line

        Attachments

        1. hadoop-7287-still-broken.txt
          5 kB
          Todd Lipcon
        2. hadoop-7287-testcase.txt
          0.7 kB
          Todd Lipcon
        3. hadoop-7287-trunk.0.patch
          3 kB
          Aaron T. Myers
        4. hadoop-7287-trunk.1.patch
          5 kB
          Aaron T. Myers
        5. hadoop-7287-trunk.2.patch
          6 kB
          Aaron T. Myers

          Issue Links

            Activity

              People

              • Assignee:
                atm Aaron T. Myers
                Reporter:
                tlipcon Todd Lipcon
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: