Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-7287

Configuration deprecation mechanism doesn't work properly for GenericOptionsParser/Tools

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.22.0, 0.23.0
    • 0.22.0, 0.23.0
    • conf
    • None
    • Reviewed

    Description

      For example, you can't use -D options on the "hadoop fs" command line in order to specify the deprecated names of configuration options. The issue is that the ordering is:

      • JVM starts
      • GenericOptionsParser creates a Configuration object and calls set() for each of the options specified on command line
      • DistributedFileSystem or other class eventually instantiates HdfsConfiguration which adds the deprecations
      • Some class calls conf.get("new key") and sees the default instead of the version set on the command line

      Attachments

        1. hadoop-7287-trunk.2.patch
          6 kB
          Aaron Myers
        2. hadoop-7287-trunk.1.patch
          5 kB
          Aaron Myers
        3. hadoop-7287-trunk.0.patch
          3 kB
          Aaron Myers
        4. hadoop-7287-testcase.txt
          0.7 kB
          Todd Lipcon
        5. hadoop-7287-still-broken.txt
          5 kB
          Todd Lipcon

        Issue Links

          Activity

            People

              atm Aaron Myers
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: