Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6057

Remove obsolete entries from mapred-default.xml

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.5.0
    • 3.0.0-alpha1
    • None

    Description

      The following properties are defined in mapred-default.xml but no longer exist in MRJobConfig.

      map.sort.class
      mapred.child.env
      mapred.child.java.opts
      mapreduce.app-submission.cross-platform
      mapreduce.client.completion.pollinterval
      mapreduce.client.output.filter
      mapreduce.client.progressmonitor.pollinterval
      mapreduce.client.submit.file.replication
      mapreduce.cluster.acls.enabled
      mapreduce.cluster.local.dir
      mapreduce.framework.name
      mapreduce.ifile.readahead
      mapreduce.ifile.readahead.bytes
      mapreduce.input.fileinputformat.list-status.num-threads
      mapreduce.input.fileinputformat.split.minsize
      mapreduce.input.lineinputformat.linespermap
      mapreduce.job.counters.limit
      mapreduce.job.max.split.locations
      mapreduce.job.reduce.shuffle.consumer.plugin.class
      mapreduce.jobhistory.address
      mapreduce.jobhistory.admin.acl
      mapreduce.jobhistory.admin.address
      mapreduce.jobhistory.cleaner.enable
      mapreduce.jobhistory.cleaner.interval-ms
      mapreduce.jobhistory.client.thread-count
      mapreduce.jobhistory.datestring.cache.size
      mapreduce.jobhistory.done-dir
      mapreduce.jobhistory.http.policy
      mapreduce.jobhistory.intermediate-done-dir
      mapreduce.jobhistory.joblist.cache.size
      mapreduce.jobhistory.keytab
      mapreduce.jobhistory.loadedjobs.cache.size
      mapreduce.jobhistory.max-age-ms
      mapreduce.jobhistory.minicluster.fixed.ports
      mapreduce.jobhistory.move.interval-ms
      mapreduce.jobhistory.move.thread-count
      mapreduce.jobhistory.principal
      mapreduce.jobhistory.recovery.enable
      mapreduce.jobhistory.recovery.store.class
      mapreduce.jobhistory.recovery.store.fs.uri
      mapreduce.jobhistory.store.class
      mapreduce.jobhistory.webapp.address
      mapreduce.local.clientfactory.class.name
      mapreduce.map.skip.proc.count.autoincr
      mapreduce.output.fileoutputformat.compress
      mapreduce.output.fileoutputformat.compress.codec
      mapreduce.output.fileoutputformat.compress.type
      mapreduce.reduce.skip.proc.count.autoincr
      mapreduce.shuffle.connection-keep-alive.enable
      mapreduce.shuffle.connection-keep-alive.timeout
      mapreduce.shuffle.max.connections
      mapreduce.shuffle.max.threads
      mapreduce.shuffle.port
      mapreduce.shuffle.ssl.enabled
      mapreduce.shuffle.ssl.file.buffer.size
      mapreduce.shuffle.transfer.buffer.size
      mapreduce.shuffle.transferTo.allowed
      yarn.app.mapreduce.client-am.ipc.max-retries-on-timeouts

      Submitting bug for comment/feedback about which properties should be kept in mapred-default.xml.

      Attachments

        1. MAPREDUCE-6057.004.patch
          12 kB
          Ray Chiang
        2. MAPREDUCE-6057-03.patch
          12 kB
          Ray Chiang
        3. MAPREDUCE-6057-02.patch
          11 kB
          Ray Chiang
        4. MAPREDUCE-6057-01.patch
          11 kB
          Ray Chiang

        Issue Links

          Activity

            People

              rchiang Ray Chiang
              rchiang Ray Chiang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: