Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6057

Remove obsolete entries from mapred-default.xml

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.5.0
    • Fix Version/s: 3.0.0-alpha1
    • Component/s: None
    • Labels:

      Description

      The following properties are defined in mapred-default.xml but no longer exist in MRJobConfig.

      map.sort.class
      mapred.child.env
      mapred.child.java.opts
      mapreduce.app-submission.cross-platform
      mapreduce.client.completion.pollinterval
      mapreduce.client.output.filter
      mapreduce.client.progressmonitor.pollinterval
      mapreduce.client.submit.file.replication
      mapreduce.cluster.acls.enabled
      mapreduce.cluster.local.dir
      mapreduce.framework.name
      mapreduce.ifile.readahead
      mapreduce.ifile.readahead.bytes
      mapreduce.input.fileinputformat.list-status.num-threads
      mapreduce.input.fileinputformat.split.minsize
      mapreduce.input.lineinputformat.linespermap
      mapreduce.job.counters.limit
      mapreduce.job.max.split.locations
      mapreduce.job.reduce.shuffle.consumer.plugin.class
      mapreduce.jobhistory.address
      mapreduce.jobhistory.admin.acl
      mapreduce.jobhistory.admin.address
      mapreduce.jobhistory.cleaner.enable
      mapreduce.jobhistory.cleaner.interval-ms
      mapreduce.jobhistory.client.thread-count
      mapreduce.jobhistory.datestring.cache.size
      mapreduce.jobhistory.done-dir
      mapreduce.jobhistory.http.policy
      mapreduce.jobhistory.intermediate-done-dir
      mapreduce.jobhistory.joblist.cache.size
      mapreduce.jobhistory.keytab
      mapreduce.jobhistory.loadedjobs.cache.size
      mapreduce.jobhistory.max-age-ms
      mapreduce.jobhistory.minicluster.fixed.ports
      mapreduce.jobhistory.move.interval-ms
      mapreduce.jobhistory.move.thread-count
      mapreduce.jobhistory.principal
      mapreduce.jobhistory.recovery.enable
      mapreduce.jobhistory.recovery.store.class
      mapreduce.jobhistory.recovery.store.fs.uri
      mapreduce.jobhistory.store.class
      mapreduce.jobhistory.webapp.address
      mapreduce.local.clientfactory.class.name
      mapreduce.map.skip.proc.count.autoincr
      mapreduce.output.fileoutputformat.compress
      mapreduce.output.fileoutputformat.compress.codec
      mapreduce.output.fileoutputformat.compress.type
      mapreduce.reduce.skip.proc.count.autoincr
      mapreduce.shuffle.connection-keep-alive.enable
      mapreduce.shuffle.connection-keep-alive.timeout
      mapreduce.shuffle.max.connections
      mapreduce.shuffle.max.threads
      mapreduce.shuffle.port
      mapreduce.shuffle.ssl.enabled
      mapreduce.shuffle.ssl.file.buffer.size
      mapreduce.shuffle.transfer.buffer.size
      mapreduce.shuffle.transferTo.allowed
      yarn.app.mapreduce.client-am.ipc.max-retries-on-timeouts

      Submitting bug for comment/feedback about which properties should be kept in mapred-default.xml.

        Attachments

        1. MAPREDUCE-6057-01.patch
          11 kB
          Ray Chiang
        2. MAPREDUCE-6057-02.patch
          11 kB
          Ray Chiang
        3. MAPREDUCE-6057-03.patch
          12 kB
          Ray Chiang
        4. MAPREDUCE-6057.004.patch
          12 kB
          Ray Chiang

          Issue Links

            Activity

              People

              • Assignee:
                rchiang Ray Chiang
                Reporter:
                rchiang Ray Chiang
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: