[MAPREDUCE-6057] Remove obsolete entries from mapred-default.xml

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.5.0
• Fix Version/s: 3.0.0-alpha1
• Labels: newbie
• Assignee: Ray Chiang
• Reporter: Ray Chiang
• Created: 28/Aug/14 05:47
• Updated: 12/May/16 18:24
• Resolved: 27/Apr/15 03:31

Description

The following properties are defined in mapred-default.xml but no longer exist in MRJobConfig.

map.sort.class
mapred.child.env
mapred.child.java.opts
mapreduce.app-submission.cross-platform
mapreduce.client.completion.pollinterval
mapreduce.client.output.filter
mapreduce.client.progressmonitor.pollinterval
mapreduce.client.submit.file.replication
mapreduce.cluster.acls.enabled
mapreduce.cluster.local.dir
mapreduce.framework.name
mapreduce.ifile.readahead
mapreduce.ifile.readahead.bytes
mapreduce.input.fileinputformat.list-status.num-threads
mapreduce.input.fileinputformat.split.minsize
mapreduce.input.lineinputformat.linespermap
mapreduce.job.counters.limit
mapreduce.job.max.split.locations
mapreduce.job.reduce.shuffle.consumer.plugin.class
mapreduce.jobhistory.address
mapreduce.jobhistory.admin.acl
mapreduce.jobhistory.admin.address
mapreduce.jobhistory.cleaner.enable
mapreduce.jobhistory.cleaner.interval-ms
mapreduce.jobhistory.client.thread-count
mapreduce.jobhistory.datestring.cache.size
mapreduce.jobhistory.done-dir
mapreduce.jobhistory.http.policy
mapreduce.jobhistory.intermediate-done-dir
mapreduce.jobhistory.joblist.cache.size
mapreduce.jobhistory.keytab
mapreduce.jobhistory.loadedjobs.cache.size
mapreduce.jobhistory.max-age-ms
mapreduce.jobhistory.minicluster.fixed.ports
mapreduce.jobhistory.move.interval-ms
mapreduce.jobhistory.move.thread-count
mapreduce.jobhistory.principal
mapreduce.jobhistory.recovery.enable
mapreduce.jobhistory.recovery.store.class
mapreduce.jobhistory.recovery.store.fs.uri
mapreduce.jobhistory.store.class
mapreduce.jobhistory.webapp.address
mapreduce.local.clientfactory.class.name
mapreduce.map.skip.proc.count.autoincr
mapreduce.output.fileoutputformat.compress
mapreduce.output.fileoutputformat.compress.codec
mapreduce.output.fileoutputformat.compress.type
mapreduce.reduce.skip.proc.count.autoincr
mapreduce.shuffle.connection-keep-alive.enable
mapreduce.shuffle.connection-keep-alive.timeout
mapreduce.shuffle.max.connections
mapreduce.shuffle.max.threads
mapreduce.shuffle.port
mapreduce.shuffle.ssl.enabled
mapreduce.shuffle.ssl.file.buffer.size
mapreduce.shuffle.transfer.buffer.size
mapreduce.shuffle.transferTo.allowed
yarn.app.mapreduce.client-am.ipc.max-retries-on-timeouts

Submitting bug for comment/feedback about which properties should be kept in mapred-default.xml.

Issue Links

• blocks: MAPREDUCE-6192 Create unit test to automatically compare MR related classes and mapred-default.xml
• relates to: MAPREDUCE-5762 Port MAPREDUCE-3223 and MAPREDUCE-4695 (Remove MRv1 config from mapred-default.xml) to branch-2