Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6057

Remove obsolete entries from mapred-default.xml

    Details

    • Type: Bug Bug
    • Status: Patch Available
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: 2.5.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      The following properties are defined in mapred-default.xml but no longer exist in MRJobConfig.

      map.sort.class
      mapred.child.env
      mapred.child.java.opts
      mapreduce.app-submission.cross-platform
      mapreduce.client.completion.pollinterval
      mapreduce.client.output.filter
      mapreduce.client.progressmonitor.pollinterval
      mapreduce.client.submit.file.replication
      mapreduce.cluster.acls.enabled
      mapreduce.cluster.local.dir
      mapreduce.framework.name
      mapreduce.ifile.readahead
      mapreduce.ifile.readahead.bytes
      mapreduce.input.fileinputformat.list-status.num-threads
      mapreduce.input.fileinputformat.split.minsize
      mapreduce.input.lineinputformat.linespermap
      mapreduce.job.counters.limit
      mapreduce.job.max.split.locations
      mapreduce.job.reduce.shuffle.consumer.plugin.class
      mapreduce.jobhistory.address
      mapreduce.jobhistory.admin.acl
      mapreduce.jobhistory.admin.address
      mapreduce.jobhistory.cleaner.enable
      mapreduce.jobhistory.cleaner.interval-ms
      mapreduce.jobhistory.client.thread-count
      mapreduce.jobhistory.datestring.cache.size
      mapreduce.jobhistory.done-dir
      mapreduce.jobhistory.http.policy
      mapreduce.jobhistory.intermediate-done-dir
      mapreduce.jobhistory.joblist.cache.size
      mapreduce.jobhistory.keytab
      mapreduce.jobhistory.loadedjobs.cache.size
      mapreduce.jobhistory.max-age-ms
      mapreduce.jobhistory.minicluster.fixed.ports
      mapreduce.jobhistory.move.interval-ms
      mapreduce.jobhistory.move.thread-count
      mapreduce.jobhistory.principal
      mapreduce.jobhistory.recovery.enable
      mapreduce.jobhistory.recovery.store.class
      mapreduce.jobhistory.recovery.store.fs.uri
      mapreduce.jobhistory.store.class
      mapreduce.jobhistory.webapp.address
      mapreduce.local.clientfactory.class.name
      mapreduce.map.skip.proc.count.autoincr
      mapreduce.output.fileoutputformat.compress
      mapreduce.output.fileoutputformat.compress.codec
      mapreduce.output.fileoutputformat.compress.type
      mapreduce.reduce.skip.proc.count.autoincr
      mapreduce.shuffle.connection-keep-alive.enable
      mapreduce.shuffle.connection-keep-alive.timeout
      mapreduce.shuffle.max.connections
      mapreduce.shuffle.max.threads
      mapreduce.shuffle.port
      mapreduce.shuffle.ssl.enabled
      mapreduce.shuffle.ssl.file.buffer.size
      mapreduce.shuffle.transfer.buffer.size
      mapreduce.shuffle.transferTo.allowed
      yarn.app.mapreduce.client-am.ipc.max-retries-on-timeouts

      Submitting bug for comment/feedback about which properties should be kept in mapred-default.xml.

      1. MAPREDUCE-6057.004.patch
        12 kB
        Ray Chiang
      2. MAPREDUCE-6057-01.patch
        11 kB
        Ray Chiang
      3. MAPREDUCE-6057-02.patch
        11 kB
        Ray Chiang
      4. MAPREDUCE-6057-03.patch
        12 kB
        Ray Chiang

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Ray Chiang
              Reporter:
              Ray Chiang
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:

                Development