[YARN-303] ProcfsBasedProcessTree throws ConcurrentModificationException

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.0.2-alpha, 2.0.1-alpha, 3.0.0-alpha1
• Target Version/s: 2.1.0-beta
• Assignee: Devaraj Kavali
• Reporter: Devaraj Kavali
• Created: 02/Jan/13 06:04
• Updated: 12/May/16 18:29

Description

Error: java.util.ConcurrentModificationException
	at java.util.HashMap$HashIterator.nextEntry(HashMap.java:793)
	at java.util.HashMap$EntryIterator.next(HashMap.java:834)
	at java.util.HashMap$EntryIterator.next(HashMap.java:832)
	at org.apache.hadoop.yarn.util.ProcfsBasedProcessTree.getProcessTree(ProcfsBasedProcessTree.java:208)
	at org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin.getProcResourceValues(LinuxResourceCalculatorPlugin.java:406)
	at org.apache.hadoop.mapred.Task.getCurrentProcResourceValues(Task.java:810)
	at org.apache.hadoop.mapred.BlockMapOutputBuffer.sortAndSpill(BlockMapOutputBuffer.java:235)
	at org.apache.hadoop.mapred.BlockMapOutputBuffer.flush(BlockMapOutputBuffer.java:322)
	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:677)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:745)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:333)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:154)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:149)