[HADOOP-7831] ConcurrentModificationException in getCurrentUser()

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.20.205.0
• Component/s: security
• Assignee: Unassigned
• Reporter: Kihwal Lee
• Created: 17/Nov/11 18:11
• Updated: 29/May/12 06:31
• Resolved: 23/Nov/11 18:35

Description

I've seen the following exception from a job tracker log. Security/kerberos enabled.

2011-11-17 01:54:00,288 WARN org.apache.hadoop.mapred.CleanupQueue: Error deleting path
hdfs://namenode:1234/xxxx/xxxx/xxxx/job_xxxxxxxxx_xxxx
java.util.ConcurrentModificationException
        at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:761)
        at java.util.LinkedList$ListItr.next(LinkedList.java:696)
        at javax.security.auth.Subject$SecureSet$1.next(Subject.java:1014)
        at javax.security.auth.Subject$ClassSet$1.run(Subject.java:1345)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject$ClassSet.populateSet(Subject.java:1342)
        at javax.security.auth.Subject$ClassSet.<init>(Subject.java:1317)
        at javax.security.auth.Subject.getPrivateCredentials(Subject.java:731)
        at org.apache.hadoop.security.UserGroupInformation.<init>(UserGroupInformation.java:379)
        at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:398)
        at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1445)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1346)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
        at org.apache.hadoop.mapred.CleanupQueue$PathDeletionContext$1.run(CleanupQueue.java:78)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1064)
        at org.apache.hadoop.mapred.CleanupQueue$PathDeletionContext.deletePath(CleanupQueue.java:75)
        at org.apache.hadoop.mapred.CleanupQueue$PathCleanupThread.run(CleanupQueue.java:131)