[HDFS-14219] ConcurrentModificationException occurs in datanode occasionally

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.8.2
• Hadoop Flags: Reviewed
• Assignee: Tao Jie
• Reporter: Tao Jie
• Created: 21/Jan/19 08:59
• Updated: 14/Oct/20 02:22
• Resolved: 14/Oct/20 01:36

Description

ERROR occasionally occurs in datanode log:

ERROR BPServiceActor.java:792 - Exception in BPOfferService for Block pool BP-1687106048-10.14.9.17-1535259994856 (Datanode Uuid c17e635a-912f-4488-b4e8-93a58a27b5db) service to osscmh-9-21/10.14.9.21:8070
java.util.ConcurrentModificationException: modification=62852685 != iterModification = 62852684
at org.apache.hadoop.util.LightWeightGSet$SetIterator.ensureNext(LightWeightGSet.java:305)
at org.apache.hadoop.util.LightWeightGSet$SetIterator.hasNext(LightWeightGSet.java:322)
at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.getBlockReports(FsDatasetImpl.java:1872)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.blockReport(BPServiceActor.java:349)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.offerService(BPServiceActor.java:648)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:790)
at java.lang.Thread.run(Thread.java:745)