[KYLIN-3562] TS conflict when kylin update metadata in HBase

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: v2.4.0
• Fix Version/s: v2.4.2, v2.5.1
• Assignee: Jiatao Tao
• Reporter: Lingang Deng
• Created: 17/Sep/18 02:10
• Updated: 02/Jun/20 06:09
• Resolved: 29/Oct/18 07:32

Description

Error log was as follows,

org.apache.kylin.common.persistence.WriteConflictException: Overwriting conflict /user/admin, expect old TS 1536928877043, but it is 1536928907207
         at org.apache.kylin.storage.hbase.HBaseResourceStore.checkAndPutResourceImpl(HBaseResourceStore.java:325)
         at org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceCheckpoint(ResourceStore.java:318)
         at org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:303)
         at org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:282)
         at org.apache.kylin.metadata.cachesync.CachedCrudAssist.save(CachedCrudAssist.java:192)

 

what disturbs me the most was that the error was happened several hours,  then my all build job and query job failed.

Issue Links

• fixes: KYLIN-3947 TS conflict when kylin update metadata in JDBC (MySQL)
• is caused by: KYLIN-3499 Double check timestamp in HBase when got "RetriesExhaustedException"
• relates to: KYLIN-3947 TS conflict when kylin update metadata in JDBC (MySQL)
• links to: GitHub Pull Request #254
• links to: GitHub Pull Request #317