[ASTERIXDB-2497] Flush failed with IllegalStateException: Low watermark should always be increasing

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.4
• Fix Version/s: 0.9.5
• Component/s: TX - Transactions
• Assignee: Murtadha Makki Al Hubail
• Reporter: Murtadha Makki Al Hubail
• Created: 13/Dec/18 15:36
• Updated: 27/Sep/19 18:03
• Resolved: 17/Dec/18 23:16

Description

Encountered intermittent disk component flush failure with the following exception:

 

java.lang.IllegalStateException: Low watermark should always be increasing
	at org.apache.asterix.common.storage.IndexCheckpoint.next(IndexCheckpoint.java:60)
	at org.apache.asterix.app.nc.IndexCheckpointManager.flushed(IndexCheckpointManager.java:87)
	at org.apache.asterix.common.ioopcallbacks.LSMIOOperationCallback.addComponentToCheckpoint(LSMIOOperationCallback.java:136)
	at org.apache.asterix.common.ioopcallbacks.LSMIOOperationCallback.afterFinalize(LSMIOOperationCallback.java:123)
	at org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.doIo(LSMHarness.java:544)
	at org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.flush(LSMHarness.java:513)
	at org.apache.hyracks.storage.am.lsm.common.impls.LSMTreeIndexAccessor.flush(LSMTreeIndexAccessor.java:122)
	at org.apache.hyracks.storage.am.lsm.common.impls.FlushOperation.call(FlushOperation.java:38)
	at org.apache.hyracks.storage.am.lsm.common.impls.FlushOperation.call(FlushOperation.java:29)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_131]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_131]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_131]
	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]