[ACCUMULO-2862] Major Compaction issues

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.7.0
• Component/s: tserver
• Assignee: Eric C. Newton
• Reporter: Josh Elser
• Created: 05/Jun/14 21:57
• Updated: 09/Jun/14 19:10
• Resolved: 09/Jun/14 19:08

Description

Since the last round of tserver/tablet refactoring, I've been getting some spurious errors while running two tservers on a single node with a single continuous ingest client.

java.lang.RuntimeException: java.lang.IllegalStateException: Major compacting files not empty [...]
	at org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1998)
	at org.apache.accumulo.tserver.tablet.CompactionRunner.run(CompactionRunner.java:42)
	at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
	at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalStateException: Major compacting files not empty [...]
	at org.apache.accumulo.tserver.tablet.DatafileManager.reserveMajorCompactingFiles(DatafileManager.java:484)
	at org.apache.accumulo.tserver.tablet.Tablet._majorCompact(Tablet.java:1797)
	at org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1986)
	... 7 more
2014-06-05 16:46:

As well as some CompactionCanceledExceptions.

Thread "major compactor 2" died org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
	java.lang.RuntimeException: org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
		at org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1970)
		at org.apache.accumulo.tserver.tablet.CompactionRunner.run(CompactionRunner.java:42)
		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
		at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
		at java.lang.Thread.run(Thread.java:745)
	Caused by: org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
		at org.apache.accumulo.tserver.tablet.Compactor.compactLocalityGroup(Compactor.java:370)
		at org.apache.accumulo.tserver.tablet.Compactor.call(Compactor.java:206)
		at org.apache.accumulo.tserver.tablet.Tablet._majorCompact(Tablet.java:1853)
		at org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1962)
		... 7 more