[ACCUMULO-1235] tablet fails to load after split fix

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.4.4, 1.5.0
• Component/s: tserver
• Labels: 15_qa_bug

Environment

10-node test cluster running randomwalk test

• Assignee: Keith Turner
• Reporter: Eric C. Newton
• Created: 03/Apr/13 13:28
• Updated: 23/Apr/13 01:21
• Resolved: 22/Apr/13 16:23

Description

After fixing a split, the metadata table information for the low half of the split is empty, which eventually causes an NPE.

The split appears to be fixed.

2013-04-03 05:25:42,209 [tabletserver.TabletServer] DEBUG: verifying extent 1ya;000019;000018
2013-04-03 05:25:42,211 [util.MetadataTable] WARN : Incomplete split 1ya;000019 attempting to fix
2013-04-03 05:25:42,222 [util.MetadataTable] DEBUG: Prev tablet 1ya;000018 : [] 9223372036854775807 false does not exist, need to create it 000018 000017 0.47058823529411764
2013-04-03 05:25:42,229 [tabletserver.TabletServer] DEBUG: verifying extent 1ya;000019;000017
2013-04-03 05:25:42,234 [tabletserver.TabletServer] DEBUG: Master didn't know 1ya;000019;000018 was split, letting it know about [1ya;000018;000017, 1ya;000019;000018]
2013-04-03 05:25:42,235 [tabletserver.Tablet] DEBUG: Looking at metadata {}
2013-04-03 05:25:42,235 [tabletserver.Tablet] DEBUG: got [] for logs for 1ya;000018;000017
2013-04-03 05:25:42,239 [tabletserver.NativeMap] DEBUG: Allocated native map 0x00002aaab809a790
2013-04-03 05:25:42,240 [tabletserver.TabletServer] WARN : exception trying to assign tablet 1ya;000018;000017 /t-0007dqd
java.lang.NullPointerException
        at org.apache.accumulo.server.tabletserver.TabletTime.getInstance(TabletTime.java:61)
        at org.apache.accumulo.server.tabletserver.Tablet.<init>(Tablet.java:1368)
        at org.apache.accumulo.server.tabletserver.Tablet.<init>(Tablet.java:1300)
        at org.apache.accumulo.server.tabletserver.Tablet.<init>(Tablet.java:1142)
        at org.apache.accumulo.server.tabletserver.Tablet.<init>(Tablet.java:1130)
        at org.apache.accumulo.server.tabletserver.TabletServer$AssignmentHandler.run(TabletServer.java:2512)
        at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
        at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
        at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
        at java.lang.Thread.run(Thread.java:662)

Issue Links

• is related to: ACCUMULO-1243 Multiple assignment may occur if tablet server dies during split