[ACCUMULO-2305] RestartIT.shutdownDuringCompactingSplitting occasionally fails

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Component/s: test
• Assignee: Unassigned
• Reporter: John Vines
• Created: 31/Jan/14 23:46
• Updated: 09/May/14 14:52
• Resolved: 09/May/14 14:52

Description

I frequently see this test fail in parallel on the second line (creating a table), with an infinite loop in the master log

2014-01-31 16:11:53,786 [impl.TabletServerBatchWriter] TRACE: tid=43  Requeuing 2 failed mutations
2014-01-31 16:11:53,787 [impl.RootTabletLocator] TRACE: tid=43 oid=1594  Looking up root tablet location in zookeeper.
2014-01-31 16:11:53,787 [impl.RootTabletLocator] TRACE: tid=43 oid=1594  Found root tablet at john-P15xEMx:60600|143ea1b4c130002 in 0.000 secs
2014-01-31 16:11:54,215 [impl.RootTabletLocator] TRACE: tid=30 oid=1595  Looking up root tablet location in zookeeper.
2014-01-31 16:11:54,215 [impl.RootTabletLocator] TRACE: tid=30 oid=1595  Found root tablet at john-P15xEMx:60600|143ea1b4c130002 in 0.000 secs
2014-01-31 16:11:54,715 [impl.RootTabletLocator] TRACE: tid=30 oid=1596  Looking up root tablet location in zookeeper.
2014-01-31 16:11:54,716 [impl.RootTabletLocator] TRACE: tid=30 oid=1596  Found root tablet at john-P15xEMx:60600|143ea1b4c130002 in 0.000 secs
2014-01-31 16:11:55,216 [impl.RootTabletLocator] TRACE: tid=30 oid=1597  Looking up root tablet location in zookeeper.
2014-01-31 16:11:55,216 [impl.RootTabletLocator] TRACE: tid=30 oid=1597  Found root tablet at john-P15xEMx:60600|143ea1b4c130002 in 0.000 secs
2014-01-31 16:11:55,286 [impl.TabletServerBatchWriter] TRACE: tid=43  Requeuing 2 failed mutations

possibly related to this error message I see before it

2014-01-31 16:02:36,695 [master.Master] ERROR: unable to get tablet server status john-P15xEMx:58357[143ea1b4c130001] java.io.IOException: No connection to john-
P15xEMx:58357[143ea1b4c130001]
2014-01-31 16:02:36,696 [master.Master] DEBUG: unable to get tablet server status john-P15xEMx:58357[143ea1b4c130001]
java.io.IOException: No connection to john-P15xEMx:58357[143ea1b4c130001]
        at org.apache.accumulo.master.Master.gatherTableInformation(Master.java:844)
        at org.apache.accumulo.master.Master.access$600(Master.java:138)
        at org.apache.accumulo.master.Master$StatusThread.updateStatus(Master.java:764)
        at org.apache.accumulo.master.Master$StatusThread.run(Master.java:754)