Details
Description
The shard random walk test failed when verifiy its new index. This test has two tables a document table and a sharded index table used to find documents. The test has a node that rebuilds the index from the document table and then verifies that the new and old index are the same. This verification failed. The failure was all realted to data loss in one tablet in the new index table. The data that was lost was read from two tablets in the document table. None of the lost data appeared in any write ahead logs. The tablet that lost data was being moved around very frequently during the time of the data loss. All of the evidence points to a bug in the batch writer or the tablet server code related to writing data.