[HBASE-5754] data lost with gora continuous ingest test (goraci)

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 0.92.1

Environment

10 node test cluster

• Assignee: Unassigned Assign to me
• Reporter: Eric C. Newton
• Created: 09/Apr/12 21:15
• Updated: 13/Jun/22 16:18
• Resolved: 06/Jun/13 14:29

Description

Keith Turner re-wrote the accumulo continuous ingest test using gora, which has both hbase and accumulo back-ends.

I put a billion entries into HBase, and ran the Verify map/reduce job. The verification failed because about 21K entries were missing. The goraci README explains the test, and how it detects missing data.

I re-ran the test with 100 million entries, and it verified successfully.
Both of the times I tested using a billion entries, the verification failed.
If I run the verification step twice, the results are consistent, so the problem is
probably not on the verify step.

Here's the versions of the various packages:

package	version
hadoop	0.20.205.0
hbase	0.92.1
gora	http://svn.apache.org/repos/asf/gora/trunk r1311277
goraci	https://github.com/ericnewton/goraci tagged 2012-04-08

The change I made to goraci was to configure it for hbase and to allow it to build properly.

Issue Links

• relates to: HBASE-5986 Clients can see holes in the META table when regions are being split