[ATLAS-629] Kafka messages in ATLAS_HOOK might be lost in HA mode at the instant of failover.

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.7-incubating
• Fix Version/s: 0.7-incubating
• Assignee: Hemanth Yamijala
• Reporter: Hemanth Yamijala
• Created: 04/Apr/16 11:57
• Updated: 13/May/16 04:19
• Resolved: 13/May/16 04:19

Description

Write data to Kafka continuously from Hive hook - can do this by writing a script that constantly creates tables. Bring down the Active instance with kill -9. Ensure writes continue after passive becomes active. The expectation is the number of tables created and the number of tables in Atlas match.

In one test, wrote 180 tables and switched over 6 times from one instance to another. Found that 1 table was lost of the lot. i.e. 179 tables were created, and 1 did not get in.

Issue Links

• links to: Review board link