[ATLAS-616] Zookeeper throws exceptions when trying to fire DSL queries at Atlas at large scale.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.7-incubating
• Environment: Atlas with External kafka / HBase / Solr; The test is run on cluster setup.; Machine 1 - Atlas , Solr; Machine 2 - Kafka , HBase; Machine 3 - Hive , client
• Assignee: Hemanth Yamijala
• Reporter: Sharmadha S
• Created: 01/Apr/16 13:30
• Updated: 23/Apr/16 00:29
• Resolved: 23/Apr/16 00:29

Description

The test plan is to simulate 'n' number of users fire 'm' number of queries at Atlas simultaneously. This is accomplished with the help of Apache Jmeter.
Atlas is populated with 10,000 tables.
• 6000 small sized tables (10 columns)
• 3000 medium sized tables (50 columns)
• 1000 large sized tables (100 columns)
The test plan consists of 30 users firing a set of 3 queries continuously for 20 times in a loop. Added -Xmx10240m -XX:MaxPermSize=512m to ATLAS_OPTS . Zookeeper throws exceptions when the test plan is run and Jmeter starts firing queries.