[DRILL-5287] Provide option to skip updates of ephemeral state changes in Zookeeper

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.9.0
• Fix Version/s: 1.10.0
• Labels: doc-impacting ready-to-commit
• Assignee: Padma Penumarthy
• Reporter: Padma Penumarthy
• Reviewer: Kunal Khatua
• Created: 21/Feb/17 21:43
• Updated: 28/Mar/17 06:14
• Resolved: 02/Mar/17 22:50

Description

We put transient profiles in zookeeper and update state as query progresses and changes states. It is observed that this adds latency of ~45msec for each update in the query execution path. This gets even worse when high number of concurrent queries are in progress. For concurrency=100, the average query response time even for short queries is 8 sec vs 0.2 sec with these updates disabled. For short lived queries in a high-throughput scenario, it is of no value to update state changes in zookeeper. We need an option to disable these updates for short running operational queries.

Issue Links

• links to: GitHub Pull Request #758