Details
-
Sub-task
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
HIVE-21846 is suboptimal if we have big number of TezAMs and LlapDaemons.
We have to find a better way which is scaleable.
Possible solution could be:
- Elect a TezAM leader for statistics fetching using ZooKeeper for the election
- TezAM should become a leader and fetch LlapDaemon data from the Daemons if there is no existing leader
- TezAM should query the data from the leader TezAM if there is an existing leader.