[SPARK-19541] High Availability support for ThriftServer

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.0.2, 2.1.0
• Component/s: SQL
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: LvDongrong
• Created: 10/Feb/17 01:26
• Updated: 21/Jul/21 10:10
• Resolved: 21/May/19 04:17

Description

Currently, We use the spark ThriftServer frequently, and there are many connects between the client and only ThriftServer.When the ThriftServer is down ,we cannot get the service again until the server is restarted .So we need to consider the ThriftServer HA as well as HiveServer HA. For ThriftServer, we want to import the pattern of HiveServer HA to provide ThriftServer HA. Therefore, we need to start multiple thrift server which register on the zookeeper. Then the client can find the thrift server by just connecting to the zookeeper.So the beeline can get the service from other thrift server when one is down.

Issue Links

• relates to: SPARK-11100 HiveThriftServer HA issue,HiveThriftServer not registering with Zookeeper
• links to: [Github] Pull Request #16879 (lvdongr)