[SPARK-21910] Connection pooling in Spark Job using HBASE Context

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 1.6.0
• Component/s: DStreams
• Assignee: Unassigned
• Reporter: Venkat Gurukrishna
• Created: 04/Sep/17 14:49
• Updated: 04/Sep/17 15:07
• Resolved: 04/Sep/17 14:59

Description

Is there a way to implement the HBASE connection pool using the HBASE Context? In our spark job we are making the HBASE call for each batch and we see new connection object is getting created for each batch interval of one second. We want to implement the connection pooling for HBASE context. Not able to do the same. Is there way to achieve the same the connection pool to HBASE using HBASE Context. We are using Spark 1.6.0, CDH 5.8.3, HBASE 1.2.0