[HBASE-16117] Fix Connection leak in mapred.TableOutputFormat

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.3.0, 1.2.2, 1.1.6, 2.0.0
• Fix Version/s: 2.0.0
• Component/s: mapreduce
• Hadoop Flags: Incompatible change, Reviewed

Release Note

(This change will be irrelevant after HBASE-16774 lands).
There is a subtle change with error handling when a connection is not able to connect to ZK. Attempts to create a connection when ZK is not up will now fail immediately instead of silently creating and then failing on a subsequent HBaseAdmin call.

• Assignee: Jonathan Hsieh
• Reporter: Jonathan Hsieh
• Created: 26/Jun/16 23:50
• Updated: 08/Oct/16 00:33
• Resolved: 08/Oct/16 00:33

Description

Spark seems to instantiate multiple instances of output formats within a single process. When mapred.TableOutputFormat (not mapreduce.TableOutputFormat) is used, this may cause connection leaks that slowly exhaust the cluster's zk connections.

This patch fixes that.

Issue Links

• is duplicated by: HBASE-16017 HBase TableOutputFormat has connection leak in getRecordWriter
• is related to: HBASE-16774 [shell] Add coverage to TestShell when ZooKeeper is not reachable
• links to: Review Board (branch-1)