-
Type:
Bug
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: 1.2.0
-
Fix Version/s: 3.0.0-alpha-1
-
Labels:
-
Environment:
hbase-spark-1.2.0-cdh5.12.1 version
spark 1.6
-
Hadoop Flags:Reviewed
-
Flags:Patch, Important
In hbase-spark project, HBaseContext provides bulkload methond for loading spark rdd data to hbase easily.But when i using it frequently, the program will throw "cannot create native thread" exception.
using pstack command in spark driver process , the thread num is increasing
using jstack, named "main-SendThread" and "main-EventThread" thread so many
It seems like that , connection created before bulkload ,but close method uninvoked at last