[SPARK-11823] HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Component/s: Tests
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Shane Knapp
• Created: 18/Nov/15 19:30
• Updated: 21/May/19 04:36
• Resolved: 21/May/19 04:36

Description

i've noticed on a few branches that the HiveThriftBinaryServerSuite tests time out, and when that happens, the build is aborted but the tests leave behind hanging processes that eat up cpu and ram.

most recently, i discovered this happening w/the 1.6 SBT build, specifically w/the hadoop 2.0 profile:

https://amplab.cs.berkeley.edu/jenkins/job/Spark-1.6-SBT/AMPLAB_JENKINS_BUILD_PROFILE=hadoop2.0,label=spark-test/56/console

vanzin grabbed the jstack log, which i've attached to this issue.

Issue Links

• is duplicated by: SPARK-11931 "org.apache.spark.sql.hive.thriftserver.HiveThriftBinaryServerSuite.test jdbc cancel" is sometimes very slow
• is related to: SPARK-11931 "org.apache.spark.sql.hive.thriftserver.HiveThriftBinaryServerSuite.test jdbc cancel" is sometimes very slow
• links to: [Github] Pull Request #10425 (JoshRosen)
• links to: [Github] Pull Request #10715 (yhuai)