[HIVE-10671] yarn-cluster mode offers a degraded performance from yarn-client [Spark Branch]

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0, 2.0.0
• Component/s: Spark
• Assignee: Rui Li
• Reporter: Xuefu Zhang
• Created: 11/May/15 19:46
• Updated: 16/Feb/16 23:50
• Resolved: 14/May/15 21:24

Description

With Hive on Spark, users noticed that in certain cases spark.master=yarn-client offers 2x or 3x better performance than if spark.master=yarn-cluster. However, yarn-cluster is what we recommend and support. Thus, we should investigate and fix the problem. One of the such queries is TPC-H 22.

Issue Links

• links to: RB entry