[HIVE-9128] Evaluate hive.rpc.query.plan performance [Spark Branch]

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Spark
• Assignee: Jimmy Xiang
• Reporter: Brock Noland
• Created: 16/Dec/14 19:33
• Updated: 17/Dec/14 00:22

Description

Tez uses hive.rpc.query.plan which is used in Utilities.java. Basically instead of writing the query plan to HDFS, the query plan is placed in the JobConf object and then de-serialized form there.

We should do some evaluation to see which is more performant for us. We might need to place some timings in Utilities to understand this if the PerfLog doesn't have enough information today.