[SPARK-2814] HiveThriftServer throws NPE when executing native commands

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.1.0
• Component/s: SQL
• Target Version/s: 1.1.0
• Assignee: Cheng Lian
• Reporter: Cheng Lian
• Created: 03/Aug/14 13:31
• Updated: 22/Oct/14 06:55
• Resolved: 03/Aug/14 19:35

Description

After PR #1686, HiveThriftServer2 throws exception when executing native commands.

The reason is that initialization of HiveContext.sessionState.out and HiveContext.sessionState.err were made lazy, while HiveThriftServer2 uses an overriden version of HiveContext that doesn't know how to initialize these two streams. When HiveContext.runHive tries to write to HiveContext.sessionState.out, an NPE is throw.

Reproduction steps:

1. Start HiveThriftServer2
2. Connect to it via beeline
3. Execute `set;`

Exception thrown:

======================
HIVE FAILURE OUTPUT
======================


======================
END HIVE FAILURE OUTPUT
======================

14/08/03 21:30:55 ERROR SparkSQLOperationManager: Error executing query:
java.lang.NullPointerException
        at org.apache.spark.sql.hive.HiveContext.runHive(HiveContext.scala:210)
        at org.apache.spark.sql.hive.HiveContext.runSqlHive(HiveContext.scala:173)
        at org.apache.spark.sql.hive.HiveContext.set(HiveContext.scala:144)
        at org.apache.spark.sql.execution.SetCommand.sideEffectResult$lzycompute(commands.scala:59)
        at org.apache.spark.sql.execution.SetCommand.sideEffectResult(commands.scala:50)
        ...

Issue Links

• is related to: SPARK-4037 NPE in JDBC server when calling SET
• links to: [Github] Pull Request #1753 (liancheng)