[HIVE-7702] Start running .q file tests on spark [Spark Branch]

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: Spark
• Assignee: Chinna Rao Lalam
• Reporter: Brock Noland
• Created: 13/Aug/14 00:39
• Updated: 29/May/15 02:27
• Resolved: 22/Aug/14 20:34

Description

Spark can currently only support a few queries, however there are some .q file tests which will pass today. The basic idea is that we should get some number of these actually working (10-20) so we can actually start testing the project.

A good starting point might be the udf*, varchar*, or alter* tests:

https://github.com/apache/hive/tree/spark/ql/src/test/queries/clientpositive

To generate the output file for test XXX.q, you'd do:

mvn clean install -DskipTests -Phadoop-2
cd itests
mvn clean install -DskipTests -Phadoop-2
cd qtest-spark
mvn test -Dtest= TestSparkCliDriver -Dqfile=XXX.q -Dtest.output.overwrite=true -Phadoop-2

which would generate XXX.q.out which we can check-in to source control as a "golden file".

Multiple tests can be run at a give time as so:

mvn test -Dtest= TestSparkCliDriver -Dqfile=X1.q,X2.q -Dtest.output.overwrite=true -Phadoop-2

Issue Links

• relates to: HIVE-7717 Add .q tests coverage for "union all" [Spark Branch]