[HIVE-7717] Add .q tests coverage for "union all" [Spark Branch]

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: spark-branch
• Fix Version/s: 1.1.0
• Component/s: Spark
• Assignee: Na Yang
• Reporter: Na Yang
• Created: 13/Aug/14 19:21
• Updated: 29/May/15 02:32
• Resolved: 20/Aug/14 00:48

Description

Add automation test coverage for "union all", by searching through the q-tests in "ql/src/test/queries/clientpositive/" for union tests (like union*.q) and verifying/enabling them on spark.

Steps to do:

1. Enable a qtest <q-test-name>.q in itests/src/test/resources/testconfiguration.properties by adding the .q test files to spark.query.files.
2. Run mvn test -Dtest=TestSparkCliDriver -Dqfile=<q-test-name>.q -Dtest.output.overwrite=true -Phadoop-2 to generate the output (located in ql/src/test/results/clientpositive/spark). File will be called <q-test-name>.q.out.
3. Check the generated output is good by verifying the results. For comparison, check the MR version in ql/src/test/results/clientpositive/<q-test-name>.q.out. The reason its separate is because the explain plan outputs are different for Spark/MR.
4. Checkin the modification to testconfiguration.properties, and the generated q.out file as well. You only have to generate the output once.

Issue Links

• depends upon: HIVE-7541 Support union all on Spark [Spark Branch]
• depends upon: HIVE-7769 add --SORT_BEFORE_DIFF to union all .q tests
• Is contained by: HIVE-7292 Hive on Spark
• is related to: HIVE-7702 Start running .q file tests on spark [Spark Branch]
• relates to: HIVE-7767 hive.optimize.union.remove does not work properly [Spark Branch]