[HIVE-8352] Enable windowing.q for spark [Spark Branch]

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: Spark
• Assignee: Jimmy Xiang
• Reporter: Brock Noland
• Created: 04/Oct/14 23:01
• Updated: 29/May/15 02:32
• Resolved: 06/Oct/14 20:16

Description

We should enable windowing.q for basic windowing coverage. After checking out the spark branch, we would build:

$ mvn clean install -DskipTests -Phadoop-2
$ cd itests/
$ mvn clean install -DskipTests -Phadoop-2

Then generate the windowing.q.out file:

$ cd qtest-spark/
$ mvn test -Dtest=TestSparkCliDriver -Dqfile=windowing.q -Phadoop-2 -Dtest.output.overwrite=true

Compare the output against MapReduce:

$ diff -y -W 150 ../../ql/src/test/results/clientpositive/spark/windowing.q.out ../../ql/src/test/results/clientpositive/windowing.q.out| less

And if everything looks good, add it to spark.query.files in ./itests/src/test/resources/testconfiguration.properties

then submit the patch including the .q file