[HUDI-6956] Fix CI failure on master

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.0.0-beta1
• Labels: pull-request-available
• Story Points: 0.5
• Assignee: Ethan Guo (this is the old account; please use "yihua")
• Reporter: Ethan Guo (this is the old account; please use "yihua")
• Created: 18/Oct/23 20:30
• Updated: 23/Oct/23 21:09
• Resolved: 23/Oct/23 21:09

Description

CI failure in GH action running on Spark 2.4

2023-10-18T08:25:11.0927081Z - Test multiple partition fields pruning *** FAILED ***
2023-10-18T08:25:11.0928903Z   org.apache.spark.sql.catalyst.parser.ParseException: extraneous input ';' expecting <EOF>(line 2, pos 53)
2023-10-18T08:25:11.0930214Z 
2023-10-18T08:25:11.0930814Z == SQL ==
2023-10-18T08:25:11.0931092Z 
2023-10-18T08:25:11.0931565Z select * from h171 where day='2023-10-12' and hour=11;
2023-10-18T08:25:11.0932258Z -----------------------------------------------------^^^
2023-10-18T08:25:11.0933281Z   at org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:241)
2023-10-18T08:25:11.0934664Z   at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:117)
2023-10-18T08:25:11.0935909Z   at org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:48)
2023-10-18T08:25:11.0937200Z   at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:69)
2023-10-18T08:25:11.0938893Z   at org.apache.spark.sql.hudi.parser.HoodieSpark2ExtendedSqlParser$$anonfun$parsePlan$1.apply(HoodieSpark2ExtendedSqlParser.scala:45)
2023-10-18T08:25:11.0940866Z   at org.apache.spark.sql.hudi.parser.HoodieSpark2ExtendedSqlParser$$anonfun$parsePlan$1.apply(HoodieSpark2ExtendedSqlParser.scala:42)
2023-10-18T08:25:11.0942715Z   at org.apache.spark.sql.hudi.parser.HoodieSpark2ExtendedSqlParser.parse(HoodieSpark2ExtendedSqlParser.scala:80)
2023-10-18T08:25:11.0944508Z   at org.apache.spark.sql.hudi.parser.HoodieSpark2ExtendedSqlParser.parsePlan(HoodieSpark2ExtendedSqlParser.scala:42)
2023-10-18T08:25:11.0946437Z   at org.apache.spark.sql.parser.HoodieCommonSqlParser$$anonfun$parsePlan$1.apply(HoodieCommonSqlParser.scala:43)
2023-10-18T08:25:11.0948031Z   at org.apache.spark.sql.parser.HoodieCommonSqlParser$$anonfun$parsePlan$1.apply(HoodieCommonSqlParser.scala:40)
2023-10-18T08:25:11.0949087Z   ...
2023-10-18T08:25:31.8632763Z - Test single partiton field pruning *** FAILED ***
2023-10-18T08:25:31.8634653Z   org.apache.spark.sql.catalyst.parser.ParseException: extraneous input ';' expecting <EOF>(line 2, pos 53)
2023-10-18T08:25:31.8635951Z 
2023-10-18T08:25:31.8636595Z == SQL ==
2023-10-18T08:25:31.8636881Z 
2023-10-18T08:25:31.8637365Z select * from h172 where day='2023-10-12' and hour=11;
2023-10-18T08:25:31.8638064Z -----------------------------------------------------^^^
2023-10-18T08:25:31.8639056Z   at org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:241)
2023-10-18T08:25:31.8640426Z   at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:117)
2023-10-18T08:25:31.8641945Z   at org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:48)
2023-10-18T08:25:31.8643243Z   at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:69)
2023-10-18T08:25:31.8644939Z   at org.apache.spark.sql.hudi.parser.HoodieSpark2ExtendedSqlParser$$anonfun$parsePlan$1.apply(HoodieSpark2ExtendedSqlParser.scala:45)
2023-10-18T08:25:31.8646914Z   at org.apache.spark.sql.hudi.parser.HoodieSpark2ExtendedSqlParser$$anonfun$parsePlan$1.apply(HoodieSpark2ExtendedSqlParser.scala:42)
2023-10-18T08:25:31.8648770Z   at org.apache.spark.sql.hudi.parser.HoodieSpark2ExtendedSqlParser.parse(HoodieSpark2ExtendedSqlParser.scala:80)
2023-10-18T08:25:31.8650554Z   at org.apache.spark.sql.hudi.parser.HoodieSpark2ExtendedSqlParser.parsePlan(HoodieSpark2ExtendedSqlParser.scala:42)
2023-10-18T08:25:31.8652258Z   at org.apache.spark.sql.parser.HoodieCommonSqlParser$$anonfun$parsePlan$1.apply(HoodieCommonSqlParser.scala:43)
2023-10-18T08:25:31.8653871Z   at org.apache.spark.sql.parser.HoodieCommonSqlParser$$anonfun$parsePlan$1.apply(HoodieCommonSqlParser.scala:40)
2023-10-18T08:25:31.8654880Z   ... 

Issue Links

• links to: GitHub Pull Request #9880