[SPARK-33948] ExpressionEncoderSuite failed in spark-branch-3.1-test-maven-hadoop-*-jdk-*-scala-2.13

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.1
• Component/s: Spark Core, SQL

Environment

 

• Assignee: Yang Jie
• Reporter: Yang Jie
• Created: 31/Dec/20 08:04
• Updated: 07/Jan/21 03:13
• Resolved: 06/Jan/21 07:12

Description

https://amplab.cs.berkeley.edu/jenkins/job/spark-branch-3.1-test-maven-hadoop-3.2-jdk-11-scala-2.13/118/#showFailuresLink

 ExpressionEncoderSuite

• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(String, String)],ArrayBuffer((a,b))) (codegen path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(String, String)],ArrayBuffer((a,b))) (interpreted path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(Int, Int)],ArrayBuffer((1,2))) (codegen path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(Int, Int)],ArrayBuffer((1,2))) (interpreted path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(Long, Long)],ArrayBuffer((1,2))) (codegen path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(Long, Long)],ArrayBuffer((1,2))) (interpreted path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(Float, Float)],ArrayBuffer((1.0,2.0))) (codegen path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(Float, Float)],ArrayBuffer((1.0,2.0))) (interpreted path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(Double, Double)],ArrayBuffer((1.0,2.0))) (codegen path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(Double, Double)],ArrayBuffer((1.0,2.0))) (interpreted path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(Short, Short)],ArrayBuffer((1,2))) (codegen path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(Short, Short)],ArrayBuffer((1,2))) (interpreted path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(Byte, Byte)],ArrayBuffer((1,2))) (codegen path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(Byte, Byte)],ArrayBuffer((1,2))) (interpreted path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(Boolean, Boolean)],ArrayBuffer((true,false))) (codegen path)
• org.apache.spark.sql.catalyst.encoders.ExpressionEncoderSuite.encode/decode for Tuple2: (ArrayBuffer[(Boolean, Boolean)],ArrayBuffer((true,false))) (interpreted path)

Issue Links

• is caused by: SPARK-33619 GetMapValueUtil code generation error
• links to: [Github] Pull Request #31055 (LuciferYang)
• links to: [Github] Pull Request #31055 (LuciferYang)