[HUDI-2661] java.lang.NoSuchMethodError: org.apache.spark.sql.catalyst.catalog.CatalogTable.copy

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Not A Bug
• Affects Version/s: 0.10.0
• Component/s: spark
• Story Points: 1
• Assignee: Forward Xu
• Reporter: Changjun Zhang

Reviewers

Raymond Xu

• Created: 01/Nov/21 13:48
• Updated: 06/Jan/22 07:36
• Resolved: 06/Jan/22 07:36

Description

Hudi Integrate with Spark SQL  :

when I add :

// Some comments here
spark-sql --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer' \
--conf 'spark.sql.extensions=org.apache.spark.sql.hudi.HoodieSparkSessionExtension'

to create a table on an existing hudi table:

create table testdb.tb_hudi_operation_test using hudi 
location '/tmp/flinkdb/datas/tb_hudi_operation';

then throw Exception :