[SPARK-32829] while parsing the data from parquet to case class

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Invalid
• Affects Version/s: 2.4.3
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: Manjay Kumar
• Created: 09/Sep/20 07:46
• Updated: 09/Sep/20 11:30
• Resolved: 09/Sep/20 11:30

Description

Caused by: java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.MutableDouble cannot be cast to org.apache.spark.sql.catalyst.expressions.MutableLong

 
I am trying to parse the the parquet file to dataset using case class with encoders. 

this is very much known error , but don't see the resolution.

could you please help on this.

 

https://stackoverflow.com/questions/51300978/spark-error-reading-parquet?rq=1

 similar like this :: https://issues.apache.org/jira/browse/SPARK-17477