[SPARK-33317] Spark Hive SQL returning empty dataframe

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 2.4.6
• Component/s: Spark Core, Spark Shell
• Assignee: Unassigned
• Reporter: Debadutta
• Created: 02/Nov/20 10:30
• Updated: 12/Dec/22 18:10
• Resolved: 03/Nov/20 05:37

Description

I am trying to run a sql query on a hive table using hive connector in spark but I am getting an empty dataframe. The query I am trying to run:-

sparkSession.sql("select fmid from farmers where fmid between ' 1000405134' and '1000772585'")

This is failing but if I remove the leading whitespaces it works.

sparkSession.sql("select fmid from farmers where fmid between '1000405134' and '1000772585'")

Currently, I am removing leading and trailing whitespaces as a workaround. But the same query with whitespaces works fine in hive console.