[SPARK-8840] Float type coercion with hiveContext

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.5.0
• Component/s: SparkR
• Assignee: L. C. Hsieh
• Reporter: Evgeny SInelnikov
• Created: 06/Jul/15 12:45
• Updated: 16/Jul/15 22:24
• Resolved: 15/Jul/15 16:48

Description

Problem with float type coercion on SparkR with hiveContext.

> result <- sql(hiveContext, "SELECT offset, percentage from data limit 100")
> show(result)
DataFrame[offset:float, percentage:float]
> head(result)
Error in as.data.frame.default(x[[i]], optional = TRUE) :
    cannot coerce class ""jobj"" to a data.frame

This trouble looks like already exists (SPARK-2863 - Emulate Hive type
coercion in native reimplementations of Hive functions) with same
reason - not completed "native reimplementations of Hive..." not
"...functions" only.

I used spark 1.4.0 binaries from official site:
http://spark.apache.org/downloads.html
And running it on:

• Hortonworks HDP 2.2.0.0-2041
• with Hive 0.14
• with disabled hooks for Application Timeline Servers (ATSHook) in hive-site.xml, commented:
  • hive.exec.failure.hooks,
  • hive.exec.post.hooks,
  • hive.exec.pre.hooks.

Issue Links

• is duplicated by: SPARK-8897 SparkR DataFrame fail to return data of float type
• links to: [Github] Pull Request #7280 (viirya)