[TOREE-166] sqlContext not shared with PySpark and sparkR

• Type: Bug
• Status: Closed
• Resolution: Fixed
• Fix Version/s: 0.1.0
• Assignee: Gino Bustelo
• Reporter: nimbusgo
• Created: 19/Oct/15 23:09
• Updated: 04/Apr/16 19:20
• Resolved: 04/Apr/16 19:20

Description

The scala interpreter and sql interpreter appear to share the same sqlContext and you can select tables in the sql interpreter that were registered in the scala interpreter. However, It appears that the PySpark and SparkR interpreters each create their own sqlContext on construction, and dataframes registered on those sqlContext will not be shared with the sqlContext in other interpreters. Would it be possible to change it so that the python and R interpreters were instantiated with the same sqlContext as the scala interpreter?