Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-2518

Moving spark dataframe from spark.pyspark to spark.r

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Not A Bug
    • Affects Version/s: 0.7.1
    • Fix Version/s: 0.7.1
    • Labels:
      None
    • Environment:

      ubuntu 16.04, AWS EC2, 64 Gb RAM, Octa core

      Description

      I am trying to pass the spark.sql.dataframe df_weekly from spark.pyspark to spark.r

      spark.pyspark
      z.put("df_weekly",df_weekly._jdf)
      
      spark.r
      library(SparkR)
      df_weekly = z.get("df_weekly")
      type(df_weekly)
      

      The object received in R is of class "jobj"

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              mrshanth Prasanth
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 48h
                48h
                Remaining:
                Remaining Estimate - 48h
                48h
                Logged:
                Time Spent - Not Specified
                Not Specified