Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-20561

Running SparkR with no RHive installed in secured environment

    XMLWordPrintableJSON

    Details

    • Type: Question
    • Status: Resolved
    • Priority: Major
    • Resolution: Invalid
    • Affects Version/s: 2.1.0
    • Fix Version/s: None
    • Component/s: Examples, Input/Output
    • Labels:
      None
    • Environment:

      Hadoop, Spark

      Description

      I need to start running data mining analysis in secured environment (IP, Port, and database name are given), where Spark runs on hive tables. So I have installed R, SparkR, dplyr, and some other r libraries.
      Now I understand that I need to point sparkR to that database(with IP/Port/Name).
      What should be my R code?
      I start with evoking R,
      then SparkR library.
      Next I right sc<-sparkR.init()
      it tells me immediately that spark-submit command:not found
      Do I need to have RHive installed first?
      Or should I actually point somehow to spark library and to that database?
      I couldn't find any documentation on that.
      Thank you

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              NatalieI Natalie
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: