Uploaded image for project: 'Livy'
  1. Livy
  2. LIVY-464

Cannot connect to Datastax standalone cluster DSE 5.1.5

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.5.0, 0.6.0
    • Fix Version/s: None
    • Component/s: Core
    • Labels:
      None
    • Environment:
      OSX and Ubuntu 16.04 in docker

      Description

      Using 

      livy.spark.master = dse://<server>:9042 
      The new way to define a datastax cluster as the spark master in livy.conf returns

      Error: Master must either be yarn or start with spark, mesos, local

      livy.spark.master = spark://<server>:9042 

       

      18/04/30 17:21:51 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:9042...

      18/04/30 17:21:51 INFO TransportClientFactory: Successfully created connection to <server>:9042 after 19 ms (0 ms spent in bootstraps)

      18/04/30 17:21:51 WARN TransportChannelHandler: Exception in connection from <server>:9042 java.lang.IllegalArgumentException: Frame length should be positive: -8858580467037765640

       

      livy.spark.master = spark://<server>:7077

       

      18/04/30 17:23:31 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:7077... 

      18/04/30 17:23:31 INFO TransportClientFactory: Successfully created connection to <server>:7077 after 15 ms (0 ms spent in bootstraps) 18/04/30 17:23:51 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:7077... 

      18/04/30 17:24:11 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:7077... 

      18/04/30 17:24:31 ERROR StandaloneSchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              konzy Brian Konzman
            • Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: