Uploaded image for project: 'Apache DataLab'
  1. Apache DataLab
  2. DATALAB-2428

[GCP][Investigation][Dataproc][Apache Standalone cluster] Often Flights_data_Preparation/Visualisation_R playbooks fail

    XMLWordPrintableJSON

    Details

      Description

      Preconditions:

      1. Dataproc is running on Jupyter

      Steps to reproduce:

      1. Run Flights_data_Preparation/Visualisation_R on Dataproc

      Actual result:

      1. Flights_data_Preparation/Visualisation_R running fails

      Dataproc:

      An error was encountered:
      Spark package found in SPARK_HOME: /usr/lib/spark
      [1] "Error in writeJobj(con, object): invalid jobj 1"
      

      Apache Standalone cluster:

      An error was encountered:
      Spark package found in SPARK_HOME: /opt/spark
      [1] "Error in writeJobj(con, object): invalid jobj 1"
      

      Expected result:

      1. Flights_data_Preparation/Visualisation_R running is running succesfully

       

        Attachments

        1. Dataproc R.png
          97 kB
          Vira Vitanska

          Activity

            People

            • Assignee:
              mykolabodnar Mykola Bodnar
              Reporter:
              vvitanska Vira Vitanska
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: