Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22572

spark-shell does not re-initialize on :replay

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.3.0
    • Fix Version/s: 2.3.0
    • Component/s: Spark Shell
    • Labels:
      None

      Description

      Spark-shell does not run the re-initialization script when a `:replay` command is issued:

      $ ./bin/spark-shell 
      17/11/21 12:01:00 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
      Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
      Setting default log level to "WARN".
      To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
      Spark context Web UI available at http://192.168.1.3:4040
      Spark context available as 'sc' (master = local[*], app id = local-1511262066013).
      Spark session available as 'spark'.
      Welcome to
            ____              __
           / __/__  ___ _____/ /__
          _\ \/ _ \/ _ `/ __/  '_/
         /___/ .__/\_,_/_/ /_/\_\   version 2.3.0-SNAPSHOT
            /_/
               
      Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_74)
      Type in expressions to have them evaluated.
      Type :help for more information.
      
      scala> sc
      res0: org.apache.spark.SparkContext = org.apache.spark.SparkContext@77bb916f
      
      scala> :replay
      Replaying: sc
      <console>:12: error: not found: value sc
             sc
             ^
      
      
      scala> sc
      <console>:12: error: not found: value sc
             sc
             ^
      
      scala>
      

        Attachments

          Activity

            People

            • Assignee:
              mpetruska Mark Petruska
              Reporter:
              mpetruska Mark Petruska
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: