[ZEPPELIN-6082] The ._* files still exist in Zeppelin version 0.11.2

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Fix Version/s: 0.12.0
• Labels: ossca2024
• Assignee: Unassigned
• Reporter: Gyeongtae Park
• Created: 08/Sep/24 07:33
• Updated: 08/Sep/24 13:26
• Resolved: 08/Sep/24 13:26

Description

The ._* files still exist in Zeppelin version 0.11.2.

Cannot run the Spark interpreter.

org.apache.zeppelin.interpreter.InterpreterException: org.apache.zeppelin.interpreter.InterpreterException: Fail to open SparkInterpreter
	at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:76)
	at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:861)
	at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:769)
	at org.apache.zeppelin.scheduler.Job.run(Job.java:186)
	at org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:135)
	at org.apache.zeppelin.scheduler.FIFOScheduler.lambda$runJobInScheduler$0(FIFOScheduler.java:42)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)
Caused by: org.apache.zeppelin.interpreter.InterpreterException: Fail to open SparkInterpreter
	at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:140)
	at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
	... 8 more
Caused by: scala.reflect.internal.FatalError: Error accessing /opt/zeppelin/interpreter/spark/._spark-interpreter-0.11.1.jar
	at scala.tools.nsc.classpath.AggregateClassPath.$anonfun$list$3(AggregateClassPath.scala:113)
	at scala.collection.Iterator.foreach(Iterator.scala:943)
	at scala.collection.Iterator.foreach$(Iterator.scala:943)
	at scala.collection.AbstractIterator.foreach(Iterator.scala:1431)
	at scala.collection.IterableLike.foreach(IterableLike.scala:74)
	at scala.collection.IterableLike.foreach$(IterableLike.scala:73)
	at scala.collection.AbstractIterable.foreach(Iterable.scala:56)
	at scala.tools.nsc.classpath.AggregateClassPath.list(AggregateClassPath.scala:101)
	at scala.tools.nsc.util.ClassPath.list(ClassPath.scala:36)
	at scala.tools.nsc.util.ClassPath.list$(ClassPath.scala:36)
	at scala.tools.nsc.classpath.AggregateClassPath.list(AggregateClassPath.scala:30)
	at scala.tools.nsc.symtab.SymbolLoaders$PackageLoader.doComplete(SymbolLoaders.scala:298)
	at scala.tools.nsc.symtab.SymbolLoaders$SymbolLoader.complete(SymbolLoaders.scala:250)
	at scala.reflect.internal.Symbols$Symbol.completeInfo(Symbols.scala:1542)
	at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1514)
	at scala.reflect.internal.Mirrors$RootsBase.init(Mirrors.scala:258)
	at scala.tools.nsc.Global.rootMirror$lzycompute(Global.scala:74)
	at scala.tools.nsc.Global.rootMirror(Global.scala:72)
	at scala.tools.nsc.Global.rootMirror(Global.scala:44)
	at scala.reflect.internal.Definitions$DefinitionsClass.ObjectClass$lzycompute(Definitions.scala:294)
	at scala.reflect.internal.Definitions$DefinitionsClass.ObjectClass(Definitions.scala:294)
	at scala.reflect.internal.Definitions$DefinitionsClass.init(Definitions.scala:1504)
	at scala.tools.nsc.Global$Run.<init>(Global.scala:1213)
	at scala.tools.nsc.interpreter.IMain._initialize(IMain.scala:124)
	at scala.tools.nsc.interpreter.IMain.initializeSynchronous(IMain.scala:146)
	at org.apache.zeppelin.spark.SparkScala212Interpreter.createSparkILoop(SparkScala212Interpreter.scala:195)
	at org.apache.zeppelin.spark.AbstractSparkScalaInterpreter.open(AbstractSparkScalaInterpreter.java:116)
	at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:124)
	... 9 more
Caused by: java.io.IOException: Error accessing /opt/zeppelin/interpreter/spark/._spark-interpreter-0.11.1.jar
	at scala.reflect.io.FileZipArchive.scala$reflect$io$FileZipArchive$$openZipFile(ZipArchive.scala:182)
	at scala.reflect.io.FileZipArchive.root$lzycompute(ZipArchive.scala:230)
	at scala.reflect.io.FileZipArchive.root(ZipArchive.scala:227)
	at scala.reflect.io.FileZipArchive.allDirs$lzycompute(ZipArchive.scala:264)
	at scala.reflect.io.FileZipArchive.allDirs(ZipArchive.scala:264)
	at scala.tools.nsc.classpath.ZipArchiveFileLookup.findDirEntry(ZipArchiveFileLookup.scala:76)
	at scala.tools.nsc.classpath.ZipArchiveFileLookup.list(ZipArchiveFileLookup.scala:63)
	at scala.tools.nsc.classpath.ZipArchiveFileLookup.list$(ZipArchiveFileLookup.scala:62)
	at scala.tools.nsc.classpath.ZipAndJarClassPathFactory$ZipArchiveClassPath.list(ZipAndJarFileLookupFactory.scala:58)
	at scala.tools.nsc.classpath.AggregateClassPath.$anonfun$list$3(AggregateClassPath.scala:105)
	... 36 more
Caused by: java.util.zip.ZipException: error in opening zip file
	at java.util.zip.ZipFile.open(Native Method)
	at java.util.zip.ZipFile.<init>(ZipFile.java:231)
	at java.util.zip.ZipFile.<init>(ZipFile.java:157)
	at java.util.zip.ZipFile.<init>(ZipFile.java:171)
	at scala.reflect.io.FileZipArchive.scala$reflect$io$FileZipArchive$$openZipFile(ZipArchive.scala:179)
	... 45 more 

• run command

  find . -name "._*" -exec rm -f {} \; 

  

 

Previous issue list

 

• ZEPPELIN-6029 zeppelin-0.11.1-bin-all.tgz contains obsolete hidden files

• • https://issues.apache.org/jira/browse/ZEPPELIN-6029?filter=-4&jql=project%20%3D%20ZEPPELIN%20order%20by%20created%20DESC
• ZEPPELIN-6030 Bug Report: Apache Zeppelin 0.11.1 Issue with Spark Interpreter
  • https://issues.apache.org/jira/browse/ZEPPELIN-6030?filter=-4&jql=project%20%3D%20ZEPPELIN%20order%20by%20created%20DESC