Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-1175

AM log is not available for yarn-client mode

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.6.0
    • Fix Version/s: 0.6.1, 0.7.0
    • Component/s: Interpreters
    • Labels:
      None

      Description

      Zeppelin's log4j.properties is propagated to AM, and the AM can not initialize log4j properly. Because zeppelin's log4j.properties will use ${zeppelin.log.file} which is only for zeppelin server.

      Here's the error message in AM

      log4j:ERROR setFile(null,true) call failed.
      java.io.FileNotFoundException:  (No such file or directory)
      	at java.io.FileOutputStream.open0(Native Method)
      	at java.io.FileOutputStream.open(FileOutputStream.java:270)
      	at java.io.FileOutputStream.<init>(FileOutputStream.java:213)
      	at java.io.FileOutputStream.<init>(FileOutputStream.java:133)
      	at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)
      	at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)
      	at org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:223)
      	at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
      	at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172)
      	at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104)
      	at org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:842)
      	at org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:768)
      	at org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:648)
      	at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:514)
      	at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:580)
      	at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
      	at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)
      	at org.apache.spark.Logging$class.initializeLogging(Logging.scala:121)
      	at org.apache.spark.Logging$class.initializeIfNecessary(Logging.scala:106)
      	at org.apache.spark.Logging$class.log(Logging.scala:50)
      	at org.apache.spark.executor.CoarseGrainedExecutorBackend$.log(CoarseGrainedExecutorBackend.scala:138)
      	at org.apache.spark.executor.CoarseGrainedExecutorBackend$.run(CoarseGrainedExecutorBackend.scala:149)
      	at org.apache.spark.executor.CoarseGrainedExecutorBackend$.main(CoarseGrainedExecutorBackend.scala:253)
      	at org.apache.spark.executor.CoarseGrainedExecutorBackend.main(CoarseGrainedExecutorBackend.scala)
      log4j:ERROR Either File or DatePattern options are not set for appender [dailyfile].
      SLF4J: Class path contains multiple SLF4J bindings.
      SLF4J: Found binding in [jar:file:/grid/0/hadoop/yarn/local/filecache/27/spark-hdp-assembly.jar!/org/slf4j/impl/StaticLoggerBinder.class]
      SLF4J: Found binding in [jar:file:/grid/0/hdp/2.5.0.0-965/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
      SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
      SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                zjffdu Jeff Zhang
                Reporter:
                zjffdu Jeff Zhang
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: