Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2562

Web application not getting started and Tomcat is shutting down with hadoop-2.7.2

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Won't Fix
    • 4.2.0
    • 4.2.0
    • None
    • None
    • Centos7

    • Important

    Description

      Jun 08, 2016 11:40:47 AM org.apache.catalina.core.AprLifecycleListener init
      INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path:
      Jun 08, 2016 11:40:48 AM org.apache.coyote.http11.Http11Protocol init
      SEVERE: Error initializing endpoint
      java.net.BindException: Address already in use <null>:11000
      at org.apache.tomcat.util.net.JIoEndpoint.init(JIoEndpoint.java:549)
      at org.apache.coyote.http11.Http11Protocol.init(Http11Protocol.java:182)
      at org.apache.catalina.connector.Connector.initialize(Connector.java:1123)
      at org.apache.catalina.core.StandardService.initialize(StandardService.java:703)
      at org.apache.catalina.core.StandardServer.initialize(StandardServer.java:843)
      at org.apache.catalina.startup.Catalina.load(Catalina.java:538)
      at org.apache.catalina.startup.Catalina.load(Catalina.java:562)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.apache.catalina.startup.Bootstrap.load(Bootstrap.java:261)
      at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:413)
      Caused by: java.net.BindException: Address already in use
      at java.net.PlainSocketImpl.socketBind(Native Method)
      at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:376)
      at java.net.ServerSocket.bind(ServerSocket.java:376)
      at java.net.ServerSocket.<init>(ServerSocket.java:237)
      at java.net.ServerSocket.<init>(ServerSocket.java:181)
      at org.apache.tomcat.util.net.DefaultServerSocketFactory.createSocket(DefaultServerSocketFactory.java:50)
      at org.apache.tomcat.util.net.JIoEndpoint.init(JIoEndpoint.java:538)
      ... 12 more

      Jun 08, 2016 11:40:48 AM org.apache.catalina.core.StandardService initialize
      SEVERE: Failed to initialize connector [Connector[HTTP/1.1-11000]]
      LifecycleException: Protocol handler initialization failed: java.net.BindException: Address already in use <null>:11000
      at org.apache.catalina.connector.Connector.initialize(Connector.java:1125)
      at org.apache.catalina.core.StandardService.initialize(StandardService.java:703)
      at org.apache.catalina.core.StandardServer.initialize(StandardServer.java:843)
      at org.apache.catalina.startup.Catalina.load(Catalina.java:538)
      at org.apache.catalina.startup.Catalina.load(Catalina.java:562)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.apache.catalina.startup.Bootstrap.load(Bootstrap.java:261)
      at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:413)

      Jun 08, 2016 11:40:48 AM org.apache.catalina.startup.Catalina load
      INFO: Initialization processed in 594 ms
      Jun 08, 2016 11:40:48 AM org.apache.catalina.core.StandardService start
      INFO: Starting service Catalina
      Jun 08, 2016 11:40:48 AM org.apache.catalina.core.StandardEngine start
      INFO: Starting Servlet Engine: Apache Tomcat/6.0.43
      Jun 08, 2016 11:40:48 AM org.apache.catalina.startup.HostConfig deployDescriptor
      INFO: Deploying configuration descriptor oozie.xml
      Jun 08, 2016 11:40:52 AM org.apache.catalina.loader.WebappClassLoader validateJarFile
      INFO: validateJarFile(/usr/local/oozie/distro/target/oozie-4.2.0-distro/oozie-4.2.0/oozie-server/webapps/oozie/WEB-INF/lib/hive-jdbc-2.0.0-standalone.jar) - jar not loaded. See Servlet Spec 2.3, section 9.7.2. Offending class: javax/servlet/Servlet.class
      Jun 08, 2016 11:40:52 AM org.apache.catalina.loader.WebappClassLoader validateJarFile
      INFO: validateJarFile(/usr/local/oozie/distro/target/oozie-4.2.0-distro/oozie-4.2.0/oozie-server/webapps/oozie/WEB-INF/lib/servlet-api-2.5.jar) - jar not loaded. See Servlet Spec 2.3, section 9.7.2. Offending class: javax/servlet/Servlet.class
      Jun 08, 2016 11:40:52 AM org.apache.catalina.loader.WebappClassLoader validateJarFile
      INFO: validateJarFile(/usr/local/oozie/distro/target/oozie-4.2.0-distro/oozie-4.2.0/oozie-server/webapps/oozie/WEB-INF/lib/servlet-api.jar) - jar not loaded. See Servlet Spec 2.3, section 9.7.2. Offending class: javax/servlet/Servlet.class
      Jun 08, 2016 11:40:55 AM org.apache.catalina.core.AprLifecycleListener init
      INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path:
      Jun 08, 2016 11:40:55 AM org.apache.coyote.http11.Http11Protocol init
      SEVERE: Error initializing endpoint
      java.net.BindException: Address already in use <null>:11000
      at org.apache.tomcat.util.net.JIoEndpoint.init(JIoEndpoint.java:549)
      at org.apache.coyote.http11.Http11Protocol.init(Http11Protocol.java:182)
      at org.apache.catalina.connector.Connector.initialize(Connector.java:1123)
      at org.apache.catalina.core.StandardService.initialize(StandardService.java:703)
      at org.apache.catalina.core.StandardServer.initialize(StandardServer.java:843)
      at org.apache.catalina.startup.Catalina.load(Catalina.java:538)
      at org.apache.catalina.startup.Catalina.load(Catalina.java:562)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.apache.catalina.startup.Bootstrap.load(Bootstrap.java:261)
      at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:413)
      Caused by: java.net.BindException: Address already in use
      at java.net.PlainSocketImpl.socketBind(Native Method)
      at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:376)
      at java.net.ServerSocket.bind(ServerSocket.java:376)
      at java.net.ServerSocket.<init>(ServerSocket.java:237)
      at java.net.ServerSocket.<init>(ServerSocket.java:181)
      at org.apache.tomcat.util.net.DefaultServerSocketFactory.createSocket(DefaultServerSocketFactory.java:50)
      at org.apache.tomcat.util.net.JIoEndpoint.init(JIoEndpoint.java:538)
      ... 12 more

      Jun 08, 2016 11:40:55 AM org.apache.catalina.core.StandardService initialize
      SEVERE: Failed to initialize connector [Connector[HTTP/1.1-11000]]
      LifecycleException: Protocol handler initialization failed: java.net.BindException: Address already in use <null>:11000
      at org.apache.catalina.connector.Connector.initialize(Connector.java:1125)
      at org.apache.catalina.core.StandardService.initialize(StandardService.java:703)
      at org.apache.catalina.core.StandardServer.initialize(StandardServer.java:843)
      at org.apache.catalina.startup.Catalina.load(Catalina.java:538)
      at org.apache.catalina.startup.Catalina.load(Catalina.java:562)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.apache.catalina.startup.Bootstrap.load(Bootstrap.java:261)
      at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:413)

      Jun 08, 2016 11:40:55 AM org.apache.catalina.startup.Catalina load
      INFO: Initialization processed in 740 ms
      Jun 08, 2016 11:40:55 AM org.apache.catalina.core.StandardService start
      INFO: Starting service Catalina
      Jun 08, 2016 11:40:55 AM org.apache.catalina.core.StandardEngine start
      INFO: Starting Servlet Engine: Apache Tomcat/6.0.43
      Jun 08, 2016 11:40:55 AM org.apache.catalina.startup.HostConfig deployDescriptor
      INFO: Deploying configuration descriptor oozie.xml
      Jun 08, 2016 11:40:55 AM org.apache.catalina.loader.WebappClassLoader validateJarFile
      INFO: validateJarFile(/usr/local/oozie/distro/target/oozie-4.2.0-distro/oozie-4.2.0/oozie-server/webapps/oozie/WEB-INF/lib/hive-jdbc-2.0.0-standalone.jar) - jar not loaded. See Servlet Spec 2.3, section 9.7.2. Offending class: javax/servlet/Servlet.class
      Jun 08, 2016 11:40:55 AM org.apache.catalina.loader.WebappClassLoader validateJarFile
      INFO: validateJarFile(/usr/local/oozie/distro/target/oozie-4.2.0-distro/oozie-4.2.0/oozie-server/webapps/oozie/WEB-INF/lib/servlet-api-2.5.jar) - jar not loaded. See Servlet Spec 2.3, section 9.7.2. Offending class: javax/servlet/Servlet.class
      Jun 08, 2016 11:40:55 AM org.apache.catalina.loader.WebappClassLoader validateJarFile
      INFO: validateJarFile(/usr/local/oozie/distro/target/oozie-4.2.0-distro/oozie-4.2.0/oozie-server/webapps/oozie/WEB-INF/lib/servlet-api.jar) - jar not loaded. See Servlet Spec 2.3, section 9.7.2. Offending class: javax/servlet/Servlet.class
      Jun 08, 2016 11:40:58 AM org.apache.catalina.startup.HostConfig deployDirectory
      INFO: Deploying web application directory ROOT
      Jun 08, 2016 11:40:58 AM org.apache.coyote.http11.Http11Protocol start
      SEVERE: Error starting endpoint
      java.net.BindException: Address already in use <null>:11000
      at org.apache.tomcat.util.net.JIoEndpoint.init(JIoEndpoint.java:549)
      at org.apache.tomcat.util.net.JIoEndpoint.start(JIoEndpoint.java:565)
      at org.apache.coyote.http11.Http11Protocol.start(Http11Protocol.java:209)
      at org.apache.catalina.connector.Connector.start(Connector.java:1196)
      at org.apache.catalina.core.StandardService.start(StandardService.java:540)
      at org.apache.catalina.core.StandardServer.start(StandardServer.java:759)
      at org.apache.catalina.startup.Catalina.start(Catalina.java:595)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
      at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
      Caused by: java.net.BindException: Address already in use
      at java.net.PlainSocketImpl.socketBind(Native Method)
      at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:376)
      at java.net.ServerSocket.bind(ServerSocket.java:376)
      at java.net.ServerSocket.<init>(ServerSocket.java:237)
      at java.net.ServerSocket.<init>(ServerSocket.java:181)
      at org.apache.tomcat.util.net.DefaultServerSocketFactory.createSocket(DefaultServerSocketFactory.java:50)
      at org.apache.tomcat.util.net.JIoEndpoint.init(JIoEndpoint.java:538)
      ... 12 more

      Jun 08, 2016 11:40:58 AM org.apache.catalina.core.StandardService start
      SEVERE: Failed to start connector [Connector[HTTP/1.1-11000]]
      LifecycleException: service.getName(): "Catalina"; Protocol handler start failed: java.net.BindException: Address already in use <null>:11000
      at org.apache.catalina.connector.Connector.start(Connector.java:1203)
      at org.apache.catalina.core.StandardService.start(StandardService.java:540)
      at org.apache.catalina.core.StandardServer.start(StandardServer.java:759)
      at org.apache.catalina.startup.Catalina.start(Catalina.java:595)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
      at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)

      Jun 08, 2016 11:40:58 AM org.apache.catalina.startup.Catalina start
      INFO: Server startup in 10186 ms
      Jun 08, 2016 11:40:58 AM org.apache.catalina.core.StandardServer await
      SEVERE: StandardServer.await: create[11001]:
      java.net.BindException: Address already in use
      at java.net.PlainSocketImpl.socketBind(Native Method)
      at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:376)
      at java.net.ServerSocket.bind(ServerSocket.java:376)
      at java.net.ServerSocket.<init>(ServerSocket.java:237)
      at org.apache.catalina.core.StandardServer.await(StandardServer.java:404)
      at org.apache.catalina.startup.Catalina.await(Catalina.java:676)
      at org.apache.catalina.startup.Catalina.start(Catalina.java:628)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
      at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)

      Jun 08, 2016 11:40:58 AM org.apache.coyote.http11.Http11Protocol pause
      INFO: Pausing Coyote HTTP/1.1 on http-11000
      Jun 08, 2016 11:40:59 AM org.apache.catalina.core.StandardService stop
      INFO: Stopping service Catalina
      Jun 08, 2016 11:40:59 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
      SEVERE: The web application [] appears to have started a thread named [Abandoned connection cleanup thread] but has failed to stop it. This is very likely to create a memory leak.
      Jun 08, 2016 11:40:59 AM org.apache.catalina.loader.WebappClassLoader clearReferencesJdbc
      SEVERE: The web application [/oozie] registered the JDBC driver [com.mysql.jdbc.Driver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered.
      Jun 08, 2016 11:40:59 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
      SEVERE: The web application [/oozie] appears to have started a thread named [FileWatchdog] but has failed to stop it. This is very likely to create a memory leak.
      Jun 08, 2016 11:40:59 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
      SEVERE: The web application [/oozie] appears to have started a thread named [MySQL Statement Cancellation Timer] but has failed to stop it. This is very likely to create a memory leak.
      Jun 08, 2016 11:40:59 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
      SEVERE: The web application [/oozie] appears to have started a thread named [IPC Client (1039062568) connection to localhost/127.0.0.1:9000 from hduser] but has failed to stop it. This is very likely to create a memory leak.
      Jun 08, 2016 11:40:59 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
      SEVERE: The web application [/oozie] appears to have started a thread named IPC Parameter Sending Thread #0 but has failed to stop it. This is very likely to create a memory leak.
      Jun 08, 2016 11:40:59 AM org.apache.catalina.loader.WebappClassLoader checkThreadLocalMapForLeaks
      SEVERE: The web application [/oozie] created a ThreadLocal with key of type [org.apache.hadoop.hdfs.DFSUtil$1] (value [org.apache.hadoop.hdfs.DFSUtil$1@4d828741]) and a value of type [java.util.Random] (value [java.util.Random@347de428]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
      Jun 08, 2016 11:40:59 AM org.apache.catalina.loader.WebappClassLoader checkThreadLocalMapForLeaks
      SEVERE: The web application [/oozie] created a ThreadLocal with key of type [org.apache.oozie.util.XLog$Info$1] (value [org.apache.oozie.util.XLog$Info$1@350e1904]) and a value of type [org.apache.oozie.util.XLog.Info] (value [org.apache.oozie.util.XLog$Info@308c70d2]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
      Jun 08, 2016 11:40:59 AM org.apache.catalina.loader.WebappClassLoader checkThreadLocalMapForLeaks
      SEVERE: The web application [/oozie] created a ThreadLocal with key of type [org.apache.hadoop.io.Text$1] (value [org.apache.hadoop.io.Text$1@544303e4]) and a value of type [sun.nio.cs.UTF_8.Encoder] (value [sun.nio.cs.UTF_8$Encoder@7bb498f3]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
      Jun 08, 2016 11:40:59 AM org.apache.catalina.loader.WebappClassLoader checkThreadLocalMapForLeaks
      SEVERE: The web application [/oozie] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@7b12a8c7]) and a value of type [org.apache.hadoop.fs.FileSystem.Statistics.StatisticsData] (value [0 bytes read, 0 bytes written, 20 read ops, 0 large read ops, 0 write ops]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
      Jun 08, 2016 11:41:00 AM org.apache.catalina.startup.HostConfig deployDirectory
      INFO: Deploying web application directory ROOT
      Jun 08, 2016 11:41:01 AM org.apache.coyote.http11.Http11Protocol start
      SEVERE: Error starting endpoint
      java.net.BindException: Address already in use <null>:11000
      at org.apache.tomcat.util.net.JIoEndpoint.init(JIoEndpoint.java:549)
      at org.apache.tomcat.util.net.JIoEndpoint.start(JIoEndpoint.java:565)
      at org.apache.coyote.http11.Http11Protocol.start(Http11Protocol.java:209)
      at org.apache.catalina.connector.Connector.start(Connector.java:1196)
      at org.apache.catalina.core.StandardService.start(StandardService.java:540)
      at org.apache.catalina.core.StandardServer.start(StandardServer.java:759)
      at org.apache.catalina.startup.Catalina.start(Catalina.java:595)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
      at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
      Caused by: java.net.BindException: Address already in use
      at java.net.PlainSocketImpl.socketBind(Native Method)
      at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:376)
      at java.net.ServerSocket.bind(ServerSocket.java:376)
      at java.net.ServerSocket.<init>(ServerSocket.java:237)
      at java.net.ServerSocket.<init>(ServerSocket.java:181)
      at org.apache.tomcat.util.net.DefaultServerSocketFactory.createSocket(DefaultServerSocketFactory.java:50)
      at org.apache.tomcat.util.net.JIoEndpoint.init(JIoEndpoint.java:538)
      ... 12 more

      Jun 08, 2016 11:41:01 AM org.apache.catalina.core.StandardService start
      SEVERE: Failed to start connector [Connector[HTTP/1.1-11000]]
      LifecycleException: service.getName(): "Catalina"; Protocol handler start failed: java.net.BindException: Address already in use <null>:11000
      at org.apache.catalina.connector.Connector.start(Connector.java:1203)
      at org.apache.catalina.core.StandardService.start(StandardService.java:540)
      at org.apache.catalina.core.StandardServer.start(StandardServer.java:759)
      at org.apache.catalina.startup.Catalina.start(Catalina.java:595)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
      at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)

      Jun 08, 2016 11:41:01 AM org.apache.catalina.startup.Catalina start
      INFO: Server startup in 5635 ms
      Jun 08, 2016 11:41:01 AM org.apache.catalina.core.StandardServer await
      SEVERE: StandardServer.await: create[11001]:
      java.net.BindException: Address already in use
      at java.net.PlainSocketImpl.socketBind(Native Method)
      at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:376)
      at java.net.ServerSocket.bind(ServerSocket.java:376)
      at java.net.ServerSocket.<init>(ServerSocket.java:237)
      at org.apache.catalina.core.StandardServer.await(StandardServer.java:404)
      at org.apache.catalina.startup.Catalina.await(Catalina.java:676)
      at org.apache.catalina.startup.Catalina.start(Catalina.java:628)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
      at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)

      Jun 08, 2016 11:41:01 AM org.apache.coyote.http11.Http11Protocol pause
      INFO: Pausing Coyote HTTP/1.1 on http-11000
      Jun 08, 2016 11:41:01 AM org.apache.coyote.http11.Http11Protocol destroy
      INFO: Stopping Coyote HTTP/1.1 on http-11000
      Jun 08, 2016 11:41:01 AM org.apache.catalina.loader.WebappClassLoader loadClass
      INFO: Illegal access: this web application instance has been stopped already. Could not load org.apache.hadoop.util.ShutdownHookManager$2. The eventual following stack trace is caused by an error thrown for debugging purposes as well as to attempt to terminate the thread which caused the illegal access, and has no functional impact.
      java.lang.IllegalStateException
      at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1566)
      at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1526)
      at org.apache.hadoop.util.ShutdownHookManager.getShutdownHooksInOrder(ShutdownHookManager.java:124)
      at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:52)

      Jun 08, 2016 11:41:02 AM org.apache.catalina.core.StandardService stop
      INFO: Stopping service Catalina
      Jun 08, 2016 11:41:02 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
      SEVERE: The web application [] appears to have started a thread named [Abandoned connection cleanup thread] but has failed to stop it. This is very likely to create a memory leak.
      Jun 08, 2016 11:41:02 AM org.apache.catalina.loader.WebappClassLoader clearReferencesJdbc
      SEVERE: The web application [/oozie] registered the JDBC driver [com.mysql.jdbc.Driver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered.
      Jun 08, 2016 11:41:02 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
      SEVERE: The web application [/oozie] appears to have started a thread named [FileWatchdog] but has failed to stop it. This is very likely to create a memory leak.
      Jun 08, 2016 11:41:02 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
      SEVERE: The web application [/oozie] appears to have started a thread named [MySQL Statement Cancellation Timer] but has failed to stop it. This is very likely to create a memory leak.
      Jun 08, 2016 11:41:02 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
      SEVERE: The web application [/oozie] appears to have started a thread named [IPC Client (335255576) connection to localhost/127.0.0.1:9000 from hduser] but has failed to stop it. This is very likely to create a memory leak.
      Jun 08, 2016 11:41:02 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
      SEVERE: The web application [/oozie] appears to have started a thread named IPC Parameter Sending Thread #0 but has failed to stop it. This is very likely to create a memory leak.
      Jun 08, 2016 11:41:02 AM org.apache.catalina.loader.WebappClassLoader checkThreadLocalMapForLeaks
      SEVERE: The web application [/oozie] created a ThreadLocal with key of type [org.apache.hadoop.hdfs.DFSUtil$1] (value [org.apache.hadoop.hdfs.DFSUtil$1@1531a352]) and a value of type [java.util.Random] (value [java.util.Random@6dd9675c]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
      Jun 08, 2016 11:41:02 AM org.apache.catalina.loader.WebappClassLoader checkThreadLocalMapForLeaks
      SEVERE: The web application [/oozie] created a ThreadLocal with key of type [org.apache.oozie.util.XLog$Info$1] (value [org.apache.oozie.util.XLog$Info$1@5c11015b]) and a value of type [org.apache.oozie.util.XLog.Info] (value [org.apache.oozie.util.XLog$Info@60702c95]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
      Jun 08, 2016 11:41:02 AM org.apache.catalina.loader.WebappClassLoader checkThreadLocalMapForLeaks
      SEVERE: The web application [/oozie] created a ThreadLocal with key of type [org.apache.hadoop.io.Text$1] (value [org.apache.hadoop.io.Text$1@647f1ba9]) and a value of type [sun.nio.cs.UTF_8.Encoder] (value [sun.nio.cs.UTF_8$Encoder@54f127ca]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
      Jun 08, 2016 11:41:02 AM org.apache.catalina.loader.WebappClassLoader checkThreadLocalMapForLeaks
      SEVERE: The web application [/oozie] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@812886f]) and a value of type [org.apache.hadoop.fs.FileSystem.Statistics.StatisticsData] (value [0 bytes read, 0 bytes written, 20 read ops, 0 large read ops, 0 write ops]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
      Jun 08, 2016 11:41:02 AM org.apache.coyote.http11.Http11Protocol destroy
      INFO: Stopping Coyote HTTP/1.1 on http-11000

      Attachments

        1. oozie-ops.log
          2 kB
          Prakash K
        2. oozie-jpa.log
          114 kB
          Prakash K
        3. catalina.out
          16 kB
          Prakash K
        4. catalina.2016-06-09.log
          15 kB
          Prakash K
        5. oozie-error.log
          20 kB
          Prakash K
        6. oozie.log
          59 kB
          Prakash K
        7. oozie-instrumentation.log
          55 kB
          Prakash K

        Activity

          People

            Unassigned Unassigned
            prakash003 Prakash K
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 53h
                53h
                Remaining:
                Remaining Estimate - 53h
                53h
                Logged:
                Time Spent - Not Specified
                Not Specified