Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-6677

Reduce logging during startup and shutdown

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 6.3, master (7.0)
    • Component/s: logging
    • Labels:
      None

      Description

      most of what is printed is neither helpful nor useful. It's just noise

      1. SOLR-6677.patch
        39 kB
        Jan Høydahl
      2. SOLR-6677.patch
        34 kB
        Jan Høydahl
      3. SOLR-6677-part-2.patch
        22 kB
        Alan Woodward
      4. SOLR-6677-part3.patch
        3 kB
        Jan Høydahl
      5. SOLR-6677-part-4.patch
        15 kB
        Alan Woodward

        Issue Links

          Activity

          Hide
          janhoy Jan Høydahl added a comment -

          So let's be more specific here, shall we?

          Here are some examples:

          Standalone mode

          > bin/solr start
          Starting Solr on port 8983 from /Users/janhoy/git/lucene-solr/solr/server
          
          0    INFO  (main) [   ] o.e.j.u.log Logging initialized @390ms
          190  INFO  (main) [   ] o.e.j.s.Server jetty-9.3.8.v20160314
          209  INFO  (main) [   ] o.e.j.d.p.ScanningAppProvider Deployment monitor [file:///Users/janhoy/git/lucene-solr/solr/server/contexts/] at interval 0
          409  INFO  (main) [   ] o.e.j.w.StandardDescriptorProcessor NO JSP Support for /solr, did not find org.apache.jasper.servlet.JspServlet
          421  WARN  (main) [   ] o.e.j.s.SecurityHandler ServletContext@o.e.j.w.WebAppContext@6536e911{/solr,file:///Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp/,STARTING}{/Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp} has uncovered http methods for path: /
          429  INFO  (main) [   ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): WebAppClassLoader=143110009@887af79
          446  INFO  (main) [   ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
          446  INFO  (main) [   ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /Users/janhoy/git/lucene-solr/solr/server/solr
          447  INFO  (main) [   ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/janhoy/git/lucene-solr/solr/server/solr'
          448  INFO  (main) [   ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
          448  INFO  (main) [   ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /Users/janhoy/git/lucene-solr/solr/server/solr
          453  INFO  (main) [   ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/janhoy/git/lucene-solr/solr/server/solr/solr.xml
          574  INFO  (main) [   ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /Users/janhoy/git/lucene-solr/solr/server/solr
          595  INFO  (main) [   ] o.a.s.c.CoreContainer New CoreContainer 1256440269
          596  INFO  (main) [   ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/Users/janhoy/git/lucene-solr/solr/server/solr]
          596  WARN  (main) [   ] o.a.s.c.CoreContainer Couldn't add files from /Users/janhoy/git/lucene-solr/solr/server/solr/lib to classpath: /Users/janhoy/git/lucene-solr/solr/server/solr/lib
          604  INFO  (main) [   ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
          851  INFO  (main) [   ] o.a.s.u.UpdateShardHandler Created UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&maxConnections=100000&maxConnectionsPerHost=100000
          852  INFO  (main) [   ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
          853  INFO  (main) [   ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
          855  INFO  (main) [   ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
          855  INFO  (main) [   ] o.a.s.c.CoreContainer No authentication plugin used.
          901  INFO  (main) [   ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /Users/janhoy/git/lucene-solr/solr/server/solr
          909  INFO  (main) [   ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
          912  INFO  (main) [   ] o.a.s.s.SolrDispatchFilter user.dir=/Users/janhoy/git/lucene-solr/solr/server
          912  INFO  (main) [   ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
          924  INFO  (main) [   ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@6536e911{/solr,file:///Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp/,AVAILABLE}{/Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp}
          946  INFO  (main) [   ] o.e.j.s.ServerConnector Started ServerConnector@683dbc2c{HTTP/1.1,[http/1.1]}{0.0.0.0:8983}
          946  INFO  (main) [   ] o.e.j.s.Server Started @1338ms
          

          Cloud mode

          > bin/solr start -c
          Starting Solr in SolrCloud mode on port 8983 from /Users/janhoy/git/lucene-solr/solr/server
          
          0    INFO  (main) [   ] o.e.j.u.log Logging initialized @298ms
          135  INFO  (main) [   ] o.e.j.s.Server jetty-9.3.8.v20160314
          149  INFO  (main) [   ] o.e.j.d.p.ScanningAppProvider Deployment monitor [file:///Users/janhoy/git/lucene-solr/solr/server/contexts/] at interval 0
          336  INFO  (main) [   ] o.e.j.w.StandardDescriptorProcessor NO JSP Support for /solr, did not find org.apache.jasper.servlet.JspServlet
          345  WARN  (main) [   ] o.e.j.s.SecurityHandler ServletContext@o.e.j.w.WebAppContext@6536e911{/solr,file:///Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp/,STARTING}{/Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp} has uncovered http methods for path: /
          355  INFO  (main) [   ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): WebAppClassLoader=143110009@887af79
          373  INFO  (main) [   ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
          373  INFO  (main) [   ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /Users/janhoy/git/lucene-solr/solr/server/solr
          374  INFO  (main) [   ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/janhoy/git/lucene-solr/solr/server/solr'
          374  INFO  (main) [   ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
          374  INFO  (main) [   ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /Users/janhoy/git/lucene-solr/solr/server/solr
          387  INFO  (main) [   ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/janhoy/git/lucene-solr/solr/server/solr/solr.xml
          451  INFO  (main) [   ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /Users/janhoy/git/lucene-solr/solr/server/solr
          478  INFO  (main) [   ] o.a.s.c.CoreContainer New CoreContainer 1256440269
          478  INFO  (main) [   ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/Users/janhoy/git/lucene-solr/solr/server/solr]
          479  WARN  (main) [   ] o.a.s.c.CoreContainer Couldn't add files from /Users/janhoy/git/lucene-solr/solr/server/solr/lib to classpath: /Users/janhoy/git/lucene-solr/solr/server/solr/lib
          489  INFO  (main) [   ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
          710  INFO  (main) [   ] o.a.s.u.UpdateShardHandler Created UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&maxConnections=100000&maxConnectionsPerHost=100000
          712  INFO  (main) [   ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
          713  INFO  (main) [   ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
          719  INFO  (main) [   ] o.a.s.c.SolrZkServerProps Reading configuration from: /Users/janhoy/git/lucene-solr/solr/server/solr/zoo.cfg
          721  INFO  (main) [   ] o.a.s.c.SolrZkServer STARTING EMBEDDED STANDALONE ZOOKEEPER SERVER at port 9983
          1222 INFO  (main) [   ] o.a.s.c.ZkContainer Zookeeper client=localhost:9983
          1244 INFO  (main) [   ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$2/2110756088@229f66ed
          1260 INFO  (main) [   ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
          1973 INFO  (zkCallback-3-thread-1-processing-n:192.168.127.63:8983_solr) [   ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@400a21 name:ZooKeeperConnection Watcher:localhost:9983 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
          1974 INFO  (main) [   ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
          1986 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
          1992 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
          1999 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
          2004 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
          2009 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
          2018 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
          2020 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /collections
          2022 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
          2026 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
          2029 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /security.json
          2031 INFO  (main) [   ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
          2033 INFO  (main) [   ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
          2036 INFO  (main) [   ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
          2053 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
          2055 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
          2057 INFO  (main) [   ] o.a.s.c.Overseer Overseer (id=null) closing
          2059 INFO  (main) [   ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96596475124711424-192.168.127.63:8983_solr-n_0000000000
          2061 INFO  (main) [   ] o.a.s.c.OverseerElectionContext I am going to be the leader 192.168.127.63:8983_solr
          2063 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
          2065 INFO  (main) [   ] o.a.s.c.Overseer Overseer (id=96596475124711424-192.168.127.63:8983_solr-n_0000000000) starting
          2071 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
          2133 INFO  (main) [   ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
          2147 INFO  (OverseerCollectionConfigSetProcessor-96596475124711424-192.168.127.63:8983_solr-n_0000000000) [   ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
          2148 INFO  (main) [   ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/192.168.127.63:8983_solr
          2148 INFO  (main) [   ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/192.168.127.63:8983_solr
          2151 INFO  (zkCallback-3-thread-1-processing-n:192.168.127.63:8983_solr) [   ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
          2152 INFO  (zkCallback-3-thread-1-processing-n:192.168.127.63:8983_solr) [   ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
          2156 INFO  (OverseerStateUpdate-96596475124711424-192.168.127.63:8983_solr-n_0000000000) [   ] o.a.s.c.Overseer Starting to work on the main queue
          2158 INFO  (OverseerStateUpdate-96596475124711424-192.168.127.63:8983_solr-n_0000000000) [   ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
          2215 INFO  (main) [   ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
          2216 INFO  (main) [   ] o.a.s.c.CoreContainer No authentication plugin used.
          2247 INFO  (main) [   ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /Users/janhoy/git/lucene-solr/solr/server/solr
          2267 INFO  (main) [   ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
          2281 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter user.dir=/Users/janhoy/git/lucene-solr/solr/server
          2281 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
          2291 INFO  (main) [   ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@6536e911{/solr,file:///Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp/,AVAILABLE}{/Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp}
          2295 INFO  (main) [   ] o.e.j.s.ServerConnector Started ServerConnector@738dc9b{HTTP/1.1,[http/1.1]}{0.0.0.0:8983}
          2295 INFO  (main) [   ] o.e.j.s.Server Started @2596ms
          

          Then we can also look at collection creation (standalone):

          > bin/solr create -c foo
          77493 INFO  (qtp225493257-19) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=json} status=0 QTime=62
          77566 INFO  (qtp225493257-21) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=json} status=0 QTime=15
          77574 INFO  (qtp225493257-19) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={core=foo&action=STATUS&wt=json} status=0 QTime=0
          77623 INFO  (qtp225493257-18) [   ] o.a.s.h.a.CoreAdminOperation core create command name=foo&action=CREATE&instanceDir=foo&wt=json
          77625 INFO  (qtp225493257-18) [   ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=foo, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
          77626 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/janhoy/git/lucene-solr/solr/server/solr/foo'
          77626 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
          77626 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /Users/janhoy/git/lucene-solr/solr/server/solr
          77665 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrConfig current version of requestparams : 0
          77668 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrConfig Adding specified lib dirs to ClassLoader
          77706 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/apache-mime4j-core-0.7.2.jar' to classloader
          77706 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/apache-mime4j-dom-0.7.2.jar' to classloader
          77706 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/aspectjrt-1.8.0.jar' to classloader
          77706 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/bcmail-jdk15-1.45.jar' to classloader
          77706 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/bcprov-jdk15-1.45.jar' to classloader
          77706 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/boilerpipe-1.1.0.jar' to classloader
          77706 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/commons-compress-1.11.jar' to classloader
          77706 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/fontbox-2.0.1.jar' to classloader
          77706 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/icu4j-56.1.jar' to classloader
          77706 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/isoparser-1.1.18.jar' to classloader
          77707 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/jackcess-2.1.3.jar' to classloader
          77707 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/java-libpst-0.8.1.jar' to classloader
          77707 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/jdom-1.0.jar' to classloader
          77707 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/jempbox-1.8.12.jar' to classloader
          77707 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/jmatio-1.0.jar' to classloader
          77707 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/juniversalchardet-1.0.3.jar' to classloader
          77707 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/metadata-extractor-2.8.1.jar' to classloader
          77707 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/pdfbox-2.0.1.jar' to classloader
          77707 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/pdfbox-tools-2.0.1.jar' to classloader
          77707 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/poi-3.15-beta1.jar' to classloader
          77707 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/poi-ooxml-3.15-beta1.jar' to classloader
          77708 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/poi-ooxml-schemas-3.15-beta1.jar' to classloader
          77708 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/poi-scratchpad-3.15-beta1.jar' to classloader
          77708 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/rome-1.0.jar' to classloader
          77708 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/tagsoup-1.2.1.jar' to classloader
          77708 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/tika-core-1.13.jar' to classloader
          77708 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/tika-java7-1.13.jar' to classloader
          77708 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/tika-parsers-1.13.jar' to classloader
          77708 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/tika-xmp-1.13.jar' to classloader
          77708 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/vorbis-java-core-0.8.jar' to classloader
          77708 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/vorbis-java-tika-0.8.jar' to classloader
          77708 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/xercesImpl-2.9.1.jar' to classloader
          77709 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/xmlbeans-2.6.0.jar' to classloader
          77709 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/xmpcore-5.1.2.jar' to classloader
          77709 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/xz-1.5.jar' to classloader
          77709 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/dist/solr-cell-7.0.0-SNAPSHOT.jar' to classloader
          77709 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/clustering/lib/attributes-binder-1.3.1.jar' to classloader
          77709 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/clustering/lib/carrot2-guava-18.0.jar' to classloader
          77709 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/clustering/lib/carrot2-mini-3.12.0.jar' to classloader
          77709 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/clustering/lib/jackson-annotations-2.5.4.jar' to classloader
          77709 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/clustering/lib/jackson-databind-2.5.4.jar' to classloader
          77709 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/clustering/lib/simple-xml-2.7.1.jar' to classloader
          77709 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/dist/solr-clustering-7.0.0-SNAPSHOT.jar' to classloader
          77709 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/langid/lib/jsonic-1.2.7.jar' to classloader
          77710 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/langid/lib/langdetect-1.1-20120112.jar' to classloader
          77710 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/dist/solr-langid-7.0.0-SNAPSHOT.jar' to classloader
          77710 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/velocity/lib/commons-beanutils-1.8.3.jar' to classloader
          77710 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/velocity/lib/commons-collections-3.2.2.jar' to classloader
          77710 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/velocity/lib/velocity-1.7.jar' to classloader
          77710 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/velocity/lib/velocity-tools-2.0.jar' to classloader
          77710 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/dist/solr-velocity-7.0.0-SNAPSHOT.jar' to classloader
          77887 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
          77965 INFO  (qtp225493257-18) [   ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
          78022 INFO  (qtp225493257-18) [   ] o.a.s.s.IndexSchema [foo] Schema name=example-data-driven-schema
          78317 INFO  (qtp225493257-18) [   ] o.a.s.s.IndexSchema unique key field: id
          78429 INFO  (qtp225493257-18) [   ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
          78433 INFO  (qtp225493257-18) [   ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
          78451 INFO  (qtp225493257-18) [   ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/Users/janhoy/git/lucene-solr/solr/server/solr/foo'
          78451 INFO  (qtp225493257-18) [   ] o.a.s.c.CoreContainer Creating SolrCore 'foo' using configuration from instancedir /Users/janhoy/git/lucene-solr/solr/server/solr/foo
          78452 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.SolrCore solr.NRTCachingDirectoryFactory
          78460 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.SolrCore [[foo] ] Opening new SolrCore at [/Users/janhoy/git/lucene-solr/solr/server/solr/foo], dataDir=[/Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/]
          78462 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.JmxMonitoredMap No JMX servers found, not exposing Solr information with JMX.
          78466 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.SolrCore [[foo] ] Added SolrEventListener for newSearcher: [org.apache.solr.core.QuerySenderListener{queries=[]}]
          78466 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.SolrCore [[foo] ] Added SolrEventListener for firstSearcher: [org.apache.solr.core.QuerySenderListener{queries=[]}]
          78478 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.CachingDirectoryFactory return new directory for /Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/snapshot_metadata
          78479 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.s.SolrSnapshotMetaDataManager Loading from snapshot metadata file...
          78482 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.SchemaCodecFactory Using default compressionMode: BEST_SPEED
          78483 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.CachingDirectoryFactory return new directory for /Users/janhoy/git/lucene-solr/solr/server/solr/foo/data
          78483 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.SolrCore New index directory detected: old=null new=/Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/index/
          78483 WARN  (qtp225493257-18) [   x:foo] o.a.s.c.SolrCore [foo] Solr index directory '/Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/index' doesn't exist. Creating new index...
          78492 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.CachingDirectoryFactory return new directory for /Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/index
          78522 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
          	commit{dir=NRTCachingDirectory(MMapDirectory@/Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@217956c4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
          78523 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
          78525 INFO  (OldIndexDirectoryCleanupThreadForCore-foo) [   x:foo] o.a.s.c.SolrCore Looking for old index directories to cleanup for core foo in /Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/
          78527 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.PluginBag queryResponseWriter : 'velocity' created with startup=lazy 
          78529 INFO  (qtp225493257-18) [   x:foo] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
          78600 INFO  (qtp225493257-18) [   x:foo] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "add-unknown-fields-to-the-schema"
          78645 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
          78662 INFO  (qtp225493257-18) [   x:foo] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
          78663 INFO  (qtp225493257-18) [   x:foo] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
          78664 INFO  (qtp225493257-18) [   x:foo] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
          78664 INFO  (qtp225493257-18) [   x:foo] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
          78718 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.PluginBag requestHandler : '/terms' created with startup=lazy 
          78718 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.PluginBag requestHandler : '/update/extract' created with startup=lazy 
          78718 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.PluginBag requestHandler : '/analysis/field' created with startup=lazy 
          78718 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.PluginBag requestHandler : '/analysis/document' created with startup=lazy 
          78720 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.PluginBag requestHandler : '/spell' created with startup=lazy 
          78720 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.PluginBag requestHandler : '/tvrh' created with startup=lazy 
          78720 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.PluginBag requestHandler : '/elevate' created with startup=lazy 
          78720 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/browse,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/elevate,/update/json,/admin/threads,/query,/analysis/field,/analysis/document,/spell,/update/csv,/sql,/graph,/tvrh,/select,/admin/segments,/admin/system,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file,/terms,/debug/dump,/update/extract
          78720 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
          78727 INFO  (qtp225493257-18) [   x:foo] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
          78727 INFO  (qtp225493257-18) [   x:foo] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
          78733 INFO  (qtp225493257-18) [   x:foo] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms; 
          78733 INFO  (qtp225493257-18) [   x:foo] o.a.s.u.CommitTracker Soft AutoCommit: disabled
          78738 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
          	commit{dir=NRTCachingDirectory(MMapDirectory@/Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@217956c4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
          78738 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
          78747 INFO  (qtp225493257-18) [   x:foo] o.a.s.s.SolrIndexSearcher Opening [Searcher@77583d16[foo] main]
          78752 INFO  (qtp225493257-18) [   x:foo] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/janhoy/git/lucene-solr/solr/server/solr/foo/conf
          78752 INFO  (qtp225493257-18) [   x:foo] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/Users/janhoy/git/lucene-solr/solr/server/solr/foo/conf}
          78758 INFO  (qtp225493257-18) [   x:foo] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/Users/janhoy/git/lucene-solr/solr/server/solr/foo/conf
          78759 INFO  (qtp225493257-18) [   x:foo] o.a.s.r.RestManager Initializing 0 registered ManagedResources
          78763 INFO  (qtp225493257-18) [   x:foo] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
          78768 INFO  (qtp225493257-18) [   x:foo] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
          78768 INFO  (qtp225493257-18) [   x:foo] o.a.s.h.c.SpellCheckComponent No queryConverter defined, using default converter
          78770 INFO  (qtp225493257-18) [   x:foo] o.a.s.h.c.QueryElevationComponent Loading QueryElevation from: /Users/janhoy/git/lucene-solr/solr/server/solr/foo/conf/elevate.xml
          78777 INFO  (qtp225493257-18) [   x:foo] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
          78786 INFO  (searcherExecutor-7-thread-1-processing-x:foo) [   x:foo] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@77583d16[foo] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
          78786 INFO  (searcherExecutor-7-thread-1-processing-x:foo) [   x:foo] o.a.s.c.QuerySenderListener QuerySenderListener done.
          78786 INFO  (searcherExecutor-7-thread-1-processing-x:foo) [   x:foo] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
          78787 INFO  (qtp225493257-18) [   x:foo] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
          78787 INFO  (searcherExecutor-7-thread-1-processing-x:foo) [   x:foo] o.a.s.c.SolrCore [foo] Registered new searcher Searcher@77583d16[foo] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
          78787 INFO  (qtp225493257-18) [   x:foo] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
          78789 INFO  (qtp225493257-18) [   x:foo] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1545543503236300800
          78792 INFO  (qtp225493257-18) [   x:foo] o.a.s.u.UpdateLog Took 4.0ms to seed version buckets with highest version 1545543503236300800
          78792 INFO  (qtp225493257-18) [   x:foo] o.a.s.c.CoreContainer registering core: foo
          78793 INFO  (qtp225493257-18) [   x:foo] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={name=foo&action=CREATE&instanceDir=foo&wt=json} status=0 QTime=1170
          

          There is obviously a LOT of noise here, what should go to DEBUG level, and what should simply go away?

          Show
          janhoy Jan Høydahl added a comment - So let's be more specific here, shall we? Here are some examples: Standalone mode > bin/solr start Starting Solr on port 8983 from /Users/janhoy/git/lucene-solr/solr/server 0 INFO (main) [ ] o.e.j.u.log Logging initialized @390ms 190 INFO (main) [ ] o.e.j.s.Server jetty-9.3.8.v20160314 209 INFO (main) [ ] o.e.j.d.p.ScanningAppProvider Deployment monitor [file:///Users/janhoy/git/lucene-solr/solr/server/contexts/] at interval 0 409 INFO (main) [ ] o.e.j.w.StandardDescriptorProcessor NO JSP Support for /solr, did not find org.apache.jasper.servlet.JspServlet 421 WARN (main) [ ] o.e.j.s.SecurityHandler ServletContext@o.e.j.w.WebAppContext@6536e911{/solr,file:///Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp/,STARTING}{/Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp} has uncovered http methods for path: / 429 INFO (main) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): WebAppClassLoader=143110009@887af79 446 INFO (main) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) 446 INFO (main) [ ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /Users/janhoy/git/lucene-solr/solr/server/solr 447 INFO (main) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/janhoy/git/lucene-solr/solr/server/solr' 448 INFO (main) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) 448 INFO (main) [ ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /Users/janhoy/git/lucene-solr/solr/server/solr 453 INFO (main) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/janhoy/git/lucene-solr/solr/server/solr/solr.xml 574 INFO (main) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /Users/janhoy/git/lucene-solr/solr/server/solr 595 INFO (main) [ ] o.a.s.c.CoreContainer New CoreContainer 1256440269 596 INFO (main) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/Users/janhoy/git/lucene-solr/solr/server/solr] 596 WARN (main) [ ] o.a.s.c.CoreContainer Couldn't add files from /Users/janhoy/git/lucene-solr/solr/server/solr/lib to classpath: /Users/janhoy/git/lucene-solr/solr/server/solr/lib 604 INFO (main) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false, 851 INFO (main) [ ] o.a.s.u.UpdateShardHandler Created UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&maxConnections=100000&maxConnectionsPerHost=100000 852 INFO (main) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory 853 INFO (main) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] 855 INFO (main) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. 855 INFO (main) [ ] o.a.s.c.CoreContainer No authentication plugin used. 901 INFO (main) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /Users/janhoy/git/lucene-solr/solr/server/solr 909 INFO (main) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions 912 INFO (main) [ ] o.a.s.s.SolrDispatchFilter user.dir=/Users/janhoy/git/lucene-solr/solr/server 912 INFO (main) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done 924 INFO (main) [ ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@6536e911{/solr,file:///Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp/,AVAILABLE}{/Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp} 946 INFO (main) [ ] o.e.j.s.ServerConnector Started ServerConnector@683dbc2c{HTTP/1.1,[http/1.1]}{0.0.0.0:8983} 946 INFO (main) [ ] o.e.j.s.Server Started @1338ms Cloud mode > bin/solr start -c Starting Solr in SolrCloud mode on port 8983 from /Users/janhoy/git/lucene-solr/solr/server 0 INFO (main) [ ] o.e.j.u.log Logging initialized @298ms 135 INFO (main) [ ] o.e.j.s.Server jetty-9.3.8.v20160314 149 INFO (main) [ ] o.e.j.d.p.ScanningAppProvider Deployment monitor [file:///Users/janhoy/git/lucene-solr/solr/server/contexts/] at interval 0 336 INFO (main) [ ] o.e.j.w.StandardDescriptorProcessor NO JSP Support for /solr, did not find org.apache.jasper.servlet.JspServlet 345 WARN (main) [ ] o.e.j.s.SecurityHandler ServletContext@o.e.j.w.WebAppContext@6536e911{/solr,file:///Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp/,STARTING}{/Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp} has uncovered http methods for path: / 355 INFO (main) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): WebAppClassLoader=143110009@887af79 373 INFO (main) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) 373 INFO (main) [ ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /Users/janhoy/git/lucene-solr/solr/server/solr 374 INFO (main) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/janhoy/git/lucene-solr/solr/server/solr' 374 INFO (main) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) 374 INFO (main) [ ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /Users/janhoy/git/lucene-solr/solr/server/solr 387 INFO (main) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/janhoy/git/lucene-solr/solr/server/solr/solr.xml 451 INFO (main) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /Users/janhoy/git/lucene-solr/solr/server/solr 478 INFO (main) [ ] o.a.s.c.CoreContainer New CoreContainer 1256440269 478 INFO (main) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/Users/janhoy/git/lucene-solr/solr/server/solr] 479 WARN (main) [ ] o.a.s.c.CoreContainer Couldn't add files from /Users/janhoy/git/lucene-solr/solr/server/solr/lib to classpath: /Users/janhoy/git/lucene-solr/solr/server/solr/lib 489 INFO (main) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false, 710 INFO (main) [ ] o.a.s.u.UpdateShardHandler Created UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&maxConnections=100000&maxConnectionsPerHost=100000 712 INFO (main) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory 713 INFO (main) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] 719 INFO (main) [ ] o.a.s.c.SolrZkServerProps Reading configuration from: /Users/janhoy/git/lucene-solr/solr/server/solr/zoo.cfg 721 INFO (main) [ ] o.a.s.c.SolrZkServer STARTING EMBEDDED STANDALONE ZOOKEEPER SERVER at port 9983 1222 INFO (main) [ ] o.a.s.c.ZkContainer Zookeeper client=localhost:9983 1244 INFO (main) [ ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$2/2110756088@229f66ed 1260 INFO (main) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper 1973 INFO (zkCallback-3-thread-1-processing-n:192.168.127.63:8983_solr) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@400a21 name:ZooKeeperConnection Watcher:localhost:9983 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None 1974 INFO (main) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 1986 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue 1992 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work 1999 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running 2004 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed 2009 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure 2018 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes 2020 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /collections 2022 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json 2026 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json 2029 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json 2031 INFO (main) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 2033 INFO (main) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties 2036 INFO (main) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0) 2053 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect 2055 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election 2057 INFO (main) [ ] o.a.s.c.Overseer Overseer (id=null) closing 2059 INFO (main) [ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96596475124711424-192.168.127.63:8983_solr-n_0000000000 2061 INFO (main) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 192.168.127.63:8983_solr 2063 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader 2065 INFO (main) [ ] o.a.s.c.Overseer Overseer (id=96596475124711424-192.168.127.63:8983_solr-n_0000000000) starting 2071 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work 2133 INFO (main) [ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000 2147 INFO (OverseerCollectionConfigSetProcessor-96596475124711424-192.168.127.63:8983_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations 2148 INFO (main) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/192.168.127.63:8983_solr 2148 INFO (main) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/192.168.127.63:8983_solr 2151 INFO (zkCallback-3-thread-1-processing-n:192.168.127.63:8983_solr) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0]) 2152 INFO (zkCallback-3-thread-1-processing-n:192.168.127.63:8983_solr) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2156 INFO (OverseerStateUpdate-96596475124711424-192.168.127.63:8983_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue 2158 INFO (OverseerStateUpdate-96596475124711424-192.168.127.63:8983_solr-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1) 2215 INFO (main) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. 2216 INFO (main) [ ] o.a.s.c.CoreContainer No authentication plugin used. 2247 INFO (main) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /Users/janhoy/git/lucene-solr/solr/server/solr 2267 INFO (main) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions 2281 INFO (main) [ ] o.a.s.s.SolrDispatchFilter user.dir=/Users/janhoy/git/lucene-solr/solr/server 2281 INFO (main) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done 2291 INFO (main) [ ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@6536e911{/solr,file:///Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp/,AVAILABLE}{/Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp} 2295 INFO (main) [ ] o.e.j.s.ServerConnector Started ServerConnector@738dc9b{HTTP/1.1,[http/1.1]}{0.0.0.0:8983} 2295 INFO (main) [ ] o.e.j.s.Server Started @2596ms Then we can also look at collection creation (standalone): > bin/solr create -c foo 77493 INFO (qtp225493257-19) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=json} status=0 QTime=62 77566 INFO (qtp225493257-21) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=json} status=0 QTime=15 77574 INFO (qtp225493257-19) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={core=foo&action=STATUS&wt=json} status=0 QTime=0 77623 INFO (qtp225493257-18) [ ] o.a.s.h.a.CoreAdminOperation core create command name=foo&action=CREATE&instanceDir=foo&wt=json 77625 INFO (qtp225493257-18) [ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=foo, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/} 77626 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/janhoy/git/lucene-solr/solr/server/solr/foo' 77626 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) 77626 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /Users/janhoy/git/lucene-solr/solr/server/solr 77665 INFO (qtp225493257-18) [ ] o.a.s.c.SolrConfig current version of requestparams : 0 77668 INFO (qtp225493257-18) [ ] o.a.s.c.SolrConfig Adding specified lib dirs to ClassLoader 77706 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/apache-mime4j-core-0.7.2.jar' to classloader 77706 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/apache-mime4j-dom-0.7.2.jar' to classloader 77706 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/aspectjrt-1.8.0.jar' to classloader 77706 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/bcmail-jdk15-1.45.jar' to classloader 77706 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/bcprov-jdk15-1.45.jar' to classloader 77706 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/boilerpipe-1.1.0.jar' to classloader 77706 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/commons-compress-1.11.jar' to classloader 77706 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/fontbox-2.0.1.jar' to classloader 77706 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/icu4j-56.1.jar' to classloader 77706 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/isoparser-1.1.18.jar' to classloader 77707 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/jackcess-2.1.3.jar' to classloader 77707 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/java-libpst-0.8.1.jar' to classloader 77707 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/jdom-1.0.jar' to classloader 77707 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/jempbox-1.8.12.jar' to classloader 77707 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/jmatio-1.0.jar' to classloader 77707 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/juniversalchardet-1.0.3.jar' to classloader 77707 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/metadata-extractor-2.8.1.jar' to classloader 77707 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/pdfbox-2.0.1.jar' to classloader 77707 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/pdfbox-tools-2.0.1.jar' to classloader 77707 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/poi-3.15-beta1.jar' to classloader 77707 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/poi-ooxml-3.15-beta1.jar' to classloader 77708 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/poi-ooxml-schemas-3.15-beta1.jar' to classloader 77708 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/poi-scratchpad-3.15-beta1.jar' to classloader 77708 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/rome-1.0.jar' to classloader 77708 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/tagsoup-1.2.1.jar' to classloader 77708 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/tika-core-1.13.jar' to classloader 77708 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/tika-java7-1.13.jar' to classloader 77708 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/tika-parsers-1.13.jar' to classloader 77708 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/tika-xmp-1.13.jar' to classloader 77708 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/vorbis-java-core-0.8.jar' to classloader 77708 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/vorbis-java-tika-0.8.jar' to classloader 77708 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/xercesImpl-2.9.1.jar' to classloader 77709 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/xmlbeans-2.6.0.jar' to classloader 77709 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/xmpcore-5.1.2.jar' to classloader 77709 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/extraction/lib/xz-1.5.jar' to classloader 77709 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/dist/solr-cell-7.0.0-SNAPSHOT.jar' to classloader 77709 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/clustering/lib/attributes-binder-1.3.1.jar' to classloader 77709 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/clustering/lib/carrot2-guava-18.0.jar' to classloader 77709 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/clustering/lib/carrot2-mini-3.12.0.jar' to classloader 77709 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/clustering/lib/jackson-annotations-2.5.4.jar' to classloader 77709 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/clustering/lib/jackson-databind-2.5.4.jar' to classloader 77709 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/clustering/lib/simple-xml-2.7.1.jar' to classloader 77709 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/dist/solr-clustering-7.0.0-SNAPSHOT.jar' to classloader 77709 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/langid/lib/jsonic-1.2.7.jar' to classloader 77710 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/langid/lib/langdetect-1.1-20120112.jar' to classloader 77710 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/dist/solr-langid-7.0.0-SNAPSHOT.jar' to classloader 77710 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/velocity/lib/commons-beanutils-1.8.3.jar' to classloader 77710 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/velocity/lib/commons-collections-3.2.2.jar' to classloader 77710 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/velocity/lib/velocity-1.7.jar' to classloader 77710 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/contrib/velocity/lib/velocity-tools-2.0.jar' to classloader 77710 INFO (qtp225493257-18) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/Users/janhoy/git/lucene-solr/solr/dist/solr-velocity-7.0.0-SNAPSHOT.jar' to classloader 77887 INFO (qtp225493257-18) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0 77965 INFO (qtp225493257-18) [ ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml 78022 INFO (qtp225493257-18) [ ] o.a.s.s.IndexSchema [foo] Schema name=example-data-driven-schema 78317 INFO (qtp225493257-18) [ ] o.a.s.s.IndexSchema unique key field: id 78429 INFO (qtp225493257-18) [ ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml 78433 INFO (qtp225493257-18) [ ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml 78451 INFO (qtp225493257-18) [ ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/Users/janhoy/git/lucene-solr/solr/server/solr/foo' 78451 INFO (qtp225493257-18) [ ] o.a.s.c.CoreContainer Creating SolrCore 'foo' using configuration from instancedir /Users/janhoy/git/lucene-solr/solr/server/solr/foo 78452 INFO (qtp225493257-18) [ x:foo] o.a.s.c.SolrCore solr.NRTCachingDirectoryFactory 78460 INFO (qtp225493257-18) [ x:foo] o.a.s.c.SolrCore [[foo] ] Opening new SolrCore at [/Users/janhoy/git/lucene-solr/solr/server/solr/foo], dataDir=[/Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/] 78462 INFO (qtp225493257-18) [ x:foo] o.a.s.c.JmxMonitoredMap No JMX servers found, not exposing Solr information with JMX. 78466 INFO (qtp225493257-18) [ x:foo] o.a.s.c.SolrCore [[foo] ] Added SolrEventListener for newSearcher: [org.apache.solr.core.QuerySenderListener{queries=[]}] 78466 INFO (qtp225493257-18) [ x:foo] o.a.s.c.SolrCore [[foo] ] Added SolrEventListener for firstSearcher: [org.apache.solr.core.QuerySenderListener{queries=[]}] 78478 INFO (qtp225493257-18) [ x:foo] o.a.s.c.CachingDirectoryFactory return new directory for /Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/snapshot_metadata 78479 INFO (qtp225493257-18) [ x:foo] o.a.s.c.s.SolrSnapshotMetaDataManager Loading from snapshot metadata file... 78482 INFO (qtp225493257-18) [ x:foo] o.a.s.c.SchemaCodecFactory Using default compressionMode: BEST_SPEED 78483 INFO (qtp225493257-18) [ x:foo] o.a.s.c.CachingDirectoryFactory return new directory for /Users/janhoy/git/lucene-solr/solr/server/solr/foo/data 78483 INFO (qtp225493257-18) [ x:foo] o.a.s.c.SolrCore New index directory detected: old=null new=/Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/index/ 78483 WARN (qtp225493257-18) [ x:foo] o.a.s.c.SolrCore [foo] Solr index directory '/Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/index' doesn't exist. Creating new index... 78492 INFO (qtp225493257-18) [ x:foo] o.a.s.c.CachingDirectoryFactory return new directory for /Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/index 78522 INFO (qtp225493257-18) [ x:foo] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1 commit{dir=NRTCachingDirectory(MMapDirectory@/Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@217956c4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1} 78523 INFO (qtp225493257-18) [ x:foo] o.a.s.c.SolrDeletionPolicy newest commit generation = 1 78525 INFO (OldIndexDirectoryCleanupThreadForCore-foo) [ x:foo] o.a.s.c.SolrCore Looking for old index directories to cleanup for core foo in /Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/ 78527 INFO (qtp225493257-18) [ x:foo] o.a.s.c.PluginBag queryResponseWriter : 'velocity' created with startup=lazy 78529 INFO (qtp225493257-18) [ x:foo] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5 78600 INFO (qtp225493257-18) [ x:foo] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "add-unknown-fields-to-the-schema" 78645 INFO (qtp225493257-18) [ x:foo] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default 78662 INFO (qtp225493257-18) [ x:foo] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 78663 INFO (qtp225493257-18) [ x:foo] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 78664 INFO (qtp225493257-18) [ x:foo] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 78664 INFO (qtp225493257-18) [ x:foo] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 78718 INFO (qtp225493257-18) [ x:foo] o.a.s.c.PluginBag requestHandler : '/terms' created with startup=lazy 78718 INFO (qtp225493257-18) [ x:foo] o.a.s.c.PluginBag requestHandler : '/update/extract' created with startup=lazy 78718 INFO (qtp225493257-18) [ x:foo] o.a.s.c.PluginBag requestHandler : '/analysis/field' created with startup=lazy 78718 INFO (qtp225493257-18) [ x:foo] o.a.s.c.PluginBag requestHandler : '/analysis/document' created with startup=lazy 78720 INFO (qtp225493257-18) [ x:foo] o.a.s.c.PluginBag requestHandler : '/spell' created with startup=lazy 78720 INFO (qtp225493257-18) [ x:foo] o.a.s.c.PluginBag requestHandler : '/tvrh' created with startup=lazy 78720 INFO (qtp225493257-18) [ x:foo] o.a.s.c.PluginBag requestHandler : '/elevate' created with startup=lazy 78720 INFO (qtp225493257-18) [ x:foo] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/browse,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/elevate,/update/json,/admin/threads,/query,/analysis/field,/analysis/document,/spell,/update/csv,/sql,/graph,/tvrh,/select,/admin/segments,/admin/system,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file,/terms,/debug/dump,/update/extract 78720 INFO (qtp225493257-18) [ x:foo] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache 78727 INFO (qtp225493257-18) [ x:foo] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 78727 INFO (qtp225493257-18) [ x:foo] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 78733 INFO (qtp225493257-18) [ x:foo] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms; 78733 INFO (qtp225493257-18) [ x:foo] o.a.s.u.CommitTracker Soft AutoCommit: disabled 78738 INFO (qtp225493257-18) [ x:foo] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1 commit{dir=NRTCachingDirectory(MMapDirectory@/Users/janhoy/git/lucene-solr/solr/server/solr/foo/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@217956c4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1} 78738 INFO (qtp225493257-18) [ x:foo] o.a.s.c.SolrDeletionPolicy newest commit generation = 1 78747 INFO (qtp225493257-18) [ x:foo] o.a.s.s.SolrIndexSearcher Opening [Searcher@77583d16[foo] main] 78752 INFO (qtp225493257-18) [ x:foo] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/janhoy/git/lucene-solr/solr/server/solr/foo/conf 78752 INFO (qtp225493257-18) [ x:foo] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/Users/janhoy/git/lucene-solr/solr/server/solr/foo/conf} 78758 INFO (qtp225493257-18) [ x:foo] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/Users/janhoy/git/lucene-solr/solr/server/solr/foo/conf 78759 INFO (qtp225493257-18) [ x:foo] o.a.s.r.RestManager Initializing 0 registered ManagedResources 78763 INFO (qtp225493257-18) [ x:foo] o.a.s.h.c.SpellCheckComponent Initializing spell checkers 78768 INFO (qtp225493257-18) [ x:foo] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01} 78768 INFO (qtp225493257-18) [ x:foo] o.a.s.h.c.SpellCheckComponent No queryConverter defined, using default converter 78770 INFO (qtp225493257-18) [ x:foo] o.a.s.h.c.QueryElevationComponent Loading QueryElevation from: /Users/janhoy/git/lucene-solr/solr/server/solr/foo/conf/elevate.xml 78777 INFO (qtp225493257-18) [ x:foo] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 78786 INFO (searcherExecutor-7-thread-1-processing-x:foo) [ x:foo] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@77583d16[foo] main{ExitableDirectoryReader(UninvertingDirectoryReader())} 78786 INFO (searcherExecutor-7-thread-1-processing-x:foo) [ x:foo] o.a.s.c.QuerySenderListener QuerySenderListener done. 78786 INFO (searcherExecutor-7-thread-1-processing-x:foo) [ x:foo] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default 78787 INFO (qtp225493257-18) [ x:foo] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets 78787 INFO (searcherExecutor-7-thread-1-processing-x:foo) [ x:foo] o.a.s.c.SolrCore [foo] Registered new searcher Searcher@77583d16[foo] main{ExitableDirectoryReader(UninvertingDirectoryReader())} 78787 INFO (qtp225493257-18) [ x:foo] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index 78789 INFO (qtp225493257-18) [ x:foo] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1545543503236300800 78792 INFO (qtp225493257-18) [ x:foo] o.a.s.u.UpdateLog Took 4.0ms to seed version buckets with highest version 1545543503236300800 78792 INFO (qtp225493257-18) [ x:foo] o.a.s.c.CoreContainer registering core: foo 78793 INFO (qtp225493257-18) [ x:foo] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={name=foo&action=CREATE&instanceDir=foo&wt=json} status=0 QTime=1170 There is obviously a LOT of noise here, what should go to DEBUG level, and what should simply go away?
          Hide
          elyograg Shawn Heisey added a comment -

          Good idea.

          I think a lot of what gets logged during startup and shutdown is kinda worthless. I would rather just see single-line messages about major milestones (jars A through Z loaded, core XXX initialized, etc) at the INFO level. ERROR and WARN messages would be unchanged.

          Some examination would need to be performed to decide whether any of those messages are generally useful if the system is NOT starting up or shutting down.

          I can see two solutions, and can imagine both being used:

          • Move the verbose stuff to DEBUG or TRACE, and ask users to increase their logging if we need to see those logs to figure out a problem.
          • Create a SolrCore level flag (maybe even two flags) to indicate startup/shutdown is in progress, and suppress certain logs when the flag is enabled. Create a solr.xml config parameter to output the log messages anyway, regardless of the the flag.

          Changing the level of the logs is easier, and would help out with logging in more situations than just startup/shutdown. That approach is probably sufficient, but I do wonder if any of those logs might be generally useful when a startup/shutdown is NOT in progress.

          Show
          elyograg Shawn Heisey added a comment - Good idea. I think a lot of what gets logged during startup and shutdown is kinda worthless. I would rather just see single-line messages about major milestones (jars A through Z loaded, core XXX initialized, etc) at the INFO level. ERROR and WARN messages would be unchanged. Some examination would need to be performed to decide whether any of those messages are generally useful if the system is NOT starting up or shutting down. I can see two solutions, and can imagine both being used: Move the verbose stuff to DEBUG or TRACE, and ask users to increase their logging if we need to see those logs to figure out a problem. Create a SolrCore level flag (maybe even two flags) to indicate startup/shutdown is in progress, and suppress certain logs when the flag is enabled. Create a solr.xml config parameter to output the log messages anyway, regardless of the the flag. Changing the level of the logs is easier, and would help out with logging in more situations than just startup/shutdown. That approach is probably sufficient, but I do wonder if any of those logs might be generally useful when a startup/shutdown is NOT in progress.
          Hide
          elyograg Shawn Heisey added a comment -

          Thinking generally ... Solr's INFO-level logging is much too verbose. WARN-level logging shows very little unless there are serious problems – it's pretty much an all-or-nothing choice.

          Some of what currently happens at INFO should definitely be at DEBUG, and some if it should be moved to the next level up. It's even possible that some of it should be moved down to WARN.

          I'm torn on what to do with the logging that shows all parameters of a request. Those are useful, but a busy server would see better performance if they are not logged. Perhaps the level of those particular messages is something that can be controlled by solrconfig.xml.

          Show
          elyograg Shawn Heisey added a comment - Thinking generally ... Solr's INFO-level logging is much too verbose. WARN-level logging shows very little unless there are serious problems – it's pretty much an all-or-nothing choice. Some of what currently happens at INFO should definitely be at DEBUG, and some if it should be moved to the next level up. It's even possible that some of it should be moved down to WARN. I'm torn on what to do with the logging that shows all parameters of a request. Those are useful, but a busy server would see better performance if they are not logged. Perhaps the level of those particular messages is something that can be controlled by solrconfig.xml.
          Hide
          janhoy Jan Høydahl added a comment -

          Tagging two related (and old) issues SOLR-4132 and SOLR-5563.

          Show
          janhoy Jan Høydahl added a comment - Tagging two related (and old) issues SOLR-4132 and SOLR-5563 .
          Hide
          arafalov Alexandre Rafalovitch added a comment -

          What if logging parameters of the request was an UpdateRequestProcessor? Because these days parameters come from all sorts of locations and things could get messy. Then the existing step-by-step logging could be at TRACE or removed all together.

          And the URP could be added/removed per request now as well as dynamically via VIA. It could also be configured to log at whatever level user wants in and/or for particular request type (e.g. log updates, not deletes).

          Show
          arafalov Alexandre Rafalovitch added a comment - What if logging parameters of the request was an UpdateRequestProcessor? Because these days parameters come from all sorts of locations and things could get messy. Then the existing step-by-step logging could be at TRACE or removed all together. And the URP could be added/removed per request now as well as dynamically via VIA. It could also be configured to log at whatever level user wants in and/or for particular request type (e.g. log updates, not deletes).
          Hide
          janhoy Jan Høydahl added a comment -

          What if logging parameters of the request was an UpdateRequestProcessor?

          I don't see how URP is related to reducing logging during startup?

          I think this issue should be about moving a ton of INFO level logs to DEBUG level so the normal case startup looks more like this

          > bin/solr start
          Starting Solr on port 8983 from /Users/janhoy/git/lucene-solr/solr/server
          
          190  INFO  (main) [   ] o.e.j.s.Server jetty-9.3.8.v20160314
          446  INFO  (main) [   ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /Users/janhoy/git/lucene-solr/solr/server/solr
          453  INFO  (main) [   ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/janhoy/git/lucene-solr/solr/server/solr/solr.xml
          596  INFO  (main) [   ] o.a.s.c.CoreContainer Loaded 3 cores: [foo, bar, baz], [instanceDir=/Users/janhoy/git/lucene-solr/solr/server/solr]
          924  INFO  (main) [   ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@6536e911{/solr,file:///Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp/,AVAILABLE}{/Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp}
          946  INFO  (main) [   ] o.e.j.s.ServerConnector Started ServerConnector@683dbc2c{HTTP/1.1,[http/1.1]}{0.0.0.0:8983}
          946  INFO  (main) [   ] o.e.j.s.Server Started @1338ms
          

          EVERYTHING that does not add value to the normal-path should not be logged. If someone needs to debug they can turn on debugging. And we should probably make it easier to enable debugging as well, i.e. through a bin/solr start -v argument which somehow changes the loglevel to DEBUG. In the same fashion we could add a -q argument which changes loglevel to WARN. Perhaps there could be a REST admin API to do the same without fiddling with log4j.properties, coupled with a new bin/solr loglevel <level> convenience CLI to change the loglevel of the running instance?

          Show
          janhoy Jan Høydahl added a comment - What if logging parameters of the request was an UpdateRequestProcessor? I don't see how URP is related to reducing logging during startup? I think this issue should be about moving a ton of INFO level logs to DEBUG level so the normal case startup looks more like this > bin/solr start Starting Solr on port 8983 from /Users/janhoy/git/lucene-solr/solr/server 190 INFO (main) [ ] o.e.j.s.Server jetty-9.3.8.v20160314 446 INFO (main) [ ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /Users/janhoy/git/lucene-solr/solr/server/solr 453 INFO (main) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/janhoy/git/lucene-solr/solr/server/solr/solr.xml 596 INFO (main) [ ] o.a.s.c.CoreContainer Loaded 3 cores: [foo, bar, baz], [instanceDir=/Users/janhoy/git/lucene-solr/solr/server/solr] 924 INFO (main) [ ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@6536e911{/solr,file:///Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp/,AVAILABLE}{/Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp} 946 INFO (main) [ ] o.e.j.s.ServerConnector Started ServerConnector@683dbc2c{HTTP/1.1,[http/1.1]}{0.0.0.0:8983} 946 INFO (main) [ ] o.e.j.s.Server Started @1338ms EVERYTHING that does not add value to the normal-path should not be logged. If someone needs to debug they can turn on debugging. And we should probably make it easier to enable debugging as well, i.e. through a bin/solr start -v argument which somehow changes the loglevel to DEBUG . In the same fashion we could add a -q argument which changes loglevel to WARN . Perhaps there could be a REST admin API to do the same without fiddling with log4j.properties, coupled with a new bin/solr loglevel <level> convenience CLI to change the loglevel of the running instance?
          Hide
          noble.paul Noble Paul added a comment -

          If someone needs to debug they can turn on debugging. And we should probably make it easier to enable debugging as well, i.e. through a bin/solr start -v argument which somehow changes the loglevel to DEBUG

          +1

          Show
          noble.paul Noble Paul added a comment - If someone needs to debug they can turn on debugging. And we should probably make it easier to enable debugging as well, i.e. through a bin/solr start -v argument which somehow changes the loglevel to DEBUG +1
          Hide
          janhoy Jan Høydahl added a comment -

          I spun off the -V and -q ideas into SOLR-9534

          Show
          janhoy Jan Høydahl added a comment - I spun off the -V and -q ideas into SOLR-9534
          Hide
          janhoy Jan Høydahl added a comment -

          First patch, moving many unhelpful INFO logs to DEBUG level as well as reducing Jetty logging.

          With this patch, the bin/solr start -f shrinks from 31 to 13 lines (11 if applied on top of SOLR-8186 and SOLR-9534):

          Starting Solr on port 8983 from /Users/janhoy/git/lucene-solr/solr/server
          
          0    INFO  (main) [   ] o.e.j.s.Server jetty-9.3.8.v20160314
          311  INFO  (main) [   ] o.a.s.c.SolrResourceLoader Using system property solr.solr.home: /Users/janhoy/git/lucene-solr/solr/server/solr
          311  INFO  (main) [   ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/janhoy/git/lucene-solr/solr/server/solr'
          316  INFO  (main) [   ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/janhoy/git/lucene-solr/solr/server/solr/solr.xml
          424  WARN  (main) [   ] o.a.s.c.CoreContainer Couldn't add files from /Users/janhoy/git/lucene-solr/solr/server/solr/lib to classpath: /Users/janhoy/git/lucene-solr/solr/server/solr/lib
          744  INFO  (main) [   ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/janhoy/git/lucene-solr/solr/server/solr
          749  INFO  (main) [   ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
          761  INFO  (main) [   ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@6536e911{/solr,file:///Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp/,AVAILABLE}{/Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp}
          774  INFO  (main) [   ] o.e.j.s.ServerConnector Started ServerConnector@5609159b{HTTP/1.1,[http/1.1]}{0.0.0.0:8983}
          775  INFO  (main) [   ] o.e.j.s.Server Started @1310ms
          

          Likewise the bin/solr create -c foo logs shrink from 129 lines to 50 lines!

          Still WorkInProgress. Would be good with some confirmation that I'm on the right track here.

          Show
          janhoy Jan Høydahl added a comment - First patch, moving many unhelpful INFO logs to DEBUG level as well as reducing Jetty logging. With this patch, the bin/solr start -f shrinks from 31 to 13 lines (11 if applied on top of SOLR-8186 and SOLR-9534 ): Starting Solr on port 8983 from /Users/janhoy/git/lucene-solr/solr/server 0 INFO (main) [ ] o.e.j.s.Server jetty-9.3.8.v20160314 311 INFO (main) [ ] o.a.s.c.SolrResourceLoader Using system property solr.solr.home: /Users/janhoy/git/lucene-solr/solr/server/solr 311 INFO (main) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/janhoy/git/lucene-solr/solr/server/solr' 316 INFO (main) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/janhoy/git/lucene-solr/solr/server/solr/solr.xml 424 WARN (main) [ ] o.a.s.c.CoreContainer Couldn't add files from /Users/janhoy/git/lucene-solr/solr/server/solr/lib to classpath: /Users/janhoy/git/lucene-solr/solr/server/solr/lib 744 INFO (main) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/janhoy/git/lucene-solr/solr/server/solr 749 INFO (main) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done 761 INFO (main) [ ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@6536e911{/solr,file:///Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp/,AVAILABLE}{/Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp} 774 INFO (main) [ ] o.e.j.s.ServerConnector Started ServerConnector@5609159b{HTTP/1.1,[http/1.1]}{0.0.0.0:8983} 775 INFO (main) [ ] o.e.j.s.Server Started @1310ms Likewise the bin/solr create -c foo logs shrink from 129 lines to 50 lines! Still WorkInProgress. Would be good with some confirmation that I'm on the right track here.
          Hide
          janhoy Jan Høydahl added a comment -

          After we cleaned up the INFO level, we should probably look through the DEBUG level too, moving some of the less useful stuff down to TRACE; that will make the new solr start -v mode more useful.

          Show
          janhoy Jan Høydahl added a comment - After we cleaned up the INFO level, we should probably look through the DEBUG level too, moving some of the less useful stuff down to TRACE; that will make the new solr start -v mode more useful.
          Hide
          dsmiley David Smiley added a comment -

          +1 this'll be nice.

          311 INFO (main) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/janhoy/git/lucene-solr/solr/server/solr'

          This comes right after solr.solr.home is printed... I think this line is implied and therefore not helpful?

          INFO (main) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done

          Looks like TRACE is appropriate for this one.

          761 INFO (main) [ ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@6536e911

          {/solr,file:///Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp/,AVAILABLE} {/Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp}

          Maybe we can disable Jetty from printing that one – the web-app notion is an internal detail now.

          Show
          dsmiley David Smiley added a comment - +1 this'll be nice. 311 INFO (main) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/janhoy/git/lucene-solr/solr/server/solr' This comes right after solr.solr.home is printed... I think this line is implied and therefore not helpful? INFO (main) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done Looks like TRACE is appropriate for this one. 761 INFO (main) [ ] o.e.j.s.h.ContextHandler Started o.e.j.w.WebAppContext@6536e911 {/solr,file:///Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp/,AVAILABLE} {/Users/janhoy/git/lucene-solr/solr/server/solr-webapp/webapp} Maybe we can disable Jetty from printing that one – the web-app notion is an internal detail now.
          Hide
          janhoy Jan Høydahl added a comment -

          Updated patch. I'll commit this and then keep the issue open a bit longer for further commits.

          Show
          janhoy Jan Høydahl added a comment - Updated patch. I'll commit this and then keep the issue open a bit longer for further commits.
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit f391d57075ca4bbb5608079bec63d9a6a574308f in lucene-solr's branch refs/heads/master from Jan Høydahl
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=f391d570 ]

          SOLR-6677: Reduced logging during Solr startup, moved more logs to DEBUG level

          Show
          jira-bot ASF subversion and git services added a comment - Commit f391d57075ca4bbb5608079bec63d9a6a574308f in lucene-solr's branch refs/heads/master from Jan Høydahl [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=f391d570 ] SOLR-6677 : Reduced logging during Solr startup, moved more logs to DEBUG level
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit 03575003068f568980782e913016b2ac281e1741 in lucene-solr's branch refs/heads/branch_6x from Jan Høydahl
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=0357500 ]

          SOLR-6677: Reduced logging during Solr startup, moved more logs to DEBUG level

          (cherry picked from commit f391d57)

          Show
          jira-bot ASF subversion and git services added a comment - Commit 03575003068f568980782e913016b2ac281e1741 in lucene-solr's branch refs/heads/branch_6x from Jan Høydahl [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=0357500 ] SOLR-6677 : Reduced logging during Solr startup, moved more logs to DEBUG level (cherry picked from commit f391d57)
          Hide
          janhoy Jan Høydahl added a comment -

          We're now down to 9 lines for bin/solr start -f.
          And 20 lines for bin/solr start -c -f (down from 67, thanks to SOLR-5563).
          For bin/solr create -c foo we have reduced from 129 to 48.

          Feel free to commit other log-level changes across the code base as part of this issue or a spinoff issue.

          Show
          janhoy Jan Høydahl added a comment - We're now down to 9 lines for bin/solr start -f . And 20 lines for bin/solr start -c -f (down from 67, thanks to SOLR-5563 ). For bin/solr create -c foo we have reduced from 129 to 48. Feel free to commit other log-level changes across the code base as part of this issue or a spinoff issue.
          Hide
          janhoy Jan Høydahl added a comment -

          Test failures:

          FAILED:  junit.framework.TestSuite.org.apache.solr.analysis.TestFoldingMultitermExtrasQuery
          ...
          Caused by: java.lang.NullPointerException
          	at org.apache.solr.schema.IndexSchema.readSchema(IndexSchema.java:541)
          	... 34 more
          

          Will commit a fix for the nullpointer

          Show
          janhoy Jan Høydahl added a comment - Test failures: FAILED: junit.framework.TestSuite.org.apache.solr.analysis.TestFoldingMultitermExtrasQuery ... Caused by: java.lang.NullPointerException at org.apache.solr.schema.IndexSchema.readSchema(IndexSchema.java:541) ... 34 more Will commit a fix for the nullpointer
          Hide
          janhoy Jan Høydahl added a comment -

          Committed to master (but with wrong JIRA id):

          Commit bede7aefa3b2294e869d7fa543417e160e3518f9 in lucene-solr's branch refs/heads/master from Jan Høydahl
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=bede7ae ]
          SOLR-9534: Fix test failures related to nullpointer when printing core name in logs.

          Show
          janhoy Jan Høydahl added a comment - Committed to master (but with wrong JIRA id): Commit bede7aefa3b2294e869d7fa543417e160e3518f9 in lucene-solr's branch refs/heads/master from Jan Høydahl [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=bede7ae ] SOLR-9534 : Fix test failures related to nullpointer when printing core name in logs.
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit dffbefa153ac6d86c60d09a1f69c1ba770e864ec in lucene-solr's branch refs/heads/branch_6x from Jan Høydahl
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=dffbefa ]

          SOLR-6677: Fix test failures related to nullpointer when printing core name in logs.

          (cherry picked from commit bede7ae - which btw had wrong JIRA number..)

          Show
          jira-bot ASF subversion and git services added a comment - Commit dffbefa153ac6d86c60d09a1f69c1ba770e864ec in lucene-solr's branch refs/heads/branch_6x from Jan Høydahl [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=dffbefa ] SOLR-6677 : Fix test failures related to nullpointer when printing core name in logs. (cherry picked from commit bede7ae - which btw had wrong JIRA number..)
          Hide
          romseygeek Alan Woodward added a comment -

          Some more moves from INFO to DEBUG, mostly on shutdown now

          Show
          romseygeek Alan Woodward added a comment - Some more moves from INFO to DEBUG, mostly on shutdown now
          Hide
          janhoy Jan Høydahl added a comment -

          This is cool. Just imagine all the GB of disk space all Solr users globally will save after all this

          Show
          janhoy Jan Høydahl added a comment - This is cool. Just imagine all the GB of disk space all Solr users globally will save after all this
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit eee7063f673858d074fb304707084706c17c85fc in lucene-solr's branch refs/heads/branch_6x from Alan Woodward
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=eee7063 ]

          SOLR-6677: Some more logging moves from INFO to DEBUG

          Show
          jira-bot ASF subversion and git services added a comment - Commit eee7063f673858d074fb304707084706c17c85fc in lucene-solr's branch refs/heads/branch_6x from Alan Woodward [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=eee7063 ] SOLR-6677 : Some more logging moves from INFO to DEBUG
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit 255bf895b3c9ed9620d9168d644c72ae922b20b6 in lucene-solr's branch refs/heads/master from Alan Woodward
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=255bf89 ]

          SOLR-6677: Some more logging moves from INFO to DEBUG

          Show
          jira-bot ASF subversion and git services added a comment - Commit 255bf895b3c9ed9620d9168d644c72ae922b20b6 in lucene-solr's branch refs/heads/master from Alan Woodward [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=255bf89 ] SOLR-6677 : Some more logging moves from INFO to DEBUG
          Hide
          janhoy Jan Høydahl added a comment -

          New patch with some extra INFO->DEBUG conversions related to startup. One of the changes is to log this line only when there is actually a change in number of nodes:

          o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
          

          Do you see a need to log it even if there is no change?

          Show
          janhoy Jan Høydahl added a comment - New patch with some extra INFO->DEBUG conversions related to startup. One of the changes is to log this line only when there is actually a change in number of nodes: o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0) Do you see a need to log it even if there is no change?
          Hide
          romseygeek Alan Woodward added a comment -

          +1 to the ZK logging changes.

          Here's some more, mostly around config and schema loading:

          • lots of INFO->DEBUG
          • summarised a few useful schema INFO log lines into a single line
          • moved a couple of INFO lines about deprecated schema entities to WARN
          • conversely, moved a couple of DirectoryFactory WARN lines to DEBUG (creating a new index directory and not finding any old directories to clean up - both entirely normal!)
          Show
          romseygeek Alan Woodward added a comment - +1 to the ZK logging changes. Here's some more, mostly around config and schema loading: lots of INFO->DEBUG summarised a few useful schema INFO log lines into a single line moved a couple of INFO lines about deprecated schema entities to WARN conversely, moved a couple of DirectoryFactory WARN lines to DEBUG (creating a new index directory and not finding any old directories to clean up - both entirely normal!)
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit 0eaa85f696a7ea7e3752763e179d9bdde98dff3e in lucene-solr's branch refs/heads/master from Jan Høydahl
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=0eaa85f ]

          SOLR-6677: part 3, moving some more to DEBUG. Only printing "Updated live nodes from ZooKeeper..." if there was actually a change

          Show
          jira-bot ASF subversion and git services added a comment - Commit 0eaa85f696a7ea7e3752763e179d9bdde98dff3e in lucene-solr's branch refs/heads/master from Jan Høydahl [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=0eaa85f ] SOLR-6677 : part 3, moving some more to DEBUG. Only printing "Updated live nodes from ZooKeeper..." if there was actually a change
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit 1ac2b0159492243250a2ef95ec29feeec9baf510 in lucene-solr's branch refs/heads/branch_6x from Jan Høydahl
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=1ac2b01 ]

          SOLR-6677: part 3, moving some more to DEBUG. Only printing "Updated live nodes from ZooKeeper..." if there was actually a change

          (cherry picked from commit 0eaa85f)

          Show
          jira-bot ASF subversion and git services added a comment - Commit 1ac2b0159492243250a2ef95ec29feeec9baf510 in lucene-solr's branch refs/heads/branch_6x from Jan Høydahl [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=1ac2b01 ] SOLR-6677 : part 3, moving some more to DEBUG. Only printing "Updated live nodes from ZooKeeper..." if there was actually a change (cherry picked from commit 0eaa85f)
          Hide
          janhoy Jan Høydahl added a comment -

          Pushed part 3

          Show
          janhoy Jan Høydahl added a comment - Pushed part 3
          Hide
          janhoy Jan Høydahl added a comment -

          Alan Woodward, please add your name to the SOLR-6677 CHANGES.txt entry on your next commit

          Show
          janhoy Jan Høydahl added a comment - Alan Woodward , please add your name to the SOLR-6677 CHANGES.txt entry on your next commit
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit 1d46b419df356d0142732bd0745ccd1ab0606704 in lucene-solr's branch refs/heads/branch_6x from Alan Woodward
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=1d46b41 ]

          SOLR-6677: More log noise reduction

          Show
          jira-bot ASF subversion and git services added a comment - Commit 1d46b419df356d0142732bd0745ccd1ab0606704 in lucene-solr's branch refs/heads/branch_6x from Alan Woodward [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=1d46b41 ] SOLR-6677 : More log noise reduction
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit 59c10713460604b3ff4300abc11d0f1a79a42307 in lucene-solr's branch refs/heads/master from Alan Woodward
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=59c1071 ]

          SOLR-6677: More log noise reduction

          Show
          jira-bot ASF subversion and git services added a comment - Commit 59c10713460604b3ff4300abc11d0f1a79a42307 in lucene-solr's branch refs/heads/master from Alan Woodward [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=59c1071 ] SOLR-6677 : More log noise reduction
          Hide
          elyograg Shawn Heisey added a comment -

          Do you see a need to log it even if there is no change?

          At SolrCloud startup, it might be nice to have one log entry with the number of nodes ... if we are able to detect when the number has become stable. Then after that, only log this at INFO if the number changes. I can't say whether it makes sense to log at DEBUG or TRACE when the node number stays the same.

          Show
          elyograg Shawn Heisey added a comment - Do you see a need to log it even if there is no change? At SolrCloud startup, it might be nice to have one log entry with the number of nodes ... if we are able to detect when the number has become stable. Then after that, only log this at INFO if the number changes. I can't say whether it makes sense to log at DEBUG or TRACE when the node number stays the same.
          Hide
          janhoy Jan Høydahl added a comment -

          Here is what I see on one of the nodes when starting a 3-node cloud setup with the current master:

          INFO  - 2016-09-27 20:44:46.881; [   ] org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/192.168.0.11:8983_solr
          INFO  - 2016-09-27 20:44:46.886; [   ] org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from ZooKeeper... (0) -> (1)
          ...
          INFO  - 2016-09-27 20:44:51.654; [   ] org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from ZooKeeper... (1) -> (2)
          INFO  - 2016-09-27 20:44:57.451; [   ] org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from ZooKeeper... (2) -> (3)
          ...
          INFO  - 2016-09-27 20:45:46.723; [   ] org.apache.solr.common.cloud.ZkStateReader$StateWatcher; A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/gettingstarted/state.json] for collection [gettingstarted] has occurred - updating... (live nodes size: [3])
          

          I think this is sufficient.

          Show
          janhoy Jan Høydahl added a comment - Here is what I see on one of the nodes when starting a 3-node cloud setup with the current master: INFO - 2016-09-27 20:44:46.881; [ ] org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/192.168.0.11:8983_solr INFO - 2016-09-27 20:44:46.886; [ ] org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from ZooKeeper... (0) -> (1) ... INFO - 2016-09-27 20:44:51.654; [ ] org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from ZooKeeper... (1) -> (2) INFO - 2016-09-27 20:44:57.451; [ ] org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from ZooKeeper... (2) -> (3) ... INFO - 2016-09-27 20:45:46.723; [ ] org.apache.solr.common.cloud.ZkStateReader$StateWatcher; A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/gettingstarted/state.json] for collection [gettingstarted] has occurred - updating... (live nodes size: [3]) I think this is sufficient.
          Hide
          janhoy Jan Høydahl added a comment -

          Looks like SOLR-5901 is related too. It has an old patch. Mark Miller is this something you want to commit?

          Show
          janhoy Jan Høydahl added a comment - Looks like SOLR-5901 is related too. It has an old patch. Mark Miller is this something you want to commit?
          Hide
          hossman Hoss Man added a comment -

          Alan Woodward: please make sure to add a note to the "Upgrading" section of CHANGES for 6.3 to call attention to the fact that Solr's logging verbosity at the INFO level has been greatly reduced, and people may need to update the log configs to use the DEBUG level to get the same logging messages as before.

          Show
          hossman Hoss Man added a comment - Alan Woodward : please make sure to add a note to the "Upgrading" section of CHANGES for 6.3 to call attention to the fact that Solr's logging verbosity at the INFO level has been greatly reduced, and people may need to update the log configs to use the DEBUG level to get the same logging messages as before.
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit a2e24d1fc55c796fd966135fe19e47a150437553 in lucene-solr's branch refs/heads/branch_6x from Alan Woodward
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=a2e24d1 ]

          SOLR-6677: Call out logging changes in upgrading section of CHANGES

          Show
          jira-bot ASF subversion and git services added a comment - Commit a2e24d1fc55c796fd966135fe19e47a150437553 in lucene-solr's branch refs/heads/branch_6x from Alan Woodward [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=a2e24d1 ] SOLR-6677 : Call out logging changes in upgrading section of CHANGES
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit 250c9d93f39bc8d3992b0e924bcd0a7883ea0773 in lucene-solr's branch refs/heads/master from Alan Woodward
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=250c9d9 ]

          SOLR-6677: Call out logging changes in upgrading section of CHANGES

          Show
          jira-bot ASF subversion and git services added a comment - Commit 250c9d93f39bc8d3992b0e924bcd0a7883ea0773 in lucene-solr's branch refs/heads/master from Alan Woodward [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=250c9d9 ] SOLR-6677 : Call out logging changes in upgrading section of CHANGES
          Hide
          romseygeek Alan Woodward added a comment -

          Good point Hoss Man, have done just that.

          Show
          romseygeek Alan Woodward added a comment - Good point Hoss Man , have done just that.
          Hide
          janhoy Jan Høydahl added a comment -

          The statement "use the DEBUG level to get the same logging messages as before." is a bit misleading, as you will get MUCH MUCH more than what you got with INFO before. The key point here is that if people are looking for particular logs or have scripted some log parsing relying on some messages, you may need to tweak your log4j.properties to get those msgs back. That could be done either by increasing verbosity in general (not advisable) or by increasing verbosity for a particular class or package.

          Show
          janhoy Jan Høydahl added a comment - The statement "use the DEBUG level to get the same logging messages as before." is a bit misleading, as you will get MUCH MUCH more than what you got with INFO before. The key point here is that if people are looking for particular logs or have scripted some log parsing relying on some messages, you may need to tweak your log4j.properties to get those msgs back. That could be done either by increasing verbosity in general (not advisable) or by increasing verbosity for a particular class or package.
          Hide
          arafalov Alexandre Rafalovitch added a comment -

          I can't see it in commits done already, but the following line can probably be Debug or even TRACE level.

          78768 INFO  (qtp225493257-18) [   x:foo] o.a.s.h.c.SpellCheckComponent No queryConverter defined, using default converter
          

          It refers to the flag that is not set anywhere in the examples and is probably too obscure to be anything but default for 99.9% of the installations. If anything it should log the opposite case, but that's a different issue.

          Show
          arafalov Alexandre Rafalovitch added a comment - I can't see it in commits done already, but the following line can probably be Debug or even TRACE level. 78768 INFO (qtp225493257-18) [ x:foo] o.a.s.h.c.SpellCheckComponent No queryConverter defined, using default converter It refers to the flag that is not set anywhere in the examples and is probably too obscure to be anything but default for 99.9% of the installations. If anything it should log the opposite case, but that's a different issue.
          Hide
          janhoy Jan Høydahl added a comment -

          Feel free to commit a fix tagged with SOLR-6677. Then I guess we'll close this issue in a few days and start opening new issues for further improvements.

          Show
          janhoy Jan Høydahl added a comment - Feel free to commit a fix tagged with SOLR-6677 . Then I guess we'll close this issue in a few days and start opening new issues for further improvements.
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit 6f6bb08782ae885419068d5c796cc5b29ea59d3b in lucene-solr's branch refs/heads/master from Alexandre Rafalovitch
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=6f6bb08 ]

          SOLR-6677: queryConverter message is now at TRACE

          Show
          jira-bot ASF subversion and git services added a comment - Commit 6f6bb08782ae885419068d5c796cc5b29ea59d3b in lucene-solr's branch refs/heads/master from Alexandre Rafalovitch [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=6f6bb08 ] SOLR-6677 : queryConverter message is now at TRACE
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit ae7b685e4179f37443d99c5f7d80695485147dec in lucene-solr's branch refs/heads/branch_6x from Alexandre Rafalovitch
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=ae7b685 ]

          SOLR-6677: queryConverter message is now at TRACE

          Show
          jira-bot ASF subversion and git services added a comment - Commit ae7b685e4179f37443d99c5f7d80695485147dec in lucene-solr's branch refs/heads/branch_6x from Alexandre Rafalovitch [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=ae7b685 ] SOLR-6677 : queryConverter message is now at TRACE
          Hide
          janhoy Jan Høydahl added a comment -

          Resolving as fixed. Please open new issues for futher log level cleanup. Thanks for all the positive energy on this issue

          Show
          janhoy Jan Høydahl added a comment - Resolving as fixed. Please open new issues for futher log level cleanup. Thanks for all the positive energy on this issue
          Hide
          shalinmangar Shalin Shekhar Mangar added a comment -

          Closing after 6.3.0 release.

          Show
          shalinmangar Shalin Shekhar Mangar added a comment - Closing after 6.3.0 release.

            People

            • Assignee:
              janhoy Jan Høydahl
              Reporter:
              noble.paul Noble Paul
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development