Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7240 Scaling HDFS
  3. HDFS-11559

Ozone: MiniOzoneCluster prints too many log messages by default

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: HDFS-7240
    • Component/s: ozone, test
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      When running tests using MiniOzoneCluster, it prints out tons of debug and trace log messages from all logs including the ones in from the libraries such as

      • ipc.Server
        2017-03-21 15:13:13,053 [Thread-0] DEBUG ipc.Server (RPC.java:registerProtocolAndImpl(895)) - RpcKind = RPC_PROTOCOL_BUFFER Protocol Name = org.apache.hadoop.ipc.ProtocolMetaInfoPB version=1 ProtocolImpl=org.apache.hadoop.ipc.protobuf.ProtocolInfoProtos$ProtocolInfoService$2 protocolClass=org.apache.hadoop.ipc.ProtocolMetaInfoPB
        2017-03-21 15:13:13,058 [Thread-0] DEBUG ipc.Server (RPC.java:registerProtocolAndImpl(895)) - RpcKind = RPC_PROTOCOL_BUFFER Protocol Name = org.apache.hadoop.hdfs.protocol.ClientProtocol version=1 ProtocolImpl=org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2 protocolClass=org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolPB
        2017-03-21 15:13:13,058 [Thread-0] DEBUG ipc.Server (RPC.java:registerProtocolAndImpl(895)) - RpcKind = RPC_PROTOCOL_BUFFER Protocol Name = org.apache.hadoop.ha.HAServiceProtocol version=1 ProtocolImpl=org.apache.hadoop.ha.proto.HAServiceProtocolProtos$HAServiceProtocolService$2 protocolClass=org.apache.hadoop.ha.protocolPB.HAServiceProtocolPB
        
      • netty
        2017-03-21 15:13:14,912 [Thread-0] DEBUG nio.NioEventLoop (Slf4JLogger.java:debug(76)) - -Dio.netty.noKeySetOptimization: false
        2017-03-21 15:13:14,912 [Thread-0] DEBUG nio.NioEventLoop (Slf4JLogger.java:debug(76)) - -Dio.netty.selectorAutoRebuildThreshold: 512
        2017-03-21 15:13:14,916 [Thread-0] TRACE nio.NioEventLoop (Slf4JLogger.java:trace(46)) - Instrumented an optimized java.util.Set into: sun.nio.ch.KQueueSelectorImpl@501c140b
        2017-03-21 15:13:14,916 [Thread-0] TRACE nio.NioEventLoop (Slf4JLogger.java:trace(46)) - Instrumented an optimized java.util.Set into: sun.nio.ch.KQueueSelectorImpl@30ebe2a0
        2017-03-21 15:13:14,917 [Thread-0] TRACE nio.NioEventLoop (Slf4JLogger.java:trace(46)) - Instrumented an optimized java.util.Set into: sun.nio.ch.KQueueSelectorImpl@98cbeb6
        
      • beanutils
        2017-03-21 15:13:10,490 [Thread-0] TRACE beanutils.BeanUtils (BeanUtilsBean.java:setProperty(888)) -   setProperty(org.apache.commons.configuration2.PropertiesConfiguration@18f07b01, listDelimiterHandler, org.apache.commons.configuration2.convert.DefaultListDelimiterHandler@5473ddc2)
        2017-03-21 15:13:10,491 [Thread-0] TRACE beanutils.BeanUtils (BeanUtilsBean.java:setProperty(906)) -     Target bean = org.apache.commons.configuration2.PropertiesConfiguration@18f07b01
        2017-03-21 15:13:10,491 [Thread-0] TRACE beanutils.BeanUtils (BeanUtilsBean.java:setProperty(907)) -     Target name = listDelimiterHandler
        
      • eclipse.jetty
         
        2017-03-21 15:13:14,796 [Thread-0] DEBUG component.ContainerLifeCycle (ContainerLifeCycle.java:addBean(323)) - org.eclipse.jetty.server.Server@32cd6303 added {qtp48399352{STOPPED,8<=0<=200,i=0,q=0},AUTO}
        2017-03-21 15:13:14,797 [Thread-0] DEBUG util.DecoratedObjectFactory (DecoratedObjectFactory.java:addDecorator(52)) - Adding Decorator: org.eclipse.jetty.util.DeprecationWarning@b7a0755
        2017-03-21 15:13:14,797 [Thread-0] DEBUG component.ContainerLifeCycle (ContainerLifeCycle.java:addBean(323)) - org.eclipse.jetty.server.session.SessionHandler@47175536 added {org.eclipse.jetty.server.session.HashSessionManager@51fce36f,AUTO}
        

      The test output becomes very very long.

        Attachments

        1. HDFS-11559-HDFS-7240.20170321.patch
          2 kB
          Tsz-wo Sze
        2. HDFS-11559-HDFS-7240.20170321b.patch
          1.0 kB
          Tsz-wo Sze

          Activity

            People

            • Assignee:
              szetszwo Tsz-wo Sze
              Reporter:
              szetszwo Tsz-wo Sze

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment