Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
Log level of ReadOnlyZKClient moved to debug.
Description
Running commands in spark-shell, this is what it looks like on each invocation:
scala> val count = rdd.count() 2018-11-07 21:01:46,026 INFO [Executor task launch worker for task 1] zookeeper.ReadOnlyZKClient: Connect 0x18f3d868 to localhost:2181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2018-11-07 21:01:46,027 INFO [ReadOnlyZKClient-localhost:2181@0x18f3d868] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$20/1362339879@743dab9f 2018-11-07 21:01:46,030 INFO [ReadOnlyZKClient-localhost:2181@0x18f3d868-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 2018-11-07 21:01:46,031 INFO [ReadOnlyZKClient-localhost:2181@0x18f3d868-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 2018-11-07 21:01:46,033 INFO [ReadOnlyZKClient-localhost:2181@0x18f3d868-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x166f1b283080005, negotiated timeout = 40000 2018-11-07 21:01:46,035 INFO [Executor task launch worker for task 1] mapreduce.TableInputFormatBase: Input split length: 0 bytes. [Stage 1:> (0 + 1) / 1]2018-11-07 21:01:48,074 INFO [Executor task launch worker for task 1] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x18f3d868 to localhost:2181 2018-11-07 21:01:48,075 INFO [ReadOnlyZKClient-localhost:2181@0x18f3d868] zookeeper.ZooKeeper: Session: 0x166f1b283080005 closed 2018-11-07 21:01:48,076 INFO [ReadOnlyZKClient -localhost:2181@0x18f3d868-EventThread] zookeeper.ClientCnxn: EventThread shut down for session: 0x166f1b283080005 count: Long = 10
Let me shut down the ReadOnlyZKClient log level.