SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/mnt/yarn/usercache/hadoop/filecache/33/__spark_libs__3907077530080990255.zip/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 20/10/30 21:42:48 INFO SignalUtils: Registered signal handler for TERM 20/10/30 21:42:48 INFO SignalUtils: Registered signal handler for HUP 20/10/30 21:42:48 INFO SignalUtils: Registered signal handler for INT 20/10/30 21:42:48 INFO SecurityManager: Changing view acls to: yarn,hadoop 20/10/30 21:42:48 INFO SecurityManager: Changing modify acls to: yarn,hadoop 20/10/30 21:42:48 INFO SecurityManager: Changing view acls groups to: 20/10/30 21:42:48 INFO SecurityManager: Changing modify acls groups to: 20/10/30 21:42:48 INFO SecurityManager: SecurityManager: authentication enabled; ui acls disabled; users with view permissions: Set(yarn, hadoop); groups with view permissions: Set(); users with modify permissions: Set(yarn, hadoop); groups with modify permissions: Set() 20/10/30 21:42:49 DEBUG MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, value=[Rate of successful kerberos logins and latency (milliseconds)], valueName=Time) 20/10/30 21:42:49 DEBUG MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, value=[Rate of failed kerberos logins and latency (milliseconds)], valueName=Time) 20/10/30 21:42:49 DEBUG MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, value=[GetGroups], valueName=Time) 20/10/30 21:42:49 DEBUG MetricsSystemImpl: UgiMetrics, User and group related metrics 20/10/30 21:42:49 DEBUG Shell: setsid exited with exit code 0 20/10/30 21:42:49 DEBUG KerberosName: Kerberos krb5 configuration not found, setting default realm to empty 20/10/30 21:42:49 DEBUG Groups: Creating new Groups object 20/10/30 21:42:49 DEBUG NativeCodeLoader: Trying to load the custom-built native-hadoop library... 20/10/30 21:42:49 DEBUG NativeCodeLoader: Loaded the native-hadoop library 20/10/30 21:42:49 DEBUG JniBasedUnixGroupsMapping: Using JniBasedUnixGroupsMapping for Group resolution 20/10/30 21:42:49 DEBUG JniBasedUnixGroupsMappingWithFallback: Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMapping 20/10/30 21:42:49 DEBUG Groups: Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000 20/10/30 21:42:49 DEBUG SparkHadoopUtil: creating UGI for user: hadoop 20/10/30 21:42:49 DEBUG UserGroupInformation: hadoop login 20/10/30 21:42:49 DEBUG UserGroupInformation: hadoop login commit 20/10/30 21:42:49 DEBUG UserGroupInformation: using local user:UnixPrincipal: yarn 20/10/30 21:42:49 DEBUG UserGroupInformation: Using user: "UnixPrincipal: yarn" with name yarn 20/10/30 21:42:49 DEBUG UserGroupInformation: User entry: "yarn" 20/10/30 21:42:49 DEBUG UserGroupInformation: UGI loginUser:yarn (auth:SIMPLE) 20/10/30 21:42:49 DEBUG UserGroupInformation: PrivilegedAction as:hadoop (auth:SIMPLE) from:org.apache.spark.deploy.yarn.ApplicationMaster.doAsUser(ApplicationMaster.scala:778) 20/10/30 21:42:49 DEBUG UserGroupInformation: PrivilegedAction as:hadoop (auth:SIMPLE) from:org.apache.spark.deploy.yarn.ApplicationMaster.doAsUser(ApplicationMaster.scala:778) 20/10/30 21:42:49 INFO ApplicationMaster: Preparing Local resources 20/10/30 21:42:49 DEBUG NativeAzureFileSystem: finalize() called. 20/10/30 21:42:49 DEBUG NativeAzureFileSystem: finalize() called. 20/10/30 21:42:49 DEBUG BlockReaderLocal: dfs.client.use.legacy.blockreader.local = false 20/10/30 21:42:49 DEBUG BlockReaderLocal: dfs.client.read.shortcircuit = false 20/10/30 21:42:49 DEBUG BlockReaderLocal: dfs.client.domain.socket.data.traffic = false 20/10/30 21:42:49 DEBUG BlockReaderLocal: dfs.domain.socket.path = 20/10/30 21:42:49 DEBUG RetryUtils: multipleLinearRandomRetry = null 20/10/30 21:42:50 DEBUG Server: rpcKind=RPC_PROTOCOL_BUFFER, rpcRequestWrapperClass=class org.apache.hadoop.ipc.ProtobufRpcEngine$RpcRequestWrapper, rpcInvoker=org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker@cdc3aae 20/10/30 21:42:50 DEBUG Client: getting client out of cache: org.apache.hadoop.ipc.Client@35d6ca49 20/10/30 21:42:50 DEBUG DomainSocketWatcher: org.apache.hadoop.net.unix.DomainSocketWatcher$2@52ec35f2: starting with interruptCheckPeriodMs = 60000 20/10/30 21:42:50 DEBUG PerformanceAdvisory: Both short-circuit local reads and UNIX domain socket are disabled. 20/10/30 21:42:50 DEBUG DataTransferSaslUtil: DataTransferProtocol not using SaslPropertiesResolver, no QOP found in configuration for dfs.data.transfer.protection 20/10/30 21:42:50 DEBUG Client: The ping interval is 60000 ms. 20/10/30 21:42:50 DEBUG Client: Connecting to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 20/10/30 21:42:50 DEBUG UserGroupInformation: PrivilegedAction as:hadoop (auth:SIMPLE) from:org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:725) 20/10/30 21:42:50 DEBUG SaslRpcClient: Sending sasl message state: NEGOTIATE 20/10/30 21:42:50 DEBUG SaslRpcClient: Received SASL message state: NEGOTIATE auths { method: "TOKEN" mechanism: "DIGEST-MD5" protocol: "" serverId: "default" challenge: "realm=\"default\",nonce=\"c/+mWQFLK4zAY1D6U2Y2dsb9x4wVUPxQ7yLSekd5\",qop=\"auth-conf\",charset=utf-8,cipher=\"3des,rc4,des,rc4-56,rc4-40\",algorithm=md5-sess" } auths { method: "SIMPLE" mechanism: "" } 20/10/30 21:42:50 DEBUG SaslRpcClient: Get token info proto:interface org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolPB info:@org.apache.hadoop.security.token.TokenInfo(value=class org.apache.hadoop.hdfs.security.token.delegation.DelegationTokenSelector) 20/10/30 21:42:50 DEBUG SaslRpcClient: Use SIMPLE authentication for protocol ClientNamenodeProtocolPB 20/10/30 21:42:50 DEBUG SaslRpcClient: Sending sasl message state: INITIATE auths { method: "SIMPLE" mechanism: "" } 20/10/30 21:42:50 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop: starting, having connections 1 20/10/30 21:42:50 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop sending #0 20/10/30 21:42:50 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop got value #0 20/10/30 21:42:50 DEBUG ProtobufRpcEngine: Call: getFileInfo took 114ms 20/10/30 21:42:50 DEBUG UserGroupInformation: PrivilegedAction as:hadoop (auth:SIMPLE) from:org.apache.spark.deploy.yarn.ApplicationMaster.doAsUser(ApplicationMaster.scala:778) 20/10/30 21:42:50 INFO ApplicationMaster: ApplicationAttemptId: appattempt_1604078122294_0004_000001 20/10/30 21:42:50 DEBUG ShutdownHookManager: Adding shutdown hook 20/10/30 21:42:50 INFO ApplicationMaster: Starting the user application in a separate Thread 20/10/30 21:42:50 INFO ApplicationMaster: Waiting for spark context initialization... 20/10/30 21:42:50 DEBUG InternalLoggerFactory: Using SLF4J as the default logging framework 20/10/30 21:42:50 DEBUG InternalThreadLocalMap: -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 20/10/30 21:42:50 DEBUG InternalThreadLocalMap: -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 20/10/30 21:42:50 INFO RSCDriver: Connecting to: a.example.com:11000 20/10/30 21:42:50 INFO RSCDriver: Starting RPC server... 20/10/30 21:42:50 DEBUG MultithreadEventLoopGroup: -Dio.netty.eventLoopThreads: 8 20/10/30 21:42:50 DEBUG PlatformDependent0: -Dio.netty.noUnsafe: false 20/10/30 21:42:50 DEBUG PlatformDependent0: Java version: 8 20/10/30 21:42:50 DEBUG PlatformDependent0: sun.misc.Unsafe.theUnsafe: available 20/10/30 21:42:50 DEBUG PlatformDependent0: sun.misc.Unsafe.copyMemory: available 20/10/30 21:42:50 DEBUG PlatformDependent0: java.nio.Buffer.address: available 20/10/30 21:42:50 DEBUG PlatformDependent0: direct buffer constructor: available 20/10/30 21:42:50 DEBUG PlatformDependent0: java.nio.Bits.unaligned: available, true 20/10/30 21:42:50 DEBUG PlatformDependent0: jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable prior to Java9 20/10/30 21:42:50 DEBUG PlatformDependent0: java.nio.DirectByteBuffer.(long, int): available 20/10/30 21:42:50 DEBUG PlatformDependent: sun.misc.Unsafe: available 20/10/30 21:42:50 DEBUG PlatformDependent: -Dio.netty.tmpdir: /mnt/yarn/usercache/hadoop/appcache/application_1604078122294_0004/container_1604078122294_0004_01_000001/tmp (java.io.tmpdir) 20/10/30 21:42:50 DEBUG PlatformDependent: -Dio.netty.bitMode: 64 (sun.arch.data.model) 20/10/30 21:42:50 DEBUG PlatformDependent: -Dio.netty.noPreferDirect: false 20/10/30 21:42:50 DEBUG PlatformDependent: -Dio.netty.maxDirectMemory: 4260102144 bytes 20/10/30 21:42:50 DEBUG PlatformDependent: -Dio.netty.uninitializedArrayAllocationThreshold: -1 20/10/30 21:42:50 DEBUG CleanerJava6: java.nio.ByteBuffer.cleaner(): available 20/10/30 21:42:50 DEBUG NioEventLoop: -Dio.netty.noKeySetOptimization: false 20/10/30 21:42:50 DEBUG NioEventLoop: -Dio.netty.selectorAutoRebuildThreshold: 512 20/10/30 21:42:50 DEBUG PlatformDependent: org.jctools-core.MpscChunkedArrayQueue: available 20/10/30 21:42:50 DEBUG DefaultChannelId: -Dio.netty.processId: 28808 (auto-detected) 20/10/30 21:42:50 DEBUG NetUtil: -Djava.net.preferIPv4Stack: false 20/10/30 21:42:50 DEBUG NetUtil: -Djava.net.preferIPv6Addresses: false 20/10/30 21:42:50 DEBUG NetUtil: Loopback interface: lo (lo, 127.0.0.1) 20/10/30 21:42:50 DEBUG NetUtil: /proc/sys/net/core/somaxconn: 4096 20/10/30 21:42:50 DEBUG DefaultChannelId: -Dio.netty.machineId: 06:15:c4:ff:fe:8f:3e:93 (auto-detected) 20/10/30 21:42:50 DEBUG ResourceLeakDetector: -Dio.netty.leakDetection.level: simple 20/10/30 21:42:50 DEBUG ResourceLeakDetector: -Dio.netty.leakDetection.targetRecords: 4 20/10/30 21:42:50 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.numHeapArenas: 8 20/10/30 21:42:50 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.numDirectArenas: 8 20/10/30 21:42:50 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.pageSize: 8192 20/10/30 21:42:50 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.maxOrder: 11 20/10/30 21:42:50 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.chunkSize: 16777216 20/10/30 21:42:50 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.tinyCacheSize: 512 20/10/30 21:42:50 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.smallCacheSize: 256 20/10/30 21:42:50 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.normalCacheSize: 64 20/10/30 21:42:50 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.maxCachedBufferCapacity: 32768 20/10/30 21:42:50 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.cacheTrimInterval: 8192 20/10/30 21:42:50 DEBUG PooledByteBufAllocator: -Dio.netty.allocator.useCacheForAllThreads: true 20/10/30 21:42:50 DEBUG ByteBufUtil: -Dio.netty.allocator.type: pooled 20/10/30 21:42:50 DEBUG ByteBufUtil: -Dio.netty.threadLocalDirectBufferSize: 65536 20/10/30 21:42:50 DEBUG ByteBufUtil: -Dio.netty.maxThreadLocalCharBufferSize: 16384 20/10/30 21:42:50 INFO RpcServer: Connected to the port 11000 20/10/30 21:42:50 WARN RSCConf: Your hostname, ip-10-85-100-91.vpc.internal, resolves to a loopback address, but we couldn't find any external IP address! 20/10/30 21:42:50 WARN RSCConf: Set livy.rsc.rpc.server.address if you need to bind to another address. 20/10/30 21:42:50 DEBUG Recycler: -Dio.netty.recycler.maxCapacityPerThread: 32768 20/10/30 21:42:50 DEBUG Recycler: -Dio.netty.recycler.maxSharedCapacityFactor: 2 20/10/30 21:42:50 DEBUG Recycler: -Dio.netty.recycler.linkCapacity: 16 20/10/30 21:42:50 DEBUG Recycler: -Dio.netty.recycler.ratio: 8 20/10/30 21:42:51 DEBUG AbstractByteBuf: -Dio.netty.buffer.bytebuf.checkAccessible: true 20/10/30 21:42:51 DEBUG ResourceLeakDetectorFactory: Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@b44065 20/10/30 21:42:51 DEBUG KryoMessageCodec: Encoded message of type org.apache.livy.rsc.rpc.Rpc$SaslMessage (41 bytes) 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] WRITE: 45B +-------------------------------------------------+ | 0 1 2 3 4 5 6 7 8 9 a b c d e f | +--------+-------------------------------------------------+----------------+ |00000000| 00 00 00 29 14 01 01 65 65 66 62 36 35 36 64 2d |...)...eefb656d-| |00000010| 64 64 36 31 2d 34 32 32 34 2d 62 39 30 32 2d 39 |dd61-4224-b902-9| |00000020| 38 61 31 31 37 37 64 34 34 32 b3 01 01 |8a1177d442... | +--------+-------------------------------------------------+----------------+ 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] FLUSH 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] ACTIVE 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] READ: 102B +-------------------------------------------------+ | 0 1 2 3 4 5 6 7 8 9 a b c d e f | +--------+-------------------------------------------------+----------------+ |00000000| 00 00 00 62 14 01 00 01 5e 72 65 61 6c 6d 3d 22 |...b....^realm="| |00000010| 72 73 63 22 2c 6e 6f 6e 63 65 3d 22 66 4c 6e 58 |rsc",nonce="fLnX| |00000020| 77 4c 67 43 41 36 33 38 62 2b 6b 4d 32 78 37 43 |wLgCA638b+kM2x7C| |00000030| 79 70 4a 2b 52 79 52 49 42 6e 47 31 33 70 42 71 |ypJ+RyRIBnG13pBq| |00000040| 4d 71 4b 48 22 2c 63 68 61 72 73 65 74 3d 75 74 |MqKH",charset=ut| |00000050| 66 2d 38 2c 61 6c 67 6f 72 69 74 68 6d 3d 6d 64 |f-8,algorithm=md| |00000060| 35 2d 73 65 73 73 |5-sess | +--------+-------------------------------------------------+----------------+ 20/10/30 21:42:51 DEBUG KryoMessageCodec: Decoded message of type org.apache.livy.rsc.rpc.Rpc$SaslMessage (98 bytes) 20/10/30 21:42:51 DEBUG Rpc$SaslClientHandler: Handling SASL challenge message... 20/10/30 21:42:51 DEBUG Rpc$SaslClientHandler: Sending SASL challenge response... 20/10/30 21:42:51 DEBUG KryoMessageCodec: Encoded message of type org.apache.livy.rsc.rpc.Rpc$SaslMessage (275 bytes) 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] WRITE: 279B +-------------------------------------------------+ | 0 1 2 3 4 5 6 7 8 9 a b c d e f | +--------+-------------------------------------------------+----------------+ |00000000| 00 00 01 13 14 01 00 01 8e 02 63 68 61 72 73 65 |..........charse| |00000010| 74 3d 75 74 66 2d 38 2c 75 73 65 72 6e 61 6d 65 |t=utf-8,username| |00000020| 3d 22 65 65 66 62 36 35 36 64 2d 64 64 36 31 2d |="eefb656d-dd61-| |00000030| 34 32 32 34 2d 62 39 30 32 2d 39 38 61 31 31 37 |4224-b902-98a117| |00000040| 37 64 34 34 32 33 22 2c 72 65 61 6c 6d 3d 22 72 |7d4423",realm="r| |00000050| 73 63 22 2c 6e 6f 6e 63 65 3d 22 66 4c 6e 58 77 |sc",nonce="fLnXw| |00000060| 4c 67 43 41 36 33 38 62 2b 6b 4d 32 78 37 43 79 |LgCA638b+kM2x7Cy| |00000070| 70 4a 2b 52 79 52 49 42 6e 47 31 33 70 42 71 4d |pJ+RyRIBnG13pBqM| |00000080| 71 4b 48 22 2c 6e 63 3d 30 30 30 30 30 30 30 31 |qKH",nc=00000001| |00000090| 2c 63 6e 6f 6e 63 65 3d 22 54 70 71 67 6f 75 56 |,cnonce="TpqgouV| |000000a0| 76 57 67 39 52 33 31 37 73 39 4e 4b 57 46 33 4b |vWg9R317s9NKWF3K| |000000b0| 4a 2f 5a 54 65 52 36 4c 4a 41 50 57 73 6c 66 4c |J/ZTeR6LJAPWslfL| |000000c0| 4b 22 2c 64 69 67 65 73 74 2d 75 72 69 3d 22 72 |K",digest-uri="r| |000000d0| 73 63 2f 72 73 63 22 2c 6d 61 78 62 75 66 3d 36 |sc/rsc",maxbuf=6| |000000e0| 35 35 33 36 2c 72 65 73 70 6f 6e 73 65 3d 36 63 |5536,response=6c| |000000f0| 31 31 37 65 31 30 39 65 36 34 63 30 36 62 33 35 |117e109e64c06b35| |00000100| 30 32 66 32 35 66 33 33 34 38 30 34 37 64 2c 71 |02f25f3348047d,q| |00000110| 6f 70 3d 61 75 74 68 |op=auth | +--------+-------------------------------------------------+----------------+ 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] FLUSH 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] READ COMPLETE 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] READ: 49B +-------------------------------------------------+ | 0 1 2 3 4 5 6 7 8 9 a b c d e f | +--------+-------------------------------------------------+----------------+ |00000000| 00 00 00 2d 14 01 00 01 29 72 73 70 61 75 74 68 |...-....)rspauth| |00000010| 3d 66 61 65 39 31 35 65 35 63 32 62 33 35 33 32 |=fae915e5c2b3532| |00000020| 62 66 38 31 34 31 34 62 36 31 64 65 61 33 65 66 |bf81414b61dea3ef| |00000030| 62 |b | +--------+-------------------------------------------------+----------------+ 20/10/30 21:42:51 DEBUG KryoMessageCodec: Decoded message of type org.apache.livy.rsc.rpc.Rpc$SaslMessage (45 bytes) 20/10/30 21:42:51 DEBUG Rpc$SaslClientHandler: Handling SASL challenge message... 20/10/30 21:42:51 DEBUG Rpc$SaslClientHandler: SASL negotiation finished with QOP auth. 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] READ COMPLETE 20/10/30 21:42:51 DEBUG RpcDispatcher: [ReplDriver] Registered outstanding rpc 0 (org.apache.livy.rsc.BaseProtocol$RemoteDriverAddress). 20/10/30 21:42:51 DEBUG KryoMessageCodec: Encoded message of type org.apache.livy.rsc.rpc.Rpc$MessageHeader (5 bytes) 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] WRITE: 9B +-------------------------------------------------+ | 0 1 2 3 4 5 6 7 8 9 a b c d e f | +--------+-------------------------------------------------+----------------+ |00000000| 00 00 00 05 12 01 00 01 01 |......... | +--------+-------------------------------------------------+----------------+ 20/10/30 21:42:51 DEBUG KryoMessageCodec: Encoded message of type org.apache.livy.rsc.BaseProtocol$RemoteDriverAddress (87 bytes) 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] WRITE: 91B +-------------------------------------------------+ | 0 1 2 3 4 5 6 7 8 9 a b c d e f | +--------+-------------------------------------------------+----------------+ |00000000| 00 00 00 57 01 00 6f 72 67 2e 61 70 61 63 68 65 |...W..org.apache| |00000010| 2e 6c 69 76 79 2e 72 73 63 2e 42 61 73 65 50 72 |.livy.rsc.BasePr| |00000020| 6f 74 6f 63 6f 6c 24 52 65 6d 6f 74 65 44 72 69 |otocol$RemoteDri| |00000030| 76 65 72 41 64 64 72 65 73 f3 01 01 69 70 2d 31 |verAddres...ip-1| |00000040| 30 2d 38 35 2d 31 30 30 2d 39 31 2e 76 70 63 2e |0-85-100-91.vpc.| |00000050| 69 6e 74 65 72 6e 61 ec f0 ab 01 |interna.... | +--------+-------------------------------------------------+----------------+ 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] FLUSH 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] READ: 15B +-------------------------------------------------+ | 0 1 2 3 4 5 6 7 8 9 a b c d e f | +--------+-------------------------------------------------+----------------+ |00000000| 00 00 00 05 12 01 00 01 02 00 00 00 02 13 01 |............... | +--------+-------------------------------------------------+----------------+ 20/10/30 21:42:51 DEBUG KryoMessageCodec: Decoded message of type org.apache.livy.rsc.rpc.Rpc$MessageHeader (5 bytes) 20/10/30 21:42:51 DEBUG KryoMessageCodec: Decoded message of type org.apache.livy.rsc.rpc.Rpc$NullMessage (2 bytes) 20/10/30 21:42:51 DEBUG RpcDispatcher: [ReplDriver] Received RPC message: type=REPLY id=0 payload=org.apache.livy.rsc.rpc.Rpc$NullMessage 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] READ COMPLETE 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 - R:a.example.com/10.139.22.111:11000] READ COMPLETE 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 ! R:a.example.com/10.139.22.111:11000] CLOSE 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 ! R:a.example.com/10.139.22.111:11000] INACTIVE 20/10/30 21:42:51 DEBUG RpcDispatcher: Channel [id: 0xcb606f33, L:/10.85.100.91:34946 ! R:a.example.com/10.139.22.111:11000] became inactive. 20/10/30 21:42:51 DEBUG Rpc: [id: 0xcb606f33, L:/10.85.100.91:34946 ! R:a.example.com/10.139.22.111:11000] UNREGISTERED 20/10/30 21:42:54 DEBUG SparkInterpreter: Adding file:/mnt/yarn/usercache/hadoop/appcache/application_1604078122294_0004/container_1604078122294_0004_01_000001/netty-all-4.0.37.Final.jar to Scala interpreter's class path... 20/10/30 21:42:54 DEBUG SparkInterpreter: Adding file:/mnt/yarn/usercache/hadoop/appcache/application_1604078122294_0004/container_1604078122294_0004_01_000001/commons-codec-1.9.jar to Scala interpreter's class path... 20/10/30 21:42:54 DEBUG SparkInterpreter: Adding file:/mnt/yarn/usercache/hadoop/appcache/application_1604078122294_0004/container_1604078122294_0004_01_000001/datanucleus-api-jdo-3.2.6.jar to Scala interpreter's class path... 20/10/30 21:42:54 DEBUG SparkInterpreter: Adding file:/mnt/yarn/usercache/hadoop/appcache/application_1604078122294_0004/container_1604078122294_0004_01_000001/datanucleus-core-3.2.10.jar to Scala interpreter's class path... 20/10/30 21:42:54 DEBUG SparkInterpreter: Adding file:/mnt/yarn/usercache/hadoop/appcache/application_1604078122294_0004/container_1604078122294_0004_01_000001/datanucleus-rdbms-3.2.9.jar to Scala interpreter's class path... 20/10/30 21:42:54 INFO SparkEntries: Starting Spark context... 20/10/30 21:42:54 INFO SparkContext: Running Spark version 2.4.4 20/10/30 21:42:54 INFO SparkContext: Submitted application: Demo-b415b264 20/10/30 21:42:54 INFO SecurityManager: Changing view acls to: yarn,hadoop 20/10/30 21:42:54 INFO SecurityManager: Changing modify acls to: yarn,hadoop 20/10/30 21:42:54 INFO SecurityManager: Changing view acls groups to: 20/10/30 21:42:54 INFO SecurityManager: Changing modify acls groups to: 20/10/30 21:42:54 INFO SecurityManager: SecurityManager: authentication enabled; ui acls disabled; users with view permissions: Set(yarn, hadoop); groups with view permissions: Set(); users with modify permissions: Set(yarn, hadoop); groups with modify permissions: Set() 20/10/30 21:42:54 DEBUG TransportServer: Shuffle server started on port: 39989 20/10/30 21:42:54 INFO Utils: Successfully started service 'sparkDriver' on port 39989. 20/10/30 21:42:54 DEBUG SparkEnv: Using serializer: class org.apache.spark.serializer.JavaSerializer 20/10/30 21:42:54 INFO SparkEnv: Registering MapOutputTracker 20/10/30 21:42:54 DEBUG MapOutputTrackerMasterEndpoint: init 20/10/30 21:42:55 INFO SparkEnv: Registering BlockManagerMaster 20/10/30 21:42:55 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/10/30 21:42:55 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/10/30 21:42:55 INFO DiskBlockManager: Created local directory at /mnt/yarn/usercache/hadoop/appcache/application_1604078122294_0004/blockmgr-71f8f87f-d0e7-46cf-bf53-b1800fed30cc 20/10/30 21:42:55 DEBUG DiskBlockManager: Adding shutdown hook 20/10/30 21:42:55 INFO MemoryStore: MemoryStore started with capacity 2.2 GB 20/10/30 21:42:55 INFO SparkEnv: Registering OutputCommitCoordinator 20/10/30 21:42:55 DEBUG OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: init 20/10/30 21:42:55 DEBUG SecurityManager: Created SSL options for ui: SSLOptions{enabled=true, port=None, keyStore=Some(/usr/share/aws/emr/security/conf/keystore.jks), keyStorePassword=Some(xxx), trustStore=Some(/usr/share/aws/emr/security/conf/truststore.jks), trustStorePassword=Some(xxx), protocol=Some(TLSv1.2), enabledAlgorithms=Set(TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256, TLS_RSA_WITH_AES_256_CBC_SHA)} 20/10/30 21:42:55 DEBUG log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.spark_project.jetty.util.log) via org.spark_project.jetty.util.log.Slf4jLog 20/10/30 21:42:55 INFO log: Logging initialized @7476ms 20/10/30 21:42:55 DEBUG Jetty: java.lang.NumberFormatException: For input string: "unknown" at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.lang.Long.parseLong(Long.java:589) at java.lang.Long.valueOf(Long.java:803) at org.spark_project.jetty.util.Jetty.formatTimestamp(Jetty.java:89) at org.spark_project.jetty.util.Jetty.(Jetty.java:61) at org.spark_project.jetty.server.Server.getVersion(Server.java:159) at org.spark_project.jetty.server.handler.ContextHandler.(ContextHandler.java:128) at org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:143) at org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:130) at org.apache.spark.ui.WebUI.attachPage(WebUI.scala:83) at org.apache.spark.ui.WebUI$$anonfun$attachTab$1.apply(WebUI.scala:65) at org.apache.spark.ui.WebUI$$anonfun$attachTab$1.apply(WebUI.scala:65) at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48) at org.apache.spark.ui.WebUI.attachTab(WebUI.scala:65) at org.apache.spark.ui.SparkUI.initialize(SparkUI.scala:62) at org.apache.spark.ui.SparkUI.(SparkUI.scala:80) at org.apache.spark.ui.SparkUI$.create(SparkUI.scala:175) at org.apache.spark.SparkContext.(SparkContext.scala:444) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520) at org.apache.spark.SparkContext.getOrCreate(SparkContext.scala) at org.apache.livy.rsc.driver.SparkEntries.sc(SparkEntries.java:53) at org.apache.livy.rsc.driver.SparkEntries.sparkSession(SparkEntries.java:67) at org.apache.livy.repl.AbstractSparkInterpreter.postStart(AbstractSparkInterpreter.scala:69) at org.apache.livy.repl.SparkInterpreter$$anonfun$start$1.apply$mcV$sp(SparkInterpreter.scala:88) at org.apache.livy.repl.SparkInterpreter$$anonfun$start$1.apply(SparkInterpreter.scala:63) at org.apache.livy.repl.SparkInterpreter$$anonfun$start$1.apply(SparkInterpreter.scala:63) at org.apache.livy.repl.AbstractSparkInterpreter.restoreContextClassLoader(AbstractSparkInterpreter.scala:340) at org.apache.livy.repl.SparkInterpreter.start(SparkInterpreter.scala:63) at org.apache.livy.repl.Session$$anonfun$1.apply(Session.scala:128) at org.apache.livy.repl.Session$$anonfun$1.apply(Session.scala:122) at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@1685cde3 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@762ebcec{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@62c1e867,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@62c1e867 added {org.apache.spark.ui.JettyUtils$$anon$3-7a61ce54@3c91f932==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@62c1e867 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-7a61ce54,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@52fce64d 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@5b8d04fa{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@2589e8da,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@2589e8da added {org.apache.spark.ui.JettyUtils$$anon$3-5a6c064b@6f785759==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@2589e8da added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-5a6c064b,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@74b0dac0 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@1ce06ebe{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@6ef8830c,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@6ef8830c added {org.apache.spark.ui.JettyUtils$$anon$3-29107011@e887bc4b==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@6ef8830c added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-29107011,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@5b84c929 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@440ed979{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@6e44c217,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@6e44c217 added {org.apache.spark.ui.JettyUtils$$anon$3-447ea736@bd061153==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@6e44c217 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-447ea736,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@5930946 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@1c606781{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@1da3c433,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@1da3c433 added {org.apache.spark.ui.JettyUtils$$anon$3-61abc17d@3597cfc3==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@1da3c433 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-61abc17d,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@7cef3d37 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@632c0144{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@602dc34e,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@602dc34e added {org.apache.spark.ui.JettyUtils$$anon$3-5f32461f@70284733==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@602dc34e added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-5f32461f,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@5994c268 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@57ad4da7{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@1ae2fbf3,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@1ae2fbf3 added {org.apache.spark.ui.JettyUtils$$anon$3-4e75bd62@da741e39==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@1ae2fbf3 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-4e75bd62,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@310db146 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@cf012b5{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@1c05dbb,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@1c05dbb added {org.apache.spark.ui.JettyUtils$$anon$3-62bd7e4c@6c3bd527==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@1c05dbb added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-62bd7e4c,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@328fbc0f 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@31210260{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@38e75516,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@38e75516 added {org.apache.spark.ui.JettyUtils$$anon$3-352a9642@81385418==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@38e75516 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-352a9642,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@7a8a3b2c 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@4381141f{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@414ca69c,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@414ca69c added {org.apache.spark.ui.JettyUtils$$anon$3-20b5b071@60671fa5==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@414ca69c added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-20b5b071,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@74d34acd 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@4a247b65{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@212b4277,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@212b4277 added {org.apache.spark.ui.JettyUtils$$anon$3-70b5e1ac@67ce6626==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@212b4277 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-70b5e1ac,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@1ede4855 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@77c8f7b8{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@c8b3bcc,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@c8b3bcc added {org.apache.spark.ui.JettyUtils$$anon$3-53ec0370@3e4d6bc4==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@c8b3bcc added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-53ec0370,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@f5930d4 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@5a592fa8{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@691d4010,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@691d4010 added {org.apache.spark.ui.JettyUtils$$anon$3-3570d92e@8721a6af==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@691d4010 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-3570d92e,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@73e990c4 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@60ded57e{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@634004b5,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@634004b5 added {org.apache.spark.ui.JettyUtils$$anon$3-504a085a@4be12748==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@634004b5 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-504a085a,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@1a778574 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@233d90f8{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@16f50178,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@16f50178 added {org.apache.spark.ui.JettyUtils$$anon$3-76df4781@ab39c5c9==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@16f50178 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-76df4781,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@5025300b 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@1fd0c0a7{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@2110ece4,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@2110ece4 added {org.apache.spark.ui.JettyUtils$$anon$3-2d7f5408@d868df54==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@2110ece4 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-2d7f5408,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@44bc5bd4 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@5f55f890{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@55966d4c,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@55966d4c added {org.apache.spark.ui.JettyUtils$$anon$3-7c0c1d28@9ecb3484==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@55966d4c added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-7c0c1d28,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@5ac89b86 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@2aa97937{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@4c339d23,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@4c339d23 added {org.apache.spark.ui.JettyUtils$$anon$3-504a3cd0@4be32b50==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@4c339d23 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-504a3cd0,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@2fc121ca 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@7f4b6b94{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@7ee66411,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@7ee66411 added {org.apache.spark.ui.JettyUtils$$anon$3-34a35d10@99fc7fad==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@7ee66411 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-34a35d10,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@12caf53f 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@36792b39{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@7b72170b,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@7b72170b added {org.apache.spark.ui.JettyUtils$$anon$3-55978ea8@5a9d008e==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@7b72170b added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-55978ea8,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@6fee2be4 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@4cfb35d{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@6d449fa2,MANAGED} 20/10/30 21:42:55 DEBUG PreEncodedHttpField: HttpField encoders loaded: [] 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@6d449fa2 added {org.spark_project.jetty.servlet.DefaultServlet-fd16a32@77c3b64e==org.spark_project.jetty.servlet.DefaultServlet,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@6d449fa2 added {[/]=>org.spark_project.jetty.servlet.DefaultServlet-fd16a32,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@60641628 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@64e060ec{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@180da3d0,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@180da3d0 added {org.apache.spark.ui.JettyUtils$$anon$4-314f3f3e@a596f900==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@180da3d0 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$4-314f3f3e,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@633c7186 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@2b421410{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@fef7af3,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@fef7af3 added {org.glassfish.jersey.servlet.ServletContainer-1e3b9153@f67052a7==org.glassfish.jersey.servlet.ServletContainer,jsp=null,order=-1,inst=false,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@fef7af3 added {[/*]=>org.glassfish.jersey.servlet.ServletContainer-1e3b9153,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@23cd1fcc 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@13518374{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@4d8a4237,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@4d8a4237 added {org.apache.spark.ui.JettyUtils$$anon$4-4c50531e@612bc507==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@4d8a4237 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$4-4c50531e,POJO} 20/10/30 21:42:55 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@7791d47 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@49ff7615{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@e215833,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@e215833 added {org.apache.spark.ui.JettyUtils$$anon$4-7dd39fb5@1e162947==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@e215833 added {[/]=>org.apache.spark.ui.JettyUtils$$anon$4-7dd39fb5,POJO} 20/10/30 21:42:55 INFO JettyUtils: Adding filter org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter to /jobs, /jobs/json, /jobs/job, /jobs/job/json, /stages, /stages/json, /stages/stage, /stages/stage/json, /stages/pool, /stages/pool/json, /storage, /storage/json, /storage/rdd, /storage/rdd/json, /environment, /environment/json, /executors, /executors/json, /executors/threadDump, /executors/threadDump/json, /static, /, /api, /jobs/job/kill, /stages/stage/kill. 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@62c1e867 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@62c1e867 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@2589e8da added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@2589e8da added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@6ef8830c added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@6ef8830c added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@6e44c217 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@6e44c217 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@1da3c433 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@1da3c433 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@602dc34e added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@602dc34e added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@1ae2fbf3 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@1ae2fbf3 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@1c05dbb added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@1c05dbb added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@38e75516 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@38e75516 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@414ca69c added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@414ca69c added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@212b4277 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@212b4277 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@c8b3bcc added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@c8b3bcc added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@691d4010 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@691d4010 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@634004b5 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@634004b5 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@16f50178 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@16f50178 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@2110ece4 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@2110ece4 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@55966d4c added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@55966d4c added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@4c339d23 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@4c339d23 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@7ee66411 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@7ee66411 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@7b72170b added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@7b72170b added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@6d449fa2 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@6d449fa2 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@180da3d0 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@180da3d0 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@fef7af3 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@fef7af3 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@4d8a4237 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@4d8a4237 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@e215833 added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@e215833 added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.Server@13be5964 added {SparkUI{STOPPED,8<=0<=200,i=0,q=0},AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.Server@13be5964 added {org.spark_project.jetty.server.handler.ErrorHandler@2102c818,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.Server@13be5964 added {org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[],MANAGED} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.Server@13be5964 20/10/30 21:42:55 INFO Server: jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.Server@13be5964 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting SparkUI{STOPPED,8<=0<=200,i=0,q=0} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7589ms SparkUI{STARTED,8<=8<=200,i=7,q=0} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.ErrorHandler@2102c818 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.ErrorHandler@2102c818 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7589ms org.spark_project.jetty.server.handler.ErrorHandler@2102c818 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[] 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7589ms org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[] 20/10/30 21:42:55 INFO Server: Started @7589ms 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7589ms org.spark_project.jetty.server.Server@13be5964 20/10/30 21:42:55 DEBUG JettyUtils: Using requestHeaderSize: 8192 20/10/30 21:42:55 DEBUG ContainerLifeCycle: HttpConnectionFactory@7c712f0[HTTP/1.1] added {HttpConfiguration@7d389d14{32768/8192,8192/8192,https://:0,[]},POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: SslConnectionFactory@3f4c531d{SSL->HTTP/1.1} added {SslContextFactory@252c2390(file:///usr/share/aws/emr/security/conf/keystore.jks,null),AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@67d57b05{null,[]}{0.0.0.0:0} added {org.spark_project.jetty.server.Server@13be5964,UNMANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@67d57b05{null,[]}{0.0.0.0:0} added {SparkUI{STARTED,8<=8<=200,i=8,q=0},UNMANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@67d57b05{null,[]}{0.0.0.0:0} added {org.spark_project.jetty.util.thread.ScheduledExecutorScheduler@7fd50dfb,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@67d57b05{null,[]}{0.0.0.0:0} added {org.spark_project.jetty.io.ArrayByteBufferPool@373235e7,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@67d57b05{null,[ssl]}{0.0.0.0:0} added {SslConnectionFactory@3f4c531d{SSL->HTTP/1.1},AUTO} 20/10/30 21:42:55 DEBUG AbstractConnector: ServerConnector@67d57b05{SSL,[ssl]}{0.0.0.0:0} added SslConnectionFactory@3f4c531d{SSL->HTTP/1.1} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@67d57b05{SSL,[ssl, http/1.1]}{0.0.0.0:0} added {HttpConnectionFactory@7c712f0[HTTP/1.1],AUTO} 20/10/30 21:42:55 DEBUG AbstractConnector: ServerConnector@67d57b05{SSL,[ssl, http/1.1]}{0.0.0.0:0} added HttpConnectionFactory@7c712f0[HTTP/1.1] 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@67d57b05{SSL,[ssl, http/1.1]}{0.0.0.0:0} added {org.spark_project.jetty.server.ServerConnector$ServerConnectorManager@7646dc90,MANAGED} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting ServerConnector@67d57b05{SSL,[ssl, http/1.1]}{0.0.0.0:0} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@67d57b05{SSL,[ssl, http/1.1]}{0.0.0.0:39101} added {sun.nio.ch.ServerSocketChannelImpl[/0.0.0.0:39101],POJO} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.util.thread.ScheduledExecutorScheduler@7fd50dfb 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7623ms org.spark_project.jetty.util.thread.ScheduledExecutorScheduler@7fd50dfb 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting SslConnectionFactory@3f4c531d{SSL->HTTP/1.1} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting SslContextFactory@252c2390(file:///usr/share/aws/emr/security/conf/keystore.jks,null) 20/10/30 21:42:55 DEBUG X509: Certificate CN alias=emr-encryption-key-store CN=*.vpc.internal in X509@6f8f426b(emr-encryption-key-store,h=[],w=[]) 20/10/30 21:42:55 INFO SslContextFactory: x509=X509@6f8f426b(emr-encryption-key-store,h=[],w=[vpc.internal]) for SslContextFactory@252c2390(file:///usr/share/aws/emr/security/conf/keystore.jks,null) 20/10/30 21:42:55 DEBUG SslContextFactory: managers=[org.spark_project.jetty.util.ssl.SniX509ExtendedKeyManager@3a0fd09c] for SslContextFactory@252c2390(file:///usr/share/aws/emr/security/conf/keystore.jks,null) 20/10/30 21:42:55 DEBUG SslContextFactory: Selected Protocols [TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] 20/10/30 21:42:55 DEBUG SslContextFactory: Selected Ciphers [TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256] of [TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384, TLS_RSA_WITH_AES_256_CBC_SHA256, TLS_ECDH_ECDSA_WITH_AES_256_CBC_SHA384, TLS_ECDH_RSA_WITH_AES_256_CBC_SHA384, TLS_DHE_RSA_WITH_AES_256_CBC_SHA256, TLS_DHE_DSS_WITH_AES_256_CBC_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA, TLS_RSA_WITH_AES_256_CBC_SHA, TLS_ECDH_ECDSA_WITH_AES_256_CBC_SHA, TLS_ECDH_RSA_WITH_AES_256_CBC_SHA, TLS_DHE_RSA_WITH_AES_256_CBC_SHA, TLS_DHE_DSS_WITH_AES_256_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256, TLS_RSA_WITH_AES_128_CBC_SHA256, TLS_ECDH_ECDSA_WITH_AES_128_CBC_SHA256, TLS_ECDH_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_DSS_WITH_AES_128_CBC_SHA256, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA, TLS_RSA_WITH_AES_128_CBC_SHA, TLS_ECDH_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDH_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_DSS_WITH_AES_128_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384, TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256, TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384, TLS_RSA_WITH_AES_256_GCM_SHA384, TLS_ECDH_ECDSA_WITH_AES_256_GCM_SHA384, TLS_ECDH_RSA_WITH_AES_256_GCM_SHA384, TLS_DHE_RSA_WITH_AES_256_GCM_SHA384, TLS_DHE_DSS_WITH_AES_256_GCM_SHA384, TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256, TLS_RSA_WITH_AES_128_GCM_SHA256, TLS_ECDH_ECDSA_WITH_AES_128_GCM_SHA256, TLS_ECDH_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_DSS_WITH_AES_128_GCM_SHA256, TLS_EMPTY_RENEGOTIATION_INFO_SCSV] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7639ms SslContextFactory@252c2390(file:///usr/share/aws/emr/security/conf/keystore.jks,null) 20/10/30 21:42:55 DEBUG SslContextFactory: Customize 67cebb32[SSLEngine[hostname=null port=-1] SSL_NULL_WITH_NULL_NULL] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7641ms SslConnectionFactory@3f4c531d{SSL->HTTP/1.1} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting HttpConnectionFactory@7c712f0[HTTP/1.1] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7641ms HttpConnectionFactory@7c712f0[HTTP/1.1] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.ServerConnector$ServerConnectorManager@7646dc90 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.ServerConnector$ServerConnectorManager@7646dc90 added {org.spark_project.jetty.io.ManagedSelector@589b94aa id=0 keys=-1 selected=-1,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.ServerConnector$ServerConnectorManager@7646dc90 added {org.spark_project.jetty.io.ManagedSelector@6bfc4d9a id=1 keys=-1 selected=-1,AUTO} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.io.ManagedSelector@589b94aa id=0 keys=-1 selected=-1 20/10/30 21:42:55 DEBUG QueuedThreadPool: queue org.spark_project.jetty.io.ManagedSelector@589b94aa id=0 keys=0 selected=0 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7645ms org.spark_project.jetty.io.ManagedSelector@589b94aa id=0 keys=0 selected=0 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.io.ManagedSelector@6bfc4d9a id=1 keys=-1 selected=-1 20/10/30 21:42:55 DEBUG QueuedThreadPool: run org.spark_project.jetty.io.ManagedSelector@589b94aa id=0 keys=0 selected=0 20/10/30 21:42:55 DEBUG QueuedThreadPool: queue org.spark_project.jetty.io.ManagedSelector@6bfc4d9a id=1 keys=0 selected=0 20/10/30 21:42:55 DEBUG ExecuteProduceConsume: EPC Idle/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@6f06b902 execute 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7646ms org.spark_project.jetty.io.ManagedSelector@6bfc4d9a id=1 keys=0 selected=0 20/10/30 21:42:55 DEBUG ExecuteProduceConsume: EPC Prod/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@6f06b902 produce enter 20/10/30 21:42:55 DEBUG QueuedThreadPool: run org.spark_project.jetty.io.ManagedSelector@6bfc4d9a id=1 keys=0 selected=0 20/10/30 21:42:55 DEBUG ExecuteProduceConsume: EPC Prod/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@6f06b902 producing 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7646ms org.spark_project.jetty.server.ServerConnector$ServerConnectorManager@7646dc90 20/10/30 21:42:55 DEBUG ExecuteProduceConsume: EPC Idle/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@1cda5f90 execute 20/10/30 21:42:55 DEBUG ManagedSelector: Selector loop waiting on select 20/10/30 21:42:55 DEBUG ExecuteProduceConsume: EPC Prod/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@1cda5f90 produce enter 20/10/30 21:42:55 DEBUG ExecuteProduceConsume: EPC Prod/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@1cda5f90 producing 20/10/30 21:42:55 DEBUG ManagedSelector: Selector loop waiting on select 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@67d57b05{SSL,[ssl, http/1.1]}{0.0.0.0:39101} added {acceptor-0@767e321e,POJO} 20/10/30 21:42:55 DEBUG QueuedThreadPool: queue acceptor-0@767e321e 20/10/30 21:42:55 DEBUG QueuedThreadPool: run acceptor-0@767e321e 20/10/30 21:42:55 INFO AbstractConnector: Started ServerConnector@67d57b05{SSL,[ssl, http/1.1]}{0.0.0.0:39101} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7655ms ServerConnector@67d57b05{SSL,[ssl, http/1.1]}{0.0.0.0:39101} 20/10/30 21:42:55 INFO Utils: Successfully started service 'SparkUI (HTTPS)' on port 39101. 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.Server@13be5964 added {Spark@67d57b05{SSL,[ssl, http/1.1]}{0.0.0.0:39101},UNMANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: HttpConnectionFactory@4899f990[HTTP/1.1] added {HttpConfiguration@7d389d14{32768/8192,8192/8192,https://:0,[SecureRequestCustomizer@4f70dc5f]},POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@95f2df6{null,[]}{0.0.0.0:0} added {org.spark_project.jetty.server.Server@13be5964,UNMANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@95f2df6{null,[]}{0.0.0.0:0} added {SparkUI{STARTED,8<=8<=200,i=5,q=0},UNMANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@95f2df6{null,[]}{0.0.0.0:0} added {org.spark_project.jetty.util.thread.ScheduledExecutorScheduler@7fd50dfb,UNMANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@95f2df6{null,[]}{0.0.0.0:0} added {org.spark_project.jetty.io.ArrayByteBufferPool@51f21825,POJO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@95f2df6{null,[http/1.1]}{0.0.0.0:0} added {HttpConnectionFactory@4899f990[HTTP/1.1],AUTO} 20/10/30 21:42:55 DEBUG AbstractConnector: ServerConnector@95f2df6{HTTP/1.1,[http/1.1]}{0.0.0.0:0} added HttpConnectionFactory@4899f990[HTTP/1.1] 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@95f2df6{HTTP/1.1,[http/1.1]}{0.0.0.0:0} added {org.spark_project.jetty.server.ServerConnector$ServerConnectorManager@56202ef2,MANAGED} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting ServerConnector@95f2df6{HTTP/1.1,[http/1.1]}{0.0.0.0:0} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@95f2df6{HTTP/1.1,[http/1.1]}{0.0.0.0:42481} added {sun.nio.ch.ServerSocketChannelImpl[/0.0.0.0:42481],POJO} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting HttpConnectionFactory@4899f990[HTTP/1.1] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7657ms HttpConnectionFactory@4899f990[HTTP/1.1] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.ServerConnector$ServerConnectorManager@56202ef2 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.ServerConnector$ServerConnectorManager@56202ef2 added {org.spark_project.jetty.io.ManagedSelector@1f7b924d id=0 keys=-1 selected=-1,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.ServerConnector$ServerConnectorManager@56202ef2 added {org.spark_project.jetty.io.ManagedSelector@6fbb2cc9 id=1 keys=-1 selected=-1,AUTO} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.io.ManagedSelector@1f7b924d id=0 keys=-1 selected=-1 20/10/30 21:42:55 DEBUG QueuedThreadPool: queue org.spark_project.jetty.io.ManagedSelector@1f7b924d id=0 keys=0 selected=0 20/10/30 21:42:55 DEBUG QueuedThreadPool: run org.spark_project.jetty.io.ManagedSelector@1f7b924d id=0 keys=0 selected=0 20/10/30 21:42:55 DEBUG ExecuteProduceConsume: EPC Idle/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@68fa7dda execute 20/10/30 21:42:55 DEBUG ExecuteProduceConsume: EPC Prod/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@68fa7dda produce enter 20/10/30 21:42:55 DEBUG ExecuteProduceConsume: EPC Prod/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@68fa7dda producing 20/10/30 21:42:55 DEBUG ManagedSelector: Selector loop waiting on select 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7658ms org.spark_project.jetty.io.ManagedSelector@1f7b924d id=0 keys=0 selected=0 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.io.ManagedSelector@6fbb2cc9 id=1 keys=-1 selected=-1 20/10/30 21:42:55 DEBUG QueuedThreadPool: queue org.spark_project.jetty.io.ManagedSelector@6fbb2cc9 id=1 keys=0 selected=0 20/10/30 21:42:55 DEBUG QueuedThreadPool: run org.spark_project.jetty.io.ManagedSelector@6fbb2cc9 id=1 keys=0 selected=0 20/10/30 21:42:55 DEBUG ExecuteProduceConsume: EPC Idle/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@266d562f execute 20/10/30 21:42:55 DEBUG ExecuteProduceConsume: EPC Prod/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@266d562f produce enter 20/10/30 21:42:55 DEBUG ExecuteProduceConsume: EPC Prod/org.spark_project.jetty.io.ManagedSelector$SelectorProducer@266d562f producing 20/10/30 21:42:55 DEBUG ManagedSelector: Selector loop waiting on select 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7658ms org.spark_project.jetty.io.ManagedSelector@6fbb2cc9 id=1 keys=0 selected=0 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7659ms org.spark_project.jetty.server.ServerConnector$ServerConnectorManager@56202ef2 20/10/30 21:42:55 DEBUG ContainerLifeCycle: ServerConnector@95f2df6{HTTP/1.1,[http/1.1]}{0.0.0.0:42481} added {acceptor-0@79c9cebe,POJO} 20/10/30 21:42:55 DEBUG QueuedThreadPool: queue acceptor-0@79c9cebe 20/10/30 21:42:55 INFO AbstractConnector: Started ServerConnector@95f2df6{HTTP/1.1,[http/1.1]}{0.0.0.0:42481} 20/10/30 21:42:55 DEBUG QueuedThreadPool: run acceptor-0@79c9cebe 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7659ms ServerConnector@95f2df6{HTTP/1.1,[http/1.1]}{0.0.0.0:42481} 20/10/30 21:42:55 INFO Utils: Successfully started service 'SparkUI' on port 42481. 20/10/30 21:42:55 DEBUG ContainerLifeCycle: o.s.j.s.h.ContextHandler@78eafb12{/,null,null,@HttpsRedirect} added {org.apache.spark.ui.JettyUtils$$anon$1@374b6e3a,MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,null,@HttpsRedirect}] added {o.s.j.s.h.ContextHandler@78eafb12{/,null,null,@HttpsRedirect},UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,null,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,null,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.h.ContextHandler@78eafb12{/,null,null,@HttpsRedirect} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.h.ContextHandler@78eafb12{/,null,STARTING,@HttpsRedirect} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$1@374b6e3a 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.apache.spark.ui.JettyUtils$$anon$1@374b6e3a 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7676ms org.apache.spark.ui.JettyUtils$$anon$1@374b6e3a 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7676ms o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.Server@13be5964 added {HttpsRedirect@95f2df6{HTTP/1.1,[http/1.1]}{0.0.0.0:42481},UNMANAGED} 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d mime types IncludeExclude@5a631e1{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@2913581a,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@4077cd77} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d added {o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@62c1e867 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-7a61ce54 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-7a61ce54@3c91f932==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-7a61ce54=org.apache.spark.ui.JettyUtils$$anon$3-7a61ce54@3c91f932==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@62c1e867 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7689ms org.spark_project.jetty.servlet.ServletHandler@62c1e867 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27 20/10/30 21:42:55 DEBUG BaseHolder: Holding class org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter from sun.misc.Launcher$AppClassLoader@4157f54e 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7690ms org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27 20/10/30 21:42:55 DEBUG FilterHolder: Filter.init org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter@344cb74a 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-7a61ce54@3c91f932==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7694ms org.apache.spark.ui.JettyUtils$$anon$3-7a61ce54@3c91f932==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@45c3f057 for org.apache.spark.ui.JettyUtils$$anon$3-7a61ce54 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7696ms o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7696ms org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887 mime types IncludeExclude@55611d12{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@25d77d85,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@7fcc6020} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887 added {o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@2589e8da 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-5a6c064b from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-5a6c064b@6f785759==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-5a6c064b=org.apache.spark.ui.JettyUtils$$anon$3-5a6c064b@6f785759==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@2589e8da 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7697ms org.spark_project.jetty.servlet.ServletHandler@2589e8da 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-5a6c064b@6f785759==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7697ms org.apache.spark.ui.JettyUtils$$anon$3-5a6c064b@6f785759==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@3709a20e for org.apache.spark.ui.JettyUtils$$anon$3-5a6c064b 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7697ms o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7697ms org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070 mime types IncludeExclude@7478d3eb{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@68297024,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@12caa6fd} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070 added {o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@6ef8830c 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-29107011 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-29107011@e887bc4b==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-29107011=org.apache.spark.ui.JettyUtils$$anon$3-29107011@e887bc4b==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@6ef8830c 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7699ms org.spark_project.jetty.servlet.ServletHandler@6ef8830c 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-29107011@e887bc4b==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7699ms org.apache.spark.ui.JettyUtils$$anon$3-29107011@e887bc4b==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@15934ae4 for org.apache.spark.ui.JettyUtils$$anon$3-29107011 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7699ms o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7699ms org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba mime types IncludeExclude@43776b90{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@4cbcdd70,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@5acd2755} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba added {o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@6e44c217 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-447ea736 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-447ea736@bd061153==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-447ea736=org.apache.spark.ui.JettyUtils$$anon$3-447ea736@bd061153==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@6e44c217 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7701ms org.spark_project.jetty.servlet.ServletHandler@6e44c217 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-447ea736@bd061153==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7701ms org.apache.spark.ui.JettyUtils$$anon$3-447ea736@bd061153==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@30afacae for org.apache.spark.ui.JettyUtils$$anon$3-447ea736 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7701ms o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7701ms org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0 mime types IncludeExclude@628169f2{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@51c51d78,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@1c421132} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0 added {o.s.j.s.ServletContextHandler@1c606781{/stages,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@1c606781{/stages,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@1c606781{/stages,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@1da3c433 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-61abc17d from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-61abc17d@3597cfc3==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-61abc17d=org.apache.spark.ui.JettyUtils$$anon$3-61abc17d@3597cfc3==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@1da3c433 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7702ms org.spark_project.jetty.servlet.ServletHandler@1da3c433 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-61abc17d@3597cfc3==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7703ms org.apache.spark.ui.JettyUtils$$anon$3-61abc17d@3597cfc3==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@3743c210 for org.apache.spark.ui.JettyUtils$$anon$3-61abc17d 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7703ms o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7703ms org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3 mime types IncludeExclude@27330b8a{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@2b7455df,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@20e41e3} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3 added {o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@602dc34e 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-5f32461f from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-5f32461f@70284733==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-5f32461f=org.apache.spark.ui.JettyUtils$$anon$3-5f32461f@70284733==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@602dc34e 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7704ms org.spark_project.jetty.servlet.ServletHandler@602dc34e 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-5f32461f@70284733==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7704ms org.apache.spark.ui.JettyUtils$$anon$3-5f32461f@70284733==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@7b0c513a for org.apache.spark.ui.JettyUtils$$anon$3-5f32461f 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7704ms o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7704ms org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a mime types IncludeExclude@4d0f1573{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@3d7e5468,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@24e2477c} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a added {o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@1ae2fbf3 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-4e75bd62 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-4e75bd62@da741e39==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-4e75bd62=org.apache.spark.ui.JettyUtils$$anon$3-4e75bd62@da741e39==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@1ae2fbf3 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7706ms org.spark_project.jetty.servlet.ServletHandler@1ae2fbf3 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-4e75bd62@da741e39==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7706ms org.apache.spark.ui.JettyUtils$$anon$3-4e75bd62@da741e39==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@34d6150 for org.apache.spark.ui.JettyUtils$$anon$3-4e75bd62 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7706ms o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7706ms org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692 mime types IncludeExclude@278e59d7{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@73c03791,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@7e385b8e} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692 added {o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@1c05dbb 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-62bd7e4c from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-62bd7e4c@6c3bd527==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-62bd7e4c=org.apache.spark.ui.JettyUtils$$anon$3-62bd7e4c@6c3bd527==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@1c05dbb 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7708ms org.spark_project.jetty.servlet.ServletHandler@1c05dbb 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-62bd7e4c@6c3bd527==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7709ms org.apache.spark.ui.JettyUtils$$anon$3-62bd7e4c@6c3bd527==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@3e6d37bd for org.apache.spark.ui.JettyUtils$$anon$3-62bd7e4c 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7709ms o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7709ms org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146 mime types IncludeExclude@19765f07{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@25ae838c,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@72a9985b} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146 added {o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@38e75516 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-352a9642 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-352a9642@81385418==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-352a9642=org.apache.spark.ui.JettyUtils$$anon$3-352a9642@81385418==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@38e75516 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7710ms org.spark_project.jetty.servlet.ServletHandler@38e75516 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-352a9642@81385418==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7710ms org.apache.spark.ui.JettyUtils$$anon$3-352a9642@81385418==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@5df455f9 for org.apache.spark.ui.JettyUtils$$anon$3-352a9642 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7711ms o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7711ms org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727 mime types IncludeExclude@2732e882{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@1967d77f,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@66c30237} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727 added {o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@414ca69c 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-20b5b071 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-20b5b071@60671fa5==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-20b5b071=org.apache.spark.ui.JettyUtils$$anon$3-20b5b071@60671fa5==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@414ca69c 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7712ms org.spark_project.jetty.servlet.ServletHandler@414ca69c 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-20b5b071@60671fa5==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7712ms org.apache.spark.ui.JettyUtils$$anon$3-20b5b071@60671fa5==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@1dd06947 for org.apache.spark.ui.JettyUtils$$anon$3-20b5b071 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7712ms o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7712ms org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487 mime types IncludeExclude@aed1265{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@74417bb5,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@6ac5be2b} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487 added {o.s.j.s.ServletContextHandler@4a247b65{/storage,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@4a247b65{/storage,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@4a247b65{/storage,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@212b4277 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-70b5e1ac from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-70b5e1ac@67ce6626==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-70b5e1ac=org.apache.spark.ui.JettyUtils$$anon$3-70b5e1ac@67ce6626==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@212b4277 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7714ms org.spark_project.jetty.servlet.ServletHandler@212b4277 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-70b5e1ac@67ce6626==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7714ms org.apache.spark.ui.JettyUtils$$anon$3-70b5e1ac@67ce6626==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@70ed4d38 for org.apache.spark.ui.JettyUtils$$anon$3-70b5e1ac 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7714ms o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7714ms org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a mime types IncludeExclude@6d124a42{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@2a61952d,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@30ff99d4} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a added {o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@c8b3bcc 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-53ec0370 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-53ec0370@3e4d6bc4==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-53ec0370=org.apache.spark.ui.JettyUtils$$anon$3-53ec0370@3e4d6bc4==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@c8b3bcc 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7716ms org.spark_project.jetty.servlet.ServletHandler@c8b3bcc 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-53ec0370@3e4d6bc4==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7716ms org.apache.spark.ui.JettyUtils$$anon$3-53ec0370@3e4d6bc4==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@2aaf8266 for org.apache.spark.ui.JettyUtils$$anon$3-53ec0370 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7716ms o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7716ms org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b mime types IncludeExclude@73feb259{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@3f03b4cb,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@6969adff} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b added {o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a, org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,[o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@691d4010 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-3570d92e from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-3570d92e@8721a6af==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-3570d92e=org.apache.spark.ui.JettyUtils$$anon$3-3570d92e@8721a6af==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@691d4010 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7717ms org.spark_project.jetty.servlet.ServletHandler@691d4010 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-3570d92e@8721a6af==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7717ms org.apache.spark.ui.JettyUtils$$anon$3-3570d92e@8721a6af==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@38c10c2c for org.apache.spark.ui.JettyUtils$$anon$3-3570d92e 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7717ms o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7717ms org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17 mime types IncludeExclude@1c2c43f5{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@380e03da,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@81ed89b} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17 added {o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a, org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b, org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,[o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17,[o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@634004b5 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-504a085a from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-504a085a@4be12748==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-504a085a=org.apache.spark.ui.JettyUtils$$anon$3-504a085a@4be12748==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@634004b5 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7719ms org.spark_project.jetty.servlet.ServletHandler@634004b5 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-504a085a@4be12748==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7719ms org.apache.spark.ui.JettyUtils$$anon$3-504a085a@4be12748==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@6e3b2f3a for org.apache.spark.ui.JettyUtils$$anon$3-504a085a 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7720ms o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7720ms org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3 mime types IncludeExclude@582e2bf4{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@260afa6a,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@11ff536e} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3 added {o.s.j.s.ServletContextHandler@233d90f8{/environment,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a, org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b, org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17, org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,[o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17,[o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3,[o.s.j.s.ServletContextHandler@233d90f8{/environment,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@233d90f8{/environment,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@233d90f8{/environment,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@16f50178 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-76df4781 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-76df4781@ab39c5c9==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-76df4781=org.apache.spark.ui.JettyUtils$$anon$3-76df4781@ab39c5c9==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@16f50178 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7721ms org.spark_project.jetty.servlet.ServletHandler@16f50178 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-76df4781@ab39c5c9==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7721ms org.apache.spark.ui.JettyUtils$$anon$3-76df4781@ab39c5c9==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@36f99250 for org.apache.spark.ui.JettyUtils$$anon$3-76df4781 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@233d90f8{/environment,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7721ms o.s.j.s.ServletContextHandler@233d90f8{/environment,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7721ms org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0 mime types IncludeExclude@6e891ec4{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@5064458,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@7f973dba} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0 added {o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a, org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b, org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17, org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3, org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,[o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0,[o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17,[o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3,[o.s.j.s.ServletContextHandler@233d90f8{/environment,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@2110ece4 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-2d7f5408 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-2d7f5408@d868df54==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-2d7f5408=org.apache.spark.ui.JettyUtils$$anon$3-2d7f5408@d868df54==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@2110ece4 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7723ms org.spark_project.jetty.servlet.ServletHandler@2110ece4 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-2d7f5408@d868df54==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7723ms org.apache.spark.ui.JettyUtils$$anon$3-2d7f5408@d868df54==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@6b551a56 for org.apache.spark.ui.JettyUtils$$anon$3-2d7f5408 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7723ms o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7723ms org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6 mime types IncludeExclude@7a9fefab{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@3ca377af,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@7f675dc7} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6 added {o.s.j.s.ServletContextHandler@5f55f890{/executors,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a, org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b, org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17, org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3, org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0, org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,[o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0,[o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17,[o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3,[o.s.j.s.ServletContextHandler@233d90f8{/environment,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6,[o.s.j.s.ServletContextHandler@5f55f890{/executors,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@5f55f890{/executors,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@5f55f890{/executors,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@55966d4c 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-7c0c1d28 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-7c0c1d28@9ecb3484==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-7c0c1d28=org.apache.spark.ui.JettyUtils$$anon$3-7c0c1d28@9ecb3484==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@55966d4c 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7725ms org.spark_project.jetty.servlet.ServletHandler@55966d4c 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-7c0c1d28@9ecb3484==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7725ms org.apache.spark.ui.JettyUtils$$anon$3-7c0c1d28@9ecb3484==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@50f29e9b for org.apache.spark.ui.JettyUtils$$anon$3-7c0c1d28 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@5f55f890{/executors,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7725ms o.s.j.s.ServletContextHandler@5f55f890{/executors,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7725ms org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199 mime types IncludeExclude@72acca8b{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@3760387c,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@73a26e4d} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199 added {o.s.j.s.ServletContextHandler@2aa97937{/executors/json,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a, org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b, org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17, org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3, org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0, org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6, org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199,[o.s.j.s.ServletContextHandler@2aa97937{/executors/json,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,[o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0,[o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17,[o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3,[o.s.j.s.ServletContextHandler@233d90f8{/environment,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6,[o.s.j.s.ServletContextHandler@5f55f890{/executors,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@2aa97937{/executors/json,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@2aa97937{/executors/json,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@4c339d23 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-504a3cd0 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-504a3cd0@4be32b50==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-504a3cd0=org.apache.spark.ui.JettyUtils$$anon$3-504a3cd0@4be32b50==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@4c339d23 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7727ms org.spark_project.jetty.servlet.ServletHandler@4c339d23 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-504a3cd0@4be32b50==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7727ms org.apache.spark.ui.JettyUtils$$anon$3-504a3cd0@4be32b50==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@840f0a9 for org.apache.spark.ui.JettyUtils$$anon$3-504a3cd0 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@2aa97937{/executors/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7727ms o.s.j.s.ServletContextHandler@2aa97937{/executors/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7727ms org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8 mime types IncludeExclude@2a39f399{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@4a892095,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@454354d5} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8 added {o.s.j.s.ServletContextHandler@7f4b6b94{/executors/threadDump,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a, org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b, org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17, org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3, org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0, org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6, org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199, org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199,[o.s.j.s.ServletContextHandler@2aa97937{/executors/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,[o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0,[o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17,[o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3,[o.s.j.s.ServletContextHandler@233d90f8{/environment,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6,[o.s.j.s.ServletContextHandler@5f55f890{/executors,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/threadDump->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8,[o.s.j.s.ServletContextHandler@7f4b6b94{/executors/threadDump,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@7f4b6b94{/executors/threadDump,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@7f4b6b94{/executors/threadDump,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@7ee66411 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-34a35d10 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-34a35d10@99fc7fad==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-34a35d10=org.apache.spark.ui.JettyUtils$$anon$3-34a35d10@99fc7fad==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@7ee66411 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7728ms org.spark_project.jetty.servlet.ServletHandler@7ee66411 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-34a35d10@99fc7fad==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7728ms org.apache.spark.ui.JettyUtils$$anon$3-34a35d10@99fc7fad==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@3d4af69e for org.apache.spark.ui.JettyUtils$$anon$3-34a35d10 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@7f4b6b94{/executors/threadDump,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7728ms o.s.j.s.ServletContextHandler@7f4b6b94{/executors/threadDump,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7728ms org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95 mime types IncludeExclude@5b847189{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@43e63d0,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@6e2a9bcf} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95 added {o.s.j.s.ServletContextHandler@36792b39{/executors/threadDump/json,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a, org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b, org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17, org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3, org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0, org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6, org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199, org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8, org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199,[o.s.j.s.ServletContextHandler@2aa97937{/executors/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,[o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/threadDump/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95,[o.s.j.s.ServletContextHandler@36792b39{/executors/threadDump/json,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0,[o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17,[o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3,[o.s.j.s.ServletContextHandler@233d90f8{/environment,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6,[o.s.j.s.ServletContextHandler@5f55f890{/executors,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/threadDump->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8,[o.s.j.s.ServletContextHandler@7f4b6b94{/executors/threadDump,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@36792b39{/executors/threadDump/json,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@36792b39{/executors/threadDump/json,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@7b72170b 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-55978ea8 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-55978ea8@5a9d008e==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-55978ea8=org.apache.spark.ui.JettyUtils$$anon$3-55978ea8@5a9d008e==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@7b72170b 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7730ms org.spark_project.jetty.servlet.ServletHandler@7b72170b 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-55978ea8@5a9d008e==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7731ms org.apache.spark.ui.JettyUtils$$anon$3-55978ea8@5a9d008e==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@65d7a748 for org.apache.spark.ui.JettyUtils$$anon$3-55978ea8 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@36792b39{/executors/threadDump/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7731ms o.s.j.s.ServletContextHandler@36792b39{/executors/threadDump/json,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7731ms org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42 mime types IncludeExclude@6a705ac5{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@503e40a7,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@88b500f} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42 added {o.s.j.s.ServletContextHandler@4cfb35d{/static,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a, org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b, org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17, org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3, org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0, org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6, org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199, org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8, org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95, org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: static->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42,[o.s.j.s.ServletContextHandler@4cfb35d{/static,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199,[o.s.j.s.ServletContextHandler@2aa97937{/executors/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,[o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/threadDump/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95,[o.s.j.s.ServletContextHandler@36792b39{/executors/threadDump/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0,[o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17,[o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3,[o.s.j.s.ServletContextHandler@233d90f8{/environment,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6,[o.s.j.s.ServletContextHandler@5f55f890{/executors,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/threadDump->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8,[o.s.j.s.ServletContextHandler@7f4b6b94{/executors/threadDump,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@4cfb35d{/static,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@4cfb35d{/static,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@6d449fa2 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.spark_project.jetty.servlet.DefaultServlet-fd16a32 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.spark_project.jetty.servlet.DefaultServlet-fd16a32@77c3b64e==org.spark_project.jetty.servlet.DefaultServlet,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.spark_project.jetty.servlet.DefaultServlet-fd16a32=org.spark_project.jetty.servlet.DefaultServlet-fd16a32@77c3b64e==org.spark_project.jetty.servlet.DefaultServlet,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@6d449fa2 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7733ms org.spark_project.jetty.servlet.ServletHandler@6d449fa2 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.DefaultServlet-fd16a32@77c3b64e==org.spark_project.jetty.servlet.DefaultServlet,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7733ms org.spark_project.jetty.servlet.DefaultServlet-fd16a32@77c3b64e==org.spark_project.jetty.servlet.DefaultServlet,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.spark_project.jetty.servlet.DefaultServlet@29df2ec6 for org.spark_project.jetty.servlet.DefaultServlet-fd16a32 20/10/30 21:42:55 DEBUG DefaultServlet: resource base = jar:file:/mnt/yarn/usercache/hadoop/filecache/33/__spark_libs__3907077530080990255.zip/spark-core_2.11-2.4.4.jar!/org/apache/spark/ui/static 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@4cfb35d{/static,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7737ms o.s.j.s.ServletContextHandler@4cfb35d{/static,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7737ms org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb mime types IncludeExclude@14ed166c{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@54b665d8,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@6b3fd749} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb added {o.s.j.s.ServletContextHandler@64e060ec{/,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a, org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b, org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17, org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3, org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0, org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6, org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199, org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8, org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95, org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42, org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}, {org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb,[o.s.j.s.ServletContextHandler@64e060ec{/,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: static->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42,[o.s.j.s.ServletContextHandler@4cfb35d{/static,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199,[o.s.j.s.ServletContextHandler@2aa97937{/executors/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,[o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/threadDump/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95,[o.s.j.s.ServletContextHandler@36792b39{/executors/threadDump/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0,[o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17,[o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3,[o.s.j.s.ServletContextHandler@233d90f8{/environment,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6,[o.s.j.s.ServletContextHandler@5f55f890{/executors,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/threadDump->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8,[o.s.j.s.ServletContextHandler@7f4b6b94{/executors/threadDump,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@64e060ec{/,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@64e060ec{/,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@180da3d0 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$4-314f3f3e from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$4-314f3f3e@a596f900==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$4-314f3f3e=org.apache.spark.ui.JettyUtils$$anon$4-314f3f3e@a596f900==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@180da3d0 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7739ms org.spark_project.jetty.servlet.ServletHandler@180da3d0 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$4-314f3f3e@a596f900==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7739ms org.apache.spark.ui.JettyUtils$$anon$4-314f3f3e@a596f900==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$4@75423b67 for org.apache.spark.ui.JettyUtils$$anon$4-314f3f3e 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@64e060ec{/,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7740ms o.s.j.s.ServletContextHandler@64e060ec{/,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7740ms org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@9600dd5 mime types IncludeExclude@6e9f2184{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@7b0f2681,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@1f72a384} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@9600dd5 added {o.s.j.s.ServletContextHandler@2b421410{/api,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a, org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b, org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17, org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3, org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0, org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6, org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199, org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8, org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95, org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42, org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb, org.spark_project.jetty.server.handler.gzip.GzipHandler@9600dd5] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@9600dd5,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}, {org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb,[o.s.j.s.ServletContextHandler@64e060ec{/,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: static->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42,[o.s.j.s.ServletContextHandler@4cfb35d{/static,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199,[o.s.j.s.ServletContextHandler@2aa97937{/executors/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,[o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/threadDump/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95,[o.s.j.s.ServletContextHandler@36792b39{/executors/threadDump/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0,[o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17,[o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3,[o.s.j.s.ServletContextHandler@233d90f8{/environment,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6,[o.s.j.s.ServletContextHandler@5f55f890{/executors,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: api->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@9600dd5,[o.s.j.s.ServletContextHandler@2b421410{/api,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/threadDump->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8,[o.s.j.s.ServletContextHandler@7f4b6b94{/executors/threadDump,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@9600dd5 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@9600dd5 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@2b421410{/api,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@2b421410{/api,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@fef7af3 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/* mapped to servlet=org.glassfish.jersey.servlet.ServletContainer-1e3b9153 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/*=org.glassfish.jersey.servlet.ServletContainer-1e3b9153@f67052a7==org.glassfish.jersey.servlet.ServletContainer,jsp=null,order=-1,inst=false} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.glassfish.jersey.servlet.ServletContainer-1e3b9153=org.glassfish.jersey.servlet.ServletContainer-1e3b9153@f67052a7==org.glassfish.jersey.servlet.ServletContainer,jsp=null,order=-1,inst=false} 20/10/30 21:42:55 DEBUG ServletHandler: Adding Default404Servlet to org.spark_project.jetty.servlet.ServletHandler@fef7af3 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@fef7af3 added {org.spark_project.jetty.servlet.ServletHandler$Default404Servlet-3c88ec0@9dd870be==org.spark_project.jetty.servlet.ServletHandler$Default404Servlet,jsp=null,order=-1,inst=false,AUTO} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@fef7af3 added {[/]=>org.spark_project.jetty.servlet.ServletHandler$Default404Servlet-3c88ec0,POJO} 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/* mapped to servlet=org.glassfish.jersey.servlet.ServletContainer-1e3b9153 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.spark_project.jetty.servlet.ServletHandler$Default404Servlet-3c88ec0 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/*=org.glassfish.jersey.servlet.ServletContainer-1e3b9153@f67052a7==org.glassfish.jersey.servlet.ServletContainer,jsp=null,order=-1,inst=false, /=org.spark_project.jetty.servlet.ServletHandler$Default404Servlet-3c88ec0@9dd870be==org.spark_project.jetty.servlet.ServletHandler$Default404Servlet,jsp=null,order=-1,inst=false} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.spark_project.jetty.servlet.ServletHandler$Default404Servlet-3c88ec0=org.spark_project.jetty.servlet.ServletHandler$Default404Servlet-3c88ec0@9dd870be==org.spark_project.jetty.servlet.ServletHandler$Default404Servlet,jsp=null,order=-1,inst=false, org.glassfish.jersey.servlet.ServletContainer-1e3b9153=org.glassfish.jersey.servlet.ServletContainer-1e3b9153@f67052a7==org.glassfish.jersey.servlet.ServletContainer,jsp=null,order=-1,inst=false} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@fef7af3 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7743ms org.spark_project.jetty.servlet.ServletHandler@fef7af3 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.glassfish.jersey.servlet.ServletContainer-1e3b9153@f67052a7==org.glassfish.jersey.servlet.ServletContainer,jsp=null,order=-1,inst=false 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7743ms org.glassfish.jersey.servlet.ServletContainer-1e3b9153@f67052a7==org.glassfish.jersey.servlet.ServletContainer,jsp=null,order=-1,inst=false 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler$Default404Servlet-3c88ec0@9dd870be==org.spark_project.jetty.servlet.ServletHandler$Default404Servlet,jsp=null,order=-1,inst=false 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7743ms org.spark_project.jetty.servlet.ServletHandler$Default404Servlet-3c88ec0@9dd870be==org.spark_project.jetty.servlet.ServletHandler$Default404Servlet,jsp=null,order=-1,inst=false 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@2b421410{/api,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7743ms o.s.j.s.ServletContextHandler@2b421410{/api,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7743ms org.spark_project.jetty.server.handler.gzip.GzipHandler@9600dd5 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@92c63be mime types IncludeExclude@37bf045a{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@3a99ba6f,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@7d609d72} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@92c63be added {o.s.j.s.ServletContextHandler@13518374{/jobs/job/kill,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a, org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b, org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17, org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3, org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0, org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6, org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199, org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8, org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95, org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42, org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb, org.spark_project.jetty.server.handler.gzip.GzipHandler@9600dd5, org.spark_project.jetty.server.handler.gzip.GzipHandler@92c63be] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@92c63be,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}, {org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb,[o.s.j.s.ServletContextHandler@64e060ec{/,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: static->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42,[o.s.j.s.ServletContextHandler@4cfb35d{/static,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199,[o.s.j.s.ServletContextHandler@2aa97937{/executors/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,[o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/threadDump/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95,[o.s.j.s.ServletContextHandler@36792b39{/executors/threadDump/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0,[o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17,[o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3,[o.s.j.s.ServletContextHandler@233d90f8{/environment,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6,[o.s.j.s.ServletContextHandler@5f55f890{/executors,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: api->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@9600dd5,[o.s.j.s.ServletContextHandler@2b421410{/api,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/kill->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@92c63be,[o.s.j.s.ServletContextHandler@13518374{/jobs/job/kill,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/threadDump->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8,[o.s.j.s.ServletContextHandler@7f4b6b94{/executors/threadDump,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@92c63be 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@92c63be 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@13518374{/jobs/job/kill,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@13518374{/jobs/job/kill,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@4d8a4237 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$4-4c50531e from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$4-4c50531e@612bc507==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$4-4c50531e=org.apache.spark.ui.JettyUtils$$anon$4-4c50531e@612bc507==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@4d8a4237 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7744ms org.spark_project.jetty.servlet.ServletHandler@4d8a4237 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$4-4c50531e@612bc507==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7745ms org.apache.spark.ui.JettyUtils$$anon$4-4c50531e@612bc507==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$4@17bb20f3 for org.apache.spark.ui.JettyUtils$$anon$4-4c50531e 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@13518374{/jobs/job/kill,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7745ms o.s.j.s.ServletContextHandler@13518374{/jobs/job/kill,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7745ms org.spark_project.jetty.server.handler.gzip.GzipHandler@92c63be 20/10/30 21:42:55 DEBUG GzipHandler: org.spark_project.jetty.server.handler.gzip.GzipHandler@58696b8a mime types IncludeExclude@2f54e82a{i=[],ip=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@56266bbf,e=[image/ief, image/vnd.wap.wbmp, image/jpeg, application/bzip2, image/x-portable-graymap, image/bmp, image/gif, image/x-icon, audio/midi, video/x-msvideo, image/x-xbitmap, application/x-rar-compressed, image/x-portable-bitmap, image/x-rgb, image/x-cmu-raster, application/gzip, audio/x-wav, audio/basic, audio/x-pn-realaudio, application/compress, audio/x-aiff, video/x.ms.asx, video/x.ms.asf, image/png, video/vnd.rn-realvideo, image/x-xwindowdump, image/jpeg2000, video/x-sgi-movie, audio/mpeg, image/xcf, video/mpeg, image/x-portable-pixmap, image/tiff, image/x-portable-anymap, image/x-xpixmap, application/zip, video/quicktime],ep=org.spark_project.jetty.util.IncludeExcludeSet$SetContainsPredicate@18547530} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.gzip.GzipHandler@58696b8a added {o.s.j.s.ServletContextHandler@49ff7615{/stages/stage/kill,null,null,@Spark},MANAGED} 20/10/30 21:42:55 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a, org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b, org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17, org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3, org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0, org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6, org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199, org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8, org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95, org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42, org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb, org.spark_project.jetty.server.handler.gzip.GzipHandler@9600dd5, org.spark_project.jetty.server.handler.gzip.GzipHandler@92c63be, org.spark_project.jetty.server.handler.gzip.GzipHandler@58696b8a] added {org.spark_project.jetty.server.handler.gzip.GzipHandler@58696b8a,UNMANAGED} 20/10/30 21:42:55 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}, {org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb,[o.s.j.s.ServletContextHandler@64e060ec{/,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,[o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/rdd/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17,[o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: api->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@9600dd5,[o.s.j.s.ServletContextHandler@2b421410{/api,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: static->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42,[o.s.j.s.ServletContextHandler@4cfb35d{/static,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199,[o.s.j.s.ServletContextHandler@2aa97937{/executors/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/threadDump/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95,[o.s.j.s.ServletContextHandler@36792b39{/executors/threadDump/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0,[o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages/stage/kill->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@58696b8a,[o.s.j.s.ServletContextHandler@49ff7615{/stages/stage/kill,null,null,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: environment->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3,[o.s.j.s.ServletContextHandler@233d90f8{/environment,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6,[o.s.j.s.ServletContextHandler@5f55f890{/executors,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: jobs/job/kill->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@92c63be,[o.s.j.s.ServletContextHandler@13518374{/jobs/job/kill,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG ContextHandlerCollection: executors/threadDump->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8,[o.s.j.s.ServletContextHandler@7f4b6b94{/executors/threadDump,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@58696b8a 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.server.handler.gzip.GzipHandler@58696b8a 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@49ff7615{/stages/stage/kill,null,null,@Spark} 20/10/30 21:42:55 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@49ff7615{/stages/stage/kill,null,STARTING,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@e215833 20/10/30 21:42:55 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$4-7dd39fb5 from default=false 20/10/30 21:42:55 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27} 20/10/30 21:42:55 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-2cacae27] 20/10/30 21:42:55 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:55 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$4-7dd39fb5@1e162947==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$4-7dd39fb5=org.apache.spark.ui.JettyUtils$$anon$4-7dd39fb5@1e162947==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true} 20/10/30 21:42:55 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@e215833 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7746ms org.spark_project.jetty.servlet.ServletHandler@e215833 20/10/30 21:42:55 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$4-7dd39fb5@1e162947==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7746ms org.apache.spark.ui.JettyUtils$$anon$4-7dd39fb5@1e162947==org.apache.spark.ui.JettyUtils$$anon$4,jsp=null,order=-1,inst=true 20/10/30 21:42:55 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$4@b72788b for org.apache.spark.ui.JettyUtils$$anon$4-7dd39fb5 20/10/30 21:42:55 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@49ff7615{/stages/stage/kill,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7746ms o.s.j.s.ServletContextHandler@49ff7615{/stages/stage/kill,null,AVAILABLE,@Spark} 20/10/30 21:42:55 DEBUG AbstractLifeCycle: STARTED @7746ms org.spark_project.jetty.server.handler.gzip.GzipHandler@58696b8a 20/10/30 21:42:55 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://ip-10-85-100-91.vpc.internal:42481 20/10/30 21:42:55 INFO YarnClusterScheduler: Created YarnClusterScheduler 20/10/30 21:42:55 INFO SchedulerExtensionServices: Starting Yarn extension services with app application_1604078122294_0004 and attemptId Some(appattempt_1604078122294_0004_000001) 20/10/30 21:42:55 INFO Utils: Using initial executors = 0, max of spark.dynamicAllocation.initialExecutors, spark.dynamicAllocation.minExecutors and spark.executor.instances 20/10/30 21:42:55 DEBUG TransportServer: Shuffle server started on port: 34063 20/10/30 21:42:55 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 34063. 20/10/30 21:42:55 INFO NettyBlockTransferService: Server created on ip-10-85-100-91.vpc.internal:34063 20/10/30 21:42:55 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/10/30 21:42:55 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, ip-10-85-100-91.vpc.internal, 34063, None) 20/10/30 21:42:55 DEBUG DefaultTopologyMapper: Got a request for ip-10-85-100-91.vpc.internal 20/10/30 21:42:55 INFO BlockManagerMasterEndpoint: Registering block manager ip-10-85-100-91.vpc.internal:34063 with 2.2 GB RAM, BlockManagerId(driver, ip-10-85-100-91.vpc.internal, 34063, None) 20/10/30 21:42:55 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, ip-10-85-100-91.vpc.internal, 34063, None) 20/10/30 21:42:55 INFO BlockManager: external shuffle service port = 7337 20/10/30 21:42:55 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, ip-10-85-100-91.vpc.internal, 34063, None) 20/10/30 21:42:56 INFO StatsdSink: StatsdSink started with prefix: 'spark' 20/10/30 21:42:56 DEBUG DecoratedObjectFactory: Adding Decorator: org.spark_project.jetty.util.DeprecationWarning@13757179 20/10/30 21:42:56 DEBUG ContainerLifeCycle: o.s.j.s.ServletContextHandler@684ae992{/,null,null} added {org.spark_project.jetty.servlet.ServletHandler@5148143c,MANAGED} 20/10/30 21:42:56 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@5148143c added {org.apache.spark.ui.JettyUtils$$anon$3-4dce00b@49e8c6a4==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true,AUTO} 20/10/30 21:42:56 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@5148143c added {[/]=>org.apache.spark.ui.JettyUtils$$anon$3-4dce00b,POJO} 20/10/30 21:42:56 INFO JettyUtils: Adding filter org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter to /metrics/json. 20/10/30 21:42:56 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@5148143c added {org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-49e9c65e,AUTO} 20/10/30 21:42:56 DEBUG ContainerLifeCycle: org.spark_project.jetty.servlet.ServletHandler@5148143c added {[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-49e9c65e,POJO} 20/10/30 21:42:56 DEBUG ContainerLifeCycle: org.spark_project.jetty.server.handler.ContextHandlerCollection@6b97c465[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}, org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d, org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887, org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070, org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba, org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0, org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3, org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a, org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692, org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146, org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727, org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487, org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a, org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b, org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17, org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3, org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0, org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6, org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199, org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8, org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95, org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42, org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb, org.spark_project.jetty.server.handler.gzip.GzipHandler@9600dd5, org.spark_project.jetty.server.handler.gzip.GzipHandler@92c63be, org.spark_project.jetty.server.handler.gzip.GzipHandler@58696b8a, o.s.j.s.ServletContextHandler@684ae992{/metrics/json,null,null,@Spark}] added {o.s.j.s.ServletContextHandler@684ae992{/metrics/json,null,null,@Spark},UNMANAGED} 20/10/30 21:42:56 DEBUG ContextHandlerCollection: ->[{o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect},[o.s.j.s.h.ContextHandler@78eafb12{/,null,AVAILABLE,@HttpsRedirect}]}, {org.spark_project.jetty.server.handler.gzip.GzipHandler@34354adb,[o.s.j.s.ServletContextHandler@64e060ec{/,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: storage/rdd->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@55108d2b,[o.s.j.s.ServletContextHandler@5a592fa8{/storage/rdd,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: storage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@2d96f487,[o.s.j.s.ServletContextHandler@4a247b65{/storage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: storage/rdd/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3e2b0d17,[o.s.j.s.ServletContextHandler@60ded57e{/storage/rdd/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: api->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@9600dd5,[o.s.j.s.ServletContextHandler@2b421410{/api,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: stages/pool/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@7651b727,[o.s.j.s.ServletContextHandler@4381141f{/stages/pool/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: stages/pool->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6b788146,[o.s.j.s.ServletContextHandler@31210260{/stages/pool,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: jobs/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@3c96887,[o.s.j.s.ServletContextHandler@5b8d04fa{/jobs/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: static->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1da78a42,[o.s.j.s.ServletContextHandler@4cfb35d{/static,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: executors/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5595c199,[o.s.j.s.ServletContextHandler@2aa97937{/executors/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: stages/stage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4fa1f692,[o.s.j.s.ServletContextHandler@cf012b5{/stages/stage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: executors/threadDump/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@580a7f95,[o.s.j.s.ServletContextHandler@36792b39{/executors/threadDump/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: environment/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1fa16ef0,[o.s.j.s.ServletContextHandler@1fd0c0a7{/environment/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: jobs/job/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4cdc8ba,[o.s.j.s.ServletContextHandler@440ed979{/jobs/job/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: jobs->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@51c58f4d,[o.s.j.s.ServletContextHandler@762ebcec{/jobs,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: stages/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@5ee4f3f3,[o.s.j.s.ServletContextHandler@632c0144{/stages/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: stages/stage->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@445c6a8a,[o.s.j.s.ServletContextHandler@57ad4da7{/stages/stage,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: storage/json->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@12f1077a,[o.s.j.s.ServletContextHandler@77c8f7b8{/storage/json,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: stages/stage/kill->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@58696b8a,[o.s.j.s.ServletContextHandler@49ff7615{/stages/stage/kill,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: jobs/job->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@6a5db070,[o.s.j.s.ServletContextHandler@1ce06ebe{/jobs/job,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: environment->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@10f6fae3,[o.s.j.s.ServletContextHandler@233d90f8{/environment,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: stages->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@48fc6ac0,[o.s.j.s.ServletContextHandler@1c606781{/stages,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: executors->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@4d8c46c6,[o.s.j.s.ServletContextHandler@5f55f890{/executors,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: jobs/job/kill->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@92c63be,[o.s.j.s.ServletContextHandler@13518374{/jobs/job/kill,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: metrics/json->[{o.s.j.s.ServletContextHandler@684ae992{/metrics/json,null,null,@Spark},[o.s.j.s.ServletContextHandler@684ae992{/metrics/json,null,null,@Spark}]}] 20/10/30 21:42:56 DEBUG ContextHandlerCollection: executors/threadDump->[{org.spark_project.jetty.server.handler.gzip.GzipHandler@1c2c9bb8,[o.s.j.s.ServletContextHandler@7f4b6b94{/executors/threadDump,null,AVAILABLE,@Spark}]}] 20/10/30 21:42:56 DEBUG AbstractLifeCycle: starting o.s.j.s.ServletContextHandler@684ae992{/metrics/json,null,null,@Spark} 20/10/30 21:42:56 DEBUG AbstractHandler: starting o.s.j.s.ServletContextHandler@684ae992{/metrics/json,null,STARTING,@Spark} 20/10/30 21:42:56 DEBUG AbstractLifeCycle: starting org.spark_project.jetty.servlet.ServletHandler@5148143c 20/10/30 21:42:56 DEBUG ServletHandler: Chose path=/ mapped to servlet=org.apache.spark.ui.JettyUtils$$anon$3-4dce00b from default=false 20/10/30 21:42:56 DEBUG ServletHandler: filterNameMap={org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-49e9c65e=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-49e9c65e} 20/10/30 21:42:56 DEBUG ServletHandler: pathFilters=[[/*]/[]==31=>org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-49e9c65e] 20/10/30 21:42:56 DEBUG ServletHandler: servletFilterMap={} 20/10/30 21:42:56 DEBUG ServletHandler: servletPathMap={/=org.apache.spark.ui.JettyUtils$$anon$3-4dce00b@49e8c6a4==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:56 DEBUG ServletHandler: servletNameMap={org.apache.spark.ui.JettyUtils$$anon$3-4dce00b=org.apache.spark.ui.JettyUtils$$anon$3-4dce00b@49e8c6a4==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true} 20/10/30 21:42:56 DEBUG AbstractHandler: starting org.spark_project.jetty.servlet.ServletHandler@5148143c 20/10/30 21:42:56 DEBUG AbstractLifeCycle: STARTED @8277ms org.spark_project.jetty.servlet.ServletHandler@5148143c 20/10/30 21:42:56 DEBUG AbstractLifeCycle: starting org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-49e9c65e 20/10/30 21:42:56 DEBUG BaseHolder: Holding class org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter from sun.misc.Launcher$AppClassLoader@4157f54e 20/10/30 21:42:56 DEBUG AbstractLifeCycle: STARTED @8277ms org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter-49e9c65e 20/10/30 21:42:56 DEBUG FilterHolder: Filter.init org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter@1d7acc5b 20/10/30 21:42:56 DEBUG AbstractLifeCycle: starting org.apache.spark.ui.JettyUtils$$anon$3-4dce00b@49e8c6a4==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:56 DEBUG AbstractLifeCycle: STARTED @8277ms org.apache.spark.ui.JettyUtils$$anon$3-4dce00b@49e8c6a4==org.apache.spark.ui.JettyUtils$$anon$3,jsp=null,order=-1,inst=true 20/10/30 21:42:56 DEBUG ServletHolder: Servlet.init org.apache.spark.ui.JettyUtils$$anon$3@6c4f8e56 for org.apache.spark.ui.JettyUtils$$anon$3-4dce00b 20/10/30 21:42:56 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@684ae992{/metrics/json,null,AVAILABLE,@Spark} 20/10/30 21:42:56 DEBUG AbstractLifeCycle: STARTED @8278ms o.s.j.s.ServletContextHandler@684ae992{/metrics/json,null,AVAILABLE,@Spark} 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop sending #1 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop got value #1 20/10/30 21:42:56 DEBUG ProtobufRpcEngine: Call: getFileInfo took 2ms 20/10/30 21:42:56 DEBUG DFSClient: /var/log/spark/apps/application_1604078122294_0004_1.inprogress: masked=rw-r--r-- 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop sending #2 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop got value #2 20/10/30 21:42:56 DEBUG ProtobufRpcEngine: Call: create took 2ms 20/10/30 21:42:56 DEBUG DFSClient: computePacketChunkSize: src=/var/log/spark/apps/application_1604078122294_0004_1.inprogress, chunkSize=516, chunksPerPacket=126, packetSize=65016 20/10/30 21:42:56 DEBUG LeaseRenewer: Lease renewer daemon for [DFSClient_NONMAPREDUCE_1707004368_1] with renew id 1 started 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop sending #3 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop got value #3 20/10/30 21:42:56 DEBUG ProtobufRpcEngine: Call: setPermission took 2ms 20/10/30 21:42:56 INFO EventLoggingListener: Logging events to hdfs:/var/log/spark/apps/application_1604078122294_0004_1 20/10/30 21:42:56 INFO Utils: Using initial executors = 0, max of spark.dynamicAllocation.initialExecutors, spark.dynamicAllocation.minExecutors and spark.executor.instances 20/10/30 21:42:56 WARN YarnSchedulerBackend$YarnSchedulerEndpoint: Attempted to request executors before the AM has registered! 20/10/30 21:42:56 DEBUG DFSClient: DFSClient writeChunk allocating new packet seqno=0, src=/var/log/spark/apps/application_1604078122294_0004_1.inprogress, packetSize=65016, chunksPerPacket=126, bytesCurBlock=0 20/10/30 21:42:56 DEBUG DFSClient: DFSClient flush(): bytesCurBlock=312 lastFlushOffset=0 createNewBlock=false 20/10/30 21:42:56 DEBUG DFSClient: Queued packet 0 20/10/30 21:42:56 DEBUG DFSClient: Waiting for ack for: 0 20/10/30 21:42:56 DEBUG DFSClient: Allocating new block 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop sending #4 20/10/30 21:42:56 DEBUG YarnClusterSchedulerBackend: Base URL for logs: http://ip-10-85-100-91.vpc.internal:8042/node/containerlogs/container_1604078122294_0004_01_000001/hadoop 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop got value #4 20/10/30 21:42:56 DEBUG ProtobufRpcEngine: Call: addBlock took 3ms 20/10/30 21:42:56 DEBUG SparkHadoopUtil: ip-10-85-100-167.vpc.internal:18080 didn't match (\$\{hadoopconf-[^\}\$\s]+\}) 20/10/30 21:42:56 DEBUG AbstractService: Service: org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl entered state INITED 20/10/30 21:42:56 DEBUG DFSClient: pipeline = DatanodeInfoWithStorage[10.85.100.91:50010,DS-8ff5d078-5d3e-4538-b5c4-593644ce9111,DISK] 20/10/30 21:42:56 DEBUG DFSClient: Connecting to datanode 10.85.100.91:50010 20/10/30 21:42:56 DEBUG DFSClient: Send buf size 131072 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop sending #5 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop got value #5 20/10/30 21:42:56 DEBUG ProtobufRpcEngine: Call: getServerDefaults took 1ms 20/10/30 21:42:56 DEBUG DFSClient: Getting new encryption token from NN 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop sending #6 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop got value #6 20/10/30 21:42:56 DEBUG ProtobufRpcEngine: Call: getDataEncryptionKey took 0ms 20/10/30 21:42:56 DEBUG SaslDataTransferClient: SASL client doing encrypted handshake for addr = /10.85.100.91, datanodeId = DatanodeInfoWithStorage[10.85.100.91:50010,DS-8ff5d078-5d3e-4538-b5c4-593644ce9111,DISK] 20/10/30 21:42:56 DEBUG SaslDataTransferClient: Client using encryption algorithm null 20/10/30 21:42:56 INFO RMProxy: Connecting to ResourceManager at ip-10-85-100-167.vpc.internal/10.85.100.167:8030 20/10/30 21:42:56 DEBUG UserGroupInformation: PrivilegedAction as:hadoop (auth:SIMPLE) from:org.apache.hadoop.yarn.client.RMProxy.getProxy(RMProxy.java:136) 20/10/30 21:42:56 DEBUG YarnRPC: Creating YarnRPC for org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC 20/10/30 21:42:56 DEBUG HadoopYarnProtoRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.yarn.api.ApplicationMasterProtocol 20/10/30 21:42:56 DEBUG Client: getting client out of cache: org.apache.hadoop.ipc.Client@35d6ca49 20/10/30 21:42:56 DEBUG AbstractService: Service org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl is started 20/10/30 21:42:56 INFO YarnRMClient: Registering the ApplicationMaster 20/10/30 21:42:56 DEBUG DataTransferSaslUtil: Verifying QOP, requested QOP = [auth-conf], negotiated QOP = auth-conf 20/10/30 21:42:56 DEBUG DataTransferSaslUtil: Creating IOStreamPair of CryptoInputStream and CryptoOutputStream. 20/10/30 21:42:56 DEBUG Client: The ping interval is 60000 ms. 20/10/30 21:42:56 DEBUG Client: Connecting to ip-10-85-100-167.vpc.internal/10.85.100.167:8030 20/10/30 21:42:56 DEBUG UserGroupInformation: PrivilegedAction as:hadoop (auth:SIMPLE) from:org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:725) 20/10/30 21:42:56 DEBUG SaslRpcClient: Sending sasl message state: NEGOTIATE 20/10/30 21:42:56 DEBUG SaslRpcClient: Received SASL message state: NEGOTIATE auths { method: "TOKEN" mechanism: "DIGEST-MD5" protocol: "" serverId: "default" challenge: "realm=\"default\",nonce=\"QnHOddDapmBk66NOWxVYDp+TpXqmk0PcefZ82IkV\",qop=\"auth-conf\",charset=utf-8,cipher=\"3des,rc4,des,rc4-56,rc4-40\",algorithm=md5-sess" } 20/10/30 21:42:56 DEBUG PerformanceAdvisory: Using crypto codec org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec. 20/10/30 21:42:56 DEBUG SaslRpcClient: Get token info proto:interface org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB info:org.apache.hadoop.yarn.security.SchedulerSecurityInfo$1@26e412ef 20/10/30 21:42:56 DEBUG AMRMTokenSelector: Looking for a token with service 10.85.100.167:8030 20/10/30 21:42:56 DEBUG AMRMTokenSelector: Token kind is YARN_AM_RM_TOKEN and the token's service name is 10.85.100.167:8030 20/10/30 21:42:56 DEBUG SaslRpcClient: Creating SASL DIGEST-MD5(TOKEN) client to authenticate to service at default 20/10/30 21:42:56 DEBUG SaslRpcClient: Use TOKEN authentication for protocol ApplicationMasterProtocolPB 20/10/30 21:42:56 DEBUG SaslRpcClient: SASL client callback: setting username: Cg0KCQgEELbqhtTXLhABEM+QhIAB 20/10/30 21:42:56 DEBUG SaslRpcClient: SASL client callback: setting userPassword 20/10/30 21:42:56 DEBUG SaslRpcClient: SASL client callback: setting realm: default 20/10/30 21:42:56 DEBUG SaslRpcClient: Sending sasl message state: INITIATE token: "charset=utf-8,username=\"Cg0KCQgEELbqhtTXLhABEM+QhIAB\",realm=\"default\",nonce=\"QnHOddDapmBk66NOWxVYDp+TpXqmk0PcefZ82IkV\",nc=00000001,cnonce=\"RSM2MDmFdTPJXZ95iO91wjONmPi+/aP4yUaVJIKk\",digest-uri=\"/default\",maxbuf=65536,response=8f32de3009b7c1ac44258d49539b0d29,qop=auth-conf,cipher=\"3des\"" auths { method: "TOKEN" mechanism: "DIGEST-MD5" protocol: "" serverId: "default" } 20/10/30 21:42:56 DEBUG SaslRpcClient: Received SASL message state: SUCCESS token: "rspauth=5e46255578420ebda5177479d901f4a1" 20/10/30 21:42:56 DEBUG Client: Negotiated QOP is :auth-conf 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8030 from hadoop: starting, having connections 2 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8030 from hadoop sending #7 20/10/30 21:42:56 DEBUG SaslRpcClient: reading next wrapped RPC packet 20/10/30 21:42:56 DEBUG SaslRpcClient: wrapping token of length:285 20/10/30 21:42:56 DEBUG SaslRpcClient: unwrapping token of length:110 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8030 from hadoop got value #7 20/10/30 21:42:56 DEBUG ProtobufRpcEngine: Call: registerApplicationMaster took 29ms 20/10/30 21:42:56 DEBUG YarnRPC: Creating YarnRPC for org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC 20/10/30 21:42:56 INFO ApplicationMaster: =============================================================================== YARN executor launch context: env: CLASSPATH -> /usr/lib/hadoop-lzo/lib/*:/usr/lib/hadoop/hadoop-aws.jar:/usr/share/aws/aws-java-sdk/*:/usr/share/aws/emr/emrfs/conf:/usr/share/aws/emr/emrfs/lib/*:/usr/share/aws/emr/emrfs/auxlib/*:/usr/share/aws/emr/goodies/lib/emr-spark-goodies.jar:/usr/share/aws/emr/security/conf:/usr/share/aws/emr/security/lib/*:/usr/share/aws/hmclient/lib/aws-glue-datacatalog-spark-client.jar:/usr/share/java/Hive-JSON-Serde/hive-openx-serde.jar:/usr/share/aws/sagemaker-spark-sdk/lib/sagemaker-spark-sdk.jar:/usr/share/aws/emr/s3select/lib/emr-s3-select-spark-connector.jar{{PWD}}{{PWD}}/__spark_conf__{{PWD}}/__spark_libs__/*$HADOOP_CONF_DIR$HADOOP_COMMON_HOME/*$HADOOP_COMMON_HOME/lib/*$HADOOP_HDFS_HOME/*$HADOOP_HDFS_HOME/lib/*$HADOOP_MAPRED_HOME/*$HADOOP_MAPRED_HOME/lib/*$HADOOP_YARN_HOME/*$HADOOP_YARN_HOME/lib/*/usr/lib/hadoop-lzo/lib/*/usr/share/aws/emr/emrfs/conf/usr/share/aws/emr/emrfs/lib/*/usr/share/aws/emr/emrfs/auxlib/*/usr/share/aws/emr/lib/*/usr/share/aws/emr/ddb/lib/emr-ddb-hadoop.jar/usr/share/aws/emr/goodies/lib/emr-hadoop-goodies.jar/usr/share/aws/emr/kinesis/lib/emr-kinesis-hadoop.jar/usr/share/aws/emr/cloudwatch-sink/lib/*/usr/share/aws/aws-java-sdk/*$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*/usr/lib/hadoop-lzo/lib/*/usr/share/aws/emr/emrfs/conf/usr/share/aws/emr/emrfs/lib/*/usr/share/aws/emr/emrfs/auxlib/*/usr/share/aws/emr/lib/*/usr/share/aws/emr/ddb/lib/emr-ddb-hadoop.jar/usr/share/aws/emr/goodies/lib/emr-hadoop-goodies.jar/usr/share/aws/emr/kinesis/lib/emr-kinesis-hadoop.jar/usr/share/aws/emr/cloudwatch-sink/lib/*/usr/share/aws/aws-java-sdk/*{{PWD}}/__spark_conf__/__hadoop_conf__ SPARK_YARN_STAGING_DIR -> hdfs://ip-10-85-100-167.vpc.internal:8020/user/hadoop/.sparkStaging/application_1604078122294_0004 SPARK_USER -> hadoop PYTHONPATH -> {{PWD}}/pyspark.zip{{PWD}}/py4j-0.10.7-src.zip{{PWD}}/pyspark.zip{{PWD}}/py4j-0.10.7-src.zip SPARK_PUBLIC_DNS -> ip-10-85-100-91.vpc.internal command: LD_LIBRARY_PATH=\"/usr/lib/hadoop/lib/native:/usr/lib/hadoop-lzo/lib/native:$LD_LIBRARY_PATH\" \ {{JAVA_HOME}}/bin/java \ -server \ -Xmx9486m \ '-verbose:gc' \ '-XX:+PrintGCDetails' \ '-XX:+PrintGCDateStamps' \ '-XX:+UseConcMarkSweepGC' \ '-XX:CMSInitiatingOccupancyFraction=70' \ '-XX:MaxHeapFreeRatio=70' \ '-XX:+CMSClassUnloadingEnabled' \ '-XX:OnOutOfMemoryError=kill -9 %p' \ -Djava.io.tmpdir={{PWD}}/tmp \ '-Dspark.network.crypto.keyLength=256' \ '-Dspark.network.crypto.enabled=true' \ '-Dspark.network.crypto.keyFactoryAlgorithm=PBKDF2WithHmacSHA256' \ '-Dspark.authenticate=true' \ '-Dspark.network.crypto.saslFallback=true' \ '-Dspark.driver.port=39989' \ '-Dspark.history.ui.port=18080' \ '-Dspark.ui.port=0' \ -Dspark.yarn.app.container.log.dir= \ org.apache.spark.executor.CoarseGrainedExecutorBackend \ --driver-url \ spark://CoarseGrainedScheduler@ip-10-85-100-91.vpc.internal:39989 \ --executor-id \ \ --hostname \ \ --cores \ 4 \ --app-id \ application_1604078122294_0004 \ --user-class-path \ file:$PWD/__app__.jar \ --user-class-path \ file:$PWD/livy-api-0.7.0-incubating.jar \ --user-class-path \ file:$PWD/livy-rsc-0.7.0-incubating.jar \ --user-class-path \ file:$PWD/livy-thriftserver-session-0.7.0-incubating.jar \ --user-class-path \ file:$PWD/netty-all-4.0.37.Final.jar \ --user-class-path \ file:$PWD/commons-codec-1.9.jar \ --user-class-path \ file:$PWD/livy-core_2.11-0.7.0-incubating.jar \ --user-class-path \ file:$PWD/livy-repl_2.11-0.7.0-incubating.jar \ --user-class-path \ file:$PWD/datanucleus-api-jdo-3.2.6.jar \ --user-class-path \ file:$PWD/datanucleus-core-3.2.10.jar \ --user-class-path \ file:$PWD/datanucleus-rdbms-3.2.9.jar \ 1>/stdout \ 2>/stderr resources: livy-thriftserver-session-0.7.0-incubating.jar -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/livy-thriftserver-session-0.7.0-incubating.jar" } size: 42040 timestamp: 1604094161946 type: FILE visibility: PRIVATE datanucleus-rdbms-3.2.9.jar -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/datanucleus-rdbms-3.2.9.jar" } size: 1809447 timestamp: 1604094162533 type: FILE visibility: PRIVATE livy-api-0.7.0-incubating.jar -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/livy-api-0.7.0-incubating.jar" } size: 14161 timestamp: 1604094161822 type: FILE visibility: PRIVATE livy-rsc-0.7.0-incubating.jar -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/livy-rsc-0.7.0-incubating.jar" } size: 499087 timestamp: 1604094161911 type: FILE visibility: PRIVATE netty-all-4.0.37.Final.jar -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/netty-all-4.0.37.Final.jar" } size: 2204062 timestamp: 1604094162044 type: FILE visibility: PRIVATE datanucleus-api-jdo-3.2.6.jar -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/datanucleus-api-jdo-3.2.6.jar" } size: 339666 timestamp: 1604094162328 type: FILE visibility: PRIVATE datanucleus-core-3.2.10.jar -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/datanucleus-core-3.2.10.jar" } size: 1890075 timestamp: 1604094162442 type: FILE visibility: PRIVATE __spark_conf__ -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/__spark_conf__.zip" } size: 291457 timestamp: 1604094163136 type: ARCHIVE visibility: PRIVATE sparkr -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/sparkr.zip" } size: 1623235 timestamp: 1604094162637 type: ARCHIVE visibility: PRIVATE commons-codec-1.9.jar -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/commons-codec-1.9.jar" } size: 263965 timestamp: 1604094162125 type: FILE visibility: PRIVATE livy-core_2.11-0.7.0-incubating.jar -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/livy-core_2.11-0.7.0-incubating.jar" } size: 95728 timestamp: 1604094162158 type: FILE visibility: PRIVATE livy-repl_2.11-0.7.0-incubating.jar -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/livy-repl_2.11-0.7.0-incubating.jar" } size: 1010321 timestamp: 1604094162213 type: FILE visibility: PRIVATE pyspark.zip -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/pyspark.zip" } size: 591770 timestamp: 1604094162673 type: FILE visibility: PRIVATE __spark_libs__ -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/__spark_libs__3907077530080990255.zip" } size: 238661437 timestamp: 1604094161514 type: ARCHIVE visibility: PRIVATE hive-site.xml -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/hive-site.xml" } size: 2132 timestamp: 1604094162567 type: FILE visibility: PRIVATE py4j-0.10.7-src.zip -> resource { scheme: "hdfs" host: "ip-10-85-100-167.vpc.internal" port: 8020 file: "/user/hadoop/.sparkStaging/application_1604078122294_0004/py4j-0.10.7-src.zip" } size: 42437 timestamp: 1604094162722 type: FILE visibility: PRIVATE =============================================================================== 20/10/30 21:42:56 INFO Utils: Using initial executors = 0, max of spark.dynamicAllocation.initialExecutors, spark.dynamicAllocation.minExecutors and spark.executor.instances 20/10/30 21:42:56 DEBUG DFSClient: DataStreamer block BP-18012997-10.85.100.167-1604078099145:blk_1073741900_1076 sending packet packet seqno: 0 offsetInBlock: 0 lastPacketInBlock: false lastByteOffsetInBlock: 312 20/10/30 21:42:56 INFO YarnSchedulerBackend$YarnSchedulerEndpoint: ApplicationMaster registered as NettyRpcEndpointRef(spark://YarnAM@ip-10-85-100-91.vpc.internal:39989) 20/10/30 21:42:56 DEBUG YarnAllocator: Updating resource requests, target: 0, pending: 0, running: 0, executorsStarting: 0 20/10/30 21:42:56 DEBUG DFSClient: DFSClient seqno: 0 reply: SUCCESS downstreamAckTimeNanos: 0 flag: 0 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop sending #8 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8020 from hadoop got value #8 20/10/30 21:42:56 DEBUG ProtobufRpcEngine: Call: fsync took 2ms 20/10/30 21:42:56 DEBUG SaslRpcClient: reading next wrapped RPC packet 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8030 from hadoop sending #9 20/10/30 21:42:56 DEBUG SaslRpcClient: wrapping token of length:110 20/10/30 21:42:56 DEBUG SaslRpcClient: unwrapping token of length:70 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8030 from hadoop got value #9 20/10/30 21:42:56 DEBUG ProtobufRpcEngine: Call: allocate took 4ms 20/10/30 21:42:56 DEBUG DFSClient: DFSClient writeChunk allocating new packet seqno=1, src=/var/log/spark/apps/application_1604078122294_0004_1.inprogress, packetSize=65016, chunksPerPacket=126, bytesCurBlock=0 20/10/30 21:42:56 DEBUG DFSClient: DFSClient writeChunk packet full seqno=1, src=/var/log/spark/apps/application_1604078122294_0004_1.inprogress, bytesCurBlock=64512, blockSize=134217728, appendChunk=false 20/10/30 21:42:56 DEBUG DFSClient: Queued packet 1 20/10/30 21:42:56 DEBUG DFSClient: computePacketChunkSize: src=/var/log/spark/apps/application_1604078122294_0004_1.inprogress, chunkSize=516, chunksPerPacket=126, packetSize=65016 20/10/30 21:42:56 DEBUG DFSClient: DataStreamer block BP-18012997-10.85.100.167-1604078099145:blk_1073741900_1076 sending packet packet seqno: 1 offsetInBlock: 0 lastPacketInBlock: false lastByteOffsetInBlock: 64512 20/10/30 21:42:56 DEBUG DFSClient: DFSClient writeChunk allocating new packet seqno=2, src=/var/log/spark/apps/application_1604078122294_0004_1.inprogress, packetSize=65016, chunksPerPacket=126, bytesCurBlock=64512 20/10/30 21:42:56 INFO StatsdSink: StatsdSink started with prefix: 'spark' 20/10/30 21:42:56 DEBUG DFSClient: DFSClient flush(): bytesCurBlock=93923 lastFlushOffset=312 createNewBlock=false 20/10/30 21:42:56 DEBUG DFSClient: Queued packet 2 20/10/30 21:42:56 DEBUG DFSClient: Waiting for ack for: 2 20/10/30 21:42:56 DEBUG DFSClient: DataStreamer block BP-18012997-10.85.100.167-1604078099145:blk_1073741900_1076 sending packet packet seqno: 2 offsetInBlock: 64512 lastPacketInBlock: false lastByteOffsetInBlock: 93923 20/10/30 21:42:56 INFO ApplicationMaster: Started progress reporter thread with (heartbeat : 3000, initial allocation : 200) intervals 20/10/30 21:42:56 DEBUG DFSClient: DFSClient seqno: 1 reply: SUCCESS downstreamAckTimeNanos: 0 flag: 0 20/10/30 21:42:56 DEBUG ApplicationMaster: Sending progress 20/10/30 21:42:56 DEBUG DFSClient: DFSClient seqno: 2 reply: SUCCESS downstreamAckTimeNanos: 0 flag: 0 20/10/30 21:42:56 INFO YarnClusterSchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.8 20/10/30 21:42:56 INFO YarnClusterScheduler: YarnClusterScheduler.postStartHook done 20/10/30 21:42:56 DEBUG YarnAllocator: Updating resource requests, target: 0, pending: 0, running: 0, executorsStarting: 0 20/10/30 21:42:56 DEBUG SaslRpcClient: reading next wrapped RPC packet 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8030 from hadoop sending #10 20/10/30 21:42:56 DEBUG SaslRpcClient: wrapping token of length:110 20/10/30 21:42:56 DEBUG SaslRpcClient: unwrapping token of length:70 20/10/30 21:42:56 DEBUG Client: IPC Client (1624817884) connection to ip-10-85-100-167.vpc.internal/10.85.100.167:8030 from hadoop got value #10 20/10/30 21:42:56 DEBUG ProtobufRpcEngine: Call: allocate took 3ms 20/10/30 21:42:56 DEBUG SparkContext: Adding shutdown hook 20/10/30 21:42:56 INFO SparkEntries: Spark context finished initialization in 2064ms 20/10/30 21:42:56 INFO SparkEntries: Created Spark session (with Hive support).