[?1034h+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Explain String | +----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Estimated Per-Host Requirements: Memory=832.00MB VCores=3 | | WARNING: The following tables are missing relevant table and/or column statistics. | | test1.http, test1.s1_u, test1.t7_impala_300000 | | | | WRITE TO HDFS [test1.t13_impala_all3, OVERWRITE=false] | | | partitions=1 | | | | | 07:HASH JOIN [LEFT OUTER JOIN, BROADCAST] | | | hash predicates: t7_impala_300000.starttime = coalesce(starttime, (u32BeginTime - u32BeginTime % 900000) / 900000), t7_impala_300000.eci = coalesce(eci, u32eci), t7_impala_300000.imsi = coalesce(imsi, s8imsi), t7_impala_300000.city = coalesce(city, u16citycode), t7_impala_300000.apptype = coalesce(apptype, u16AppType), t7_impala_300000.imei = coalesce(imei, s8imei) | | | | | |--16:EXCHANGE [BROADCAST] | | | | | | | 06:HASH JOIN [FULL OUTER JOIN, PARTITIONED] | | | | hash predicates: starttime = (u32BeginTime - u32BeginTime % 900000) / 900000, eci = u32eci, imsi = s8imsi, city = u16citycode, apptype = u16AppType, imei = s8imei | | | | other predicates: sum(u8TcpSynAckNum) = sum(u8TcpSynAckNum) | | | | | | | |--15:EXCHANGE [HASH((u32BeginTime - u32BeginTime % 900000) / 900000,u32eci,s8imsi,u16citycode,u16AppType,s8imei)] | | | | | | | | | 13:AGGREGATE [FINALIZE] | | | | | output: test1.collect_set1:merge(u16Tac), test1.collect_set1:merge(s8MSISDN), test1.collect_set1:merge(u32ENodebIP_1), test1.collect_set1:merge(u32SGWIP_1), sum:merge(CASE WHEN u8TCPStat = 0 THEN 1 ELSE 0 END), count:merge(1), sum:merge(u32TCPConstructLinkRespTime), sum:merge(u8TcpSynAckNum), sum:merge(u8TCPRetryTimes), sum:merge(u64TcpSynAckTime - u64TcpSynTime), sum:merge(u8TcpAckNum), sum:merge(u64TcpHandShakeTime - u64TcpSynAckTime), sum:merge(CASE WHEN u8TCPStat = 1 THEN u8TCPRetryTimes - u8TcpSynAckNum ELSE 0 END), sum:merge(CASE WHEN u8TCPStat = 1 THEN u8TcpSynAckNum - u8TcpAckNum ELSE 0 END) | | | | | group by: (u32BeginTime - u32BeginTime % 900000) / 900000, u32eci, s8imei, s8imsi, u16citycode, u16AppType, u16AppTypeWhole | | | | | | | | | 12:EXCHANGE [HASH((u32BeginTime - u32BeginTime % 900000) / 900000,u32eci,s8imei,s8imsi,u16citycode,u16AppType,u16AppTypeWhole)] | | | | | | | | | 05:AGGREGATE | | | | | output: test1.collect_set1(u16Tac), test1.collect_set1(s8MSISDN), test1.collect_set1(u32ENodebIP_1), test1.collect_set1(u32SGWIP_1), sum(CASE WHEN u8TCPStat = 0 THEN 1 ELSE 0 END), count(1), sum(u32TCPConstructLinkRespTime), sum(u8TcpSynAckNum), sum(u8TCPRetryTimes), sum(u64TcpSynAckTime - u64TcpSynTime), sum(u8TcpAckNum), sum(u64TcpHandShakeTime - u64TcpSynAckTime), sum(CASE WHEN u8TCPStat = 1 THEN u8TCPRetryTimes - u8TcpSynAckNum ELSE 0 END), sum(CASE WHEN u8TCPStat = 1 THEN u8TcpSynAckNum - u8TcpAckNum ELSE 0 END) | | | | | group by: (u32BeginTime - u32BeginTime % 900000) / 900000, u32eci, s8imei, s8imsi, u16citycode, u16AppType, u16AppTypeWhole | | | | | | | | | 04:SCAN HDFS [test1.s1_u] | | | | partitions=1/1 files=2 size=40.93MB | | | | predicates: u8L4Protocol = 0 | | | | | | | 14:EXCHANGE [HASH(starttime,eci,imsi,city,apptype,imei)] | | | | | | | 11:AGGREGATE [FINALIZE] | | | | output: test1.collect_set1:merge(t_http.tac), test1.collect_set1:merge(t_http.MSISDN), test1.collect_set1:merge(t_http.enodeb), test1.collect_set1:merge(t_http.sgw), sum:merge(CASE WHEN 200 <= u16HttpWapStat AND u16HttpWapStat < 400 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 400 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 401 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 402 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 403 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 404 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 405 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 406 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 407 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 408 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 409 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 410 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 411 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 412 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 413 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 414 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 415 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 416 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 417 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 500 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 501 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 502 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 503 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 504 THEN http_n ELSE 0 END), sum:merge(CASE WHEN u16HttpWapStat = 505 THEN http_n ELSE 0 END), sum:merge(CASE WHEN (417 < u16HttpWapStat AND u16HttpWapStat < 500) OR 505 < u16HttpWapStat THEN http_n ELSE 0 END), sum:merge(http_n), sum:merge(Http_D), sum:merge(CASE WHEN 200 <= u16HttpWapStat AND u16HttpWapStat < 400 THEN PageDlTraffic_tmp ELSE 0 END), sum:merge(PageDlTraffic_tmp), sum:merge(UlTraffic_tmp), sum:merge(CASE WHEN 200 <= u16HttpWapStat AND u16HttpWapStat < 400 THEN PageTransTime_tmp ELSE 0 END), sum:merge(CASE WHEN s8HttpContentType IN ('application/vnd.android.package-archive', 'application/vnd.symbian.install', 'application/x-msdownload', 'application/vnd.iphone', 'application/x-silverlight-app') THEN PageDlTraffic_tmp ELSE 0 END), sum:merge(CASE WHEN s8HttpContentType IN ('application/vnd.android.package-archive', 'application/vnd.symbian.install', 'application/x-msdownload', 'application/vnd.iphone', 'application/x-silverlight-app') THEN PageTransTime_tmp ELSE 0 END), sum:merge(HttpSmallDataDelay_tmp), sum:merge(HttpSmall_XDR_tmp), sum:merge(HttpBigTransTime_tmp), sum:merge(HttpBigData_tmp) | | | | group by: starttime, eci, imei, imsi, city, apptype, appwhole | | | | | | | 10:EXCHANGE [HASH(starttime,eci,imei,imsi,city,apptype,appwhole)] | | | | | | | 03:AGGREGATE | | | | output: test1.collect_set1(test1.collect_set1(u16Tac)), test1.collect_set1(test1.collect_set1(s8MSISDN)), test1.collect_set1(test1.collect_set1(u32ENodebIP_1)), test1.collect_set1(test1.collect_set1(u32SGWIP_1)), sum(CASE WHEN 200 <= u16HttpWapStat AND u16HttpWapStat < 400 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 400 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 401 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 402 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 403 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 404 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 405 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 406 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 407 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 408 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 409 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 410 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 411 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 412 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 413 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 414 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 415 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 416 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 417 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 500 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 501 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 502 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 503 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 504 THEN count(1) ELSE 0 END), sum(CASE WHEN u16HttpWapStat = 505 THEN count(1) ELSE 0 END), sum(CASE WHEN (417 < u16HttpWapStat AND u16HttpWapStat < 500) OR 505 < u16HttpWapStat THEN count(1) ELSE 0 END), sum(count(1)), sum(sum(u32HttpLastAckTime)), sum(CASE WHEN 200 <= u16HttpWapStat AND u16HttpWapStat < 400 THEN sum(u32DlTraffic * 8) ELSE 0 END), sum(sum(u32DlTraffic * 8)), sum(sum(u32DlTraffic)), sum(CASE WHEN 200 <= u16HttpWapStat AND u16HttpWapStat < 400 THEN sum(u32HttpLastPacketTime - u32HttpFirstRespondTime) ELSE 0 END), sum(CASE WHEN s8HttpContentType IN ('application/vnd.android.package-archive', 'application/vnd.symbian.install', 'application/x-msdownload', 'application/vnd.iphone', 'application/x-silverlight-app') THEN sum(u32DlTraffic * 8) ELSE 0 END), sum(CASE WHEN s8HttpContentType IN ('application/vnd.android.package-archive', 'application/vnd.symbian.install', 'application/x-msdownload', 'application/vnd.iphone', 'application/x-silverlight-app') THEN sum(u32HttpLastPacketTime - u32HttpFirstRespondTime) ELSE 0 END), sum(sum(CASE WHEN (u8RAT = 2 AND 100 > (u32DlTraffic / 1024) > 30) OR (u8RAT = 1 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 100) OR (u8RAT = 6 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 300) THEN u32HttpLastAckTime ELSE 0 END)), sum(sum(CASE WHEN (u8RAT = 2 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 100) OR (u8RAT = 1 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 100) OR (u8RAT = 6 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 300) THEN 1 ELSE 0 END)), sum(sum(CASE WHEN u8RAT = 2 AND (u32DlTraffic / 1024) > 50 AND (u32DlTraffic / 1024) < 100 OR (u8RAT = 1 AND (u32DlTraffic / 1024) > 100 AND (u32DlTraffic / 1024) < 500) OR (u8RAT = 6 AND (u32DlTraffic / 1024) > 300 AND (u32DlTraffic / 1024) < 500) THEN u32HttpLastAckTime ELSE 0 END)), sum(sum(CASE WHEN (u8RAT = 2 AND (u32DlTraffic / 1024) > 50 AND (u32DlTraffic / 1024) < 100) OR (u8RAT = 1 AND (u32DlTraffic / 1024) > 100 AND (u32DlTraffic / 1024) < 500) OR (u8RAT = 6 AND (u32DlTraffic / 1024) > 300 AND (u32DlTraffic / 1024) < 500) THEN u32DlTraffic * 8 ELSE 0 END)) | | | | group by: (u32BeginTime - u32BeginTime % 900000) / 900000, u32eci, s8imei, s8imsi, u16citycode, u16AppType, u16AppTypeWhole | | | | | | | 09:AGGREGATE [FINALIZE] | | | | output: test1.collect_set1:merge(u16Tac), test1.collect_set1:merge(s8MSISDN), test1.collect_set1:merge(u32ENodebIP_1), test1.collect_set1:merge(u32SGWIP_1), count:merge(1), sum:merge(u32HttpLastAckTime), sum:merge(u32DlTraffic * 8), sum:merge(u32HttpLastPacketTime - u32HttpFirstRespondTime), sum:merge(CASE WHEN (u8RAT = 2 AND 100 > (u32DlTraffic / 1024) > 30) OR (u8RAT = 1 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 100) OR (u8RAT = 6 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 300) THEN u32HttpLastAckTime ELSE 0 END), sum:merge(CASE WHEN (u8RAT = 2 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 100) OR (u8RAT = 1 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 100) OR (u8RAT = 6 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 300) THEN 1 ELSE 0 END), sum:merge(CASE WHEN u8RAT = 2 AND (u32DlTraffic / 1024) > 50 AND (u32DlTraffic / 1024) < 100 OR (u8RAT = 1 AND (u32DlTraffic / 1024) > 100 AND (u32DlTraffic / 1024) < 500) OR (u8RAT = 6 AND (u32DlTraffic / 1024) > 300 AND (u32DlTraffic / 1024) < 500) THEN u32HttpLastAckTime ELSE 0 END), sum:merge(CASE WHEN (u8RAT = 2 AND (u32DlTraffic / 1024) > 50 AND (u32DlTraffic / 1024) < 100) OR (u8RAT = 1 AND (u32DlTraffic / 1024) > 100 AND (u32DlTraffic / 1024) < 500) OR (u8RAT = 6 AND (u32DlTraffic / 1024) > 300 AND (u32DlTraffic / 1024) < 500) THEN u32DlTraffic * 8 ELSE 0 END), sum:merge(u32DlTraffic) | | | | group by: (u32BeginTime - u32BeginTime % 900000) / 900000, u32eci, s8imei, s8imsi, u16citycode, u16AppType, u16AppTypeWhole, u16HttpWapStat, s8HttpContentType | | | | | | | 08:EXCHANGE [HASH((u32BeginTime - u32BeginTime % 900000) / 900000,u32eci,s8imei,s8imsi,u16citycode,u16AppType,u16AppTypeWhole,u16HttpWapStat,s8HttpContentType)] | | | | | | | 02:AGGREGATE | | | | output: test1.collect_set1(u16Tac), test1.collect_set1(s8MSISDN), test1.collect_set1(u32ENodebIP_1), test1.collect_set1(u32SGWIP_1), count(1), sum(u32HttpLastAckTime), sum(u32DlTraffic * 8), sum(u32HttpLastPacketTime - u32HttpFirstRespondTime), sum(CASE WHEN (u8RAT = 2 AND 100 > (u32DlTraffic / 1024) > 30) OR (u8RAT = 1 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 100) OR (u8RAT = 6 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 300) THEN u32HttpLastAckTime ELSE 0 END), sum(CASE WHEN (u8RAT = 2 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 100) OR (u8RAT = 1 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 100) OR (u8RAT = 6 AND (u32DlTraffic / 1024) > 30 AND (u32DlTraffic / 1024) < 300) THEN 1 ELSE 0 END), sum(CASE WHEN u8RAT = 2 AND (u32DlTraffic / 1024) > 50 AND (u32DlTraffic / 1024) < 100 OR (u8RAT = 1 AND (u32DlTraffic / 1024) > 100 AND (u32DlTraffic / 1024) < 500) OR (u8RAT = 6 AND (u32DlTraffic / 1024) > 300 AND (u32DlTraffic / 1024) < 500) THEN u32HttpLastAckTime ELSE 0 END), sum(CASE WHEN (u8RAT = 2 AND (u32DlTraffic / 1024) > 50 AND (u32DlTraffic / 1024) < 100) OR (u8RAT = 1 AND (u32DlTraffic / 1024) > 100 AND (u32DlTraffic / 1024) < 500) OR (u8RAT = 6 AND (u32DlTraffic / 1024) > 300 AND (u32DlTraffic / 1024) < 500) THEN u32DlTraffic * 8 ELSE 0 END), sum(u32DlTraffic) | | | | group by: (u32BeginTime - u32BeginTime % 900000) / 900000, u32eci, s8imei, s8imsi, u16citycode, u16AppType, u16AppTypeWhole, u16HttpWapStat, s8HttpContentType | | | | | | | 01:SCAN HDFS [test1.http] | | | partitions=1/1 files=2 size=644.73MB | | | | | 00:SCAN HDFS [test1.t7_impala_300000] | | partitions=1/1 files=1 size=52.96MB | +----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+