SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/hive-0.14.0/lib/hive-jdbc-0.14.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] Query ID = bae_20150728043838_44f49129-0e0b-4ab2-92e8-d076c22204b3 Total jobs = 17 Launching Job 1 out of 17 Launching Job 2 out of 17 Launching Job 3 out of 17 Launching Job 4 out of 17 Launching Job 5 out of 17 Launching Job 6 out of 17 Launching Job 7 out of 17 Launching Job 8 out of 17 Number of reduce tasks not specified. Estimated from input data size: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapreduce.job.reduces= Number of reduce tasks not specified. Estimated from input data size: 1009 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= Number of reduce tasks not specified. Estimated from input data size: 1 In order to limit the maximum number of reducers: In order to change the average load for a reducer (in bytes): set hive.exec.reducers.max= set hive.exec.reducers.bytes.per.reducer= In order to set a constant number of reducers: In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapreduce.job.reduces= set mapreduce.job.reduces= Number of reduce tasks not specified. Estimated from input data size: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapreduce.job.reduces= Number of reduce tasks not specified. Estimated from input data size: 120 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= Number of reduce tasks not specified. Estimated from input data size: 1 In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapreduce.job.reduces= In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: Number of reduce tasks not specified. Estimated from input data size: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= set mapreduce.job.reduces= In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapreduce.job.reduces= Number of reduce tasks not specified. Estimated from input data size: 3 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapreduce.job.reduces= Starting Job = job_1437468004903_11188, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11188/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11188 Starting Job = job_1437468004903_11184, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11184/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11184 Starting Job = job_1437468004903_11182, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11182/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11182 Hadoop job information for Stage-11: number of mappers: 1; number of reducers: 1 2015-07-28 04:39:22,184 Stage-11 map = 0%, reduce = 0% Starting Job = job_1437468004903_11189, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11189/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11189 Starting Job = job_1437468004903_11185, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11185/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11185 Starting Job = job_1437468004903_11186, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11186/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11186 Hadoop job information for Stage-5: number of mappers: 1; number of reducers: 1 2015-07-28 04:39:26,012 Stage-5 map = 0%, reduce = 0% Starting Job = job_1437468004903_11187, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11187/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11187 Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1 2015-07-28 04:39:28,856 Stage-1 map = 0%, reduce = 0% 2015-07-28 04:39:32,943 Stage-11 map = 100%, reduce = 0%, Cumulative CPU 2.99 sec Hadoop job information for Stage-10: number of mappers: 1; number of reducers: 1 2015-07-28 04:39:34,148 Stage-10 map = 0%, reduce = 0% Starting Job = job_1437468004903_11183, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11183/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11183 Hadoop job information for Stage-12: number of mappers: 2529; number of reducers: 1009 2015-07-28 04:39:42,684 Stage-12 map = 0%, reduce = 0% Hadoop job information for Stage-4: number of mappers: 4; number of reducers: 3 2015-07-28 04:39:43,327 Stage-4 map = 0%, reduce = 0% 2015-07-28 04:39:44,145 Stage-5 map = 100%, reduce = 0% 2015-07-28 04:39:44,824 Stage-11 map = 100%, reduce = 100%, Cumulative CPU 5.36 sec MapReduce Total cumulative CPU time: 5 seconds 360 msec Ended Job = job_1437468004903_11182 Launching Job 9 out of 17 Number of reduce tasks not specified. Estimated from input data size: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapreduce.job.reduces= Starting Job = job_1437468004903_11198, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11198/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11198 Hadoop job information for Stage-9: number of mappers: 101; number of reducers: 120 2015-07-28 04:39:49,071 Stage-9 map = 0%, reduce = 0% Hadoop job information for Stage-6: number of mappers: 1; number of reducers: 1 2015-07-28 04:39:59,839 Stage-6 map = 0%, reduce = 0% Hadoop job information for Stage-13: number of mappers: 1; number of reducers: 1 2015-07-28 04:40:02,137 Stage-13 map = 0%, reduce = 0% 2015-07-28 04:40:02,762 Stage-10 map = 100%, reduce = 0%, Cumulative CPU 6.08 sec 2015-07-28 04:40:02,821 Stage-4 map = 25%, reduce = 0%, Cumulative CPU 29.67 sec 2015-07-28 04:40:04,625 Stage-9 map = 1%, reduce = 0%, Cumulative CPU 39.73 sec 2015-07-28 04:40:04,906 Stage-4 map = 50%, reduce = 0%, Cumulative CPU 42.54 sec 2015-07-28 04:40:07,133 Stage-12 map = 1%, reduce = 0%, Cumulative CPU 715.8 sec 2015-07-28 04:40:07,815 Stage-9 map = 2%, reduce = 0%, Cumulative CPU 128.04 sec 2015-07-28 04:40:08,916 Stage-9 map = 3%, reduce = 0%, Cumulative CPU 184.87 sec 2015-07-28 04:40:09,191 Stage-5 map = 100%, reduce = 100%, Cumulative CPU 9.13 sec 2015-07-28 04:40:09,970 Stage-9 map = 5%, reduce = 0%, Cumulative CPU 283.47 sec 2015-07-28 04:40:11,017 Stage-9 map = 6%, reduce = 0%, Cumulative CPU 362.31 sec 2015-07-28 04:40:11,218 Stage-4 map = 59%, reduce = 0%, Cumulative CPU 131.64 sec 2015-07-28 04:40:12,064 Stage-9 map = 7%, reduce = 0%, Cumulative CPU 401.16 sec 2015-07-28 04:40:13,109 Stage-9 map = 9%, reduce = 0%, Cumulative CPU 453.36 sec 2015-07-28 04:40:14,173 Stage-9 map = 10%, reduce = 0%, Cumulative CPU 472.01 sec 2015-07-28 04:40:14,357 Stage-4 map = 67%, reduce = 0%, Cumulative CPU 135.1 sec 2015-07-28 04:40:15,237 Stage-9 map = 12%, reduce = 0%, Cumulative CPU 539.7 sec 2015-07-28 04:40:15,317 Stage-10 map = 100%, reduce = 100%, Cumulative CPU 11.61 sec 2015-07-28 04:40:15,425 Stage-4 map = 75%, reduce = 0%, Cumulative CPU 136.09 sec 2015-07-28 04:40:16,289 Stage-9 map = 13%, reduce = 0%, Cumulative CPU 610.24 sec 2015-07-28 04:40:17,329 Stage-9 map = 15%, reduce = 0%, Cumulative CPU 715.06 sec MapReduce Total cumulative CPU time: 11 seconds 610 msec Ended Job = job_1437468004903_11185 Launching Job 10 out of 17 Number of reduce tasks not specified. Estimated from input data size: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapreduce.job.reduces= 2015-07-28 04:40:18,281 Stage-6 map = 100%, reduce = 0%, Cumulative CPU 2.84 sec 2015-07-28 04:40:18,366 Stage-9 map = 17%, reduce = 0%, Cumulative CPU 768.87 sec 2015-07-28 04:40:18,658 Stage-12 map = 2%, reduce = 0%, Cumulative CPU 1217.09 sec Starting Job = job_1437468004903_11203, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11203/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11203 2015-07-28 04:40:19,423 Stage-9 map = 19%, reduce = 0%, Cumulative CPU 970.1 sec 2015-07-28 04:40:20,473 Stage-9 map = 21%, reduce = 0%, Cumulative CPU 1003.32 sec 2015-07-28 04:40:21,517 Stage-9 map = 24%, reduce = 0%, Cumulative CPU 1061.99 sec 2015-07-28 04:40:21,923 Stage-13 map = 100%, reduce = 0%, Cumulative CPU 6.67 sec 2015-07-28 04:40:22,563 Stage-9 map = 27%, reduce = 0%, Cumulative CPU 1118.32 sec 2015-07-28 04:40:23,608 Stage-9 map = 29%, reduce = 0%, Cumulative CPU 1172.8 sec 2015-07-28 04:40:24,660 Stage-9 map = 32%, reduce = 0%, Cumulative CPU 1209.11 sec 2015-07-28 04:40:25,716 Stage-9 map = 35%, reduce = 0%, Cumulative CPU 1243.74 sec 2015-07-28 04:40:26,764 Stage-9 map = 37%, reduce = 0%, Cumulative CPU 1276.08 sec 2015-07-28 04:40:27,803 Stage-9 map = 38%, reduce = 0%, Cumulative CPU 1281.7 sec 2015-07-28 04:40:28,892 Stage-9 map = 40%, reduce = 0%, Cumulative CPU 1310.15 sec Hadoop job information for Stage-14: number of mappers: 1; number of reducers: 1 2015-07-28 04:40:29,341 Stage-14 map = 0%, reduce = 0% 2015-07-28 04:40:29,582 Stage-1 map = 0%, reduce = 0% 2015-07-28 04:40:29,931 Stage-9 map = 41%, reduce = 0%, Cumulative CPU 1356.22 sec 2015-07-28 04:40:30,228 Stage-4 map = 75%, reduce = 8%, Cumulative CPU 136.54 sec 2015-07-28 04:40:32,013 Stage-9 map = 43%, reduce = 0%, Cumulative CPU 1428.15 sec 2015-07-28 04:40:32,328 Stage-4 map = 75%, reduce = 17%, Cumulative CPU 137.27 sec 2015-07-28 04:40:33,074 Stage-9 map = 44%, reduce = 0%, Cumulative CPU 1440.01 sec 2015-07-28 04:40:33,981 Stage-6 map = 100%, reduce = 100%, Cumulative CPU 7.48 sec 2015-07-28 04:40:35,373 Stage-12 map = 3%, reduce = 0%, Cumulative CPU 1965.63 sec 2015-07-28 04:40:36,196 Stage-9 map = 45%, reduce = 0%, Cumulative CPU 1782.43 sec MapReduce Total cumulative CPU time: 7 seconds 480 msec Ended Job = job_1437468004903_11189 2015-07-28 04:40:37,237 Stage-9 map = 46%, reduce = 0%, Cumulative CPU 1798.87 sec 2015-07-28 04:40:37,569 Stage-4 map = 100%, reduce = 17%, Cumulative CPU 162.3 sec Launching Job 11 out of 17 Number of reduce tasks not specified. Estimated from input data size: 120 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapreduce.job.reduces= 2015-07-28 04:40:38,305 Stage-9 map = 48%, reduce = 0%, Cumulative CPU 1822.18 sec MapReduce Total cumulative CPU time: 9 seconds 130 msec Ended Job = job_1437468004903_11188 2015-07-28 04:40:38,628 Stage-13 map = 100%, reduce = 100%, Cumulative CPU 11.48 sec 2015-07-28 04:40:39,054 Stage-14 map = 100%, reduce = 0%, Cumulative CPU 2.3 sec Starting Job = job_1437468004903_11214, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11214/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11214 2015-07-28 04:40:39,367 Stage-9 map = 49%, reduce = 0%, Cumulative CPU 1944.12 sec Launching Job 12 out of 17 Number of reduce tasks not specified. Estimated from input data size: 205 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapreduce.job.reduces= 2015-07-28 04:40:39,701 Stage-4 map = 100%, reduce = 31%, Cumulative CPU 164.31 sec 2015-07-28 04:40:40,435 Stage-9 map = 51%, reduce = 0%, Cumulative CPU 2046.4 sec 2015-07-28 04:40:40,793 Stage-4 map = 100%, reduce = 44%, Cumulative CPU 168.12 sec 2015-07-28 04:40:41,491 Stage-9 map = 52%, reduce = 0%, Cumulative CPU 2085.22 sec 2015-07-28 04:40:41,859 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 176.96 sec 2015-07-28 04:40:42,546 Stage-9 map = 55%, reduce = 0%, Cumulative CPU 2207.97 sec Starting Job = job_1437468004903_11218, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11218/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11218 2015-07-28 04:40:43,611 Stage-9 map = 57%, reduce = 0%, Cumulative CPU 2235.31 sec 2015-07-28 04:40:43,937 Stage-4 map = 100%, reduce = 75%, Cumulative CPU 186.47 sec 2015-07-28 04:40:44,988 Stage-4 map = 100%, reduce = 89%, Cumulative CPU 191.21 sec 2015-07-28 04:40:45,750 Stage-9 map = 59%, reduce = 0%, Cumulative CPU 2319.51 sec 2015-07-28 04:40:46,185 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 10.32 sec 2015-07-28 04:40:46,799 Stage-9 map = 61%, reduce = 0%, Cumulative CPU 2357.34 sec 2015-07-28 04:40:47,862 Stage-9 map = 62%, reduce = 0%, Cumulative CPU 2426.43 sec 2015-07-28 04:40:48,182 Stage-4 map = 100%, reduce = 100%, Cumulative CPU 196.44 sec 2015-07-28 04:40:48,941 Stage-9 map = 63%, reduce = 0%, Cumulative CPU 2502.74 sec 2015-07-28 04:40:49,627 Stage-12 map = 4%, reduce = 0%, Cumulative CPU 2610.71 sec 2015-07-28 04:40:49,999 Stage-9 map = 66%, reduce = 0%, Cumulative CPU 2575.93 sec MapReduce Total cumulative CPU time: 11 seconds 480 msec Ended Job = job_1437468004903_11198 MapReduce Total cumulative CPU time: 3 minutes 16 seconds 440 msec Ended Job = job_1437468004903_11187 2015-07-28 04:40:51,071 Stage-9 map = 69%, reduce = 0%, Cumulative CPU 2666.04 sec Stage-20 is selected by condition resolver. Stage-7 is filtered out by condition resolver. Hadoop job information for Stage-17: number of mappers: 187; number of reducers: 205 2015-07-28 04:40:52,101 Stage-17 map = 0%, reduce = 0% 2015-07-28 04:40:52,123 Stage-9 map = 70%, reduce = 0%, Cumulative CPU 2690.34 sec Hadoop job information for Stage-15: number of mappers: 101; number of reducers: 120 2015-07-28 04:40:52,858 Stage-15 map = 0%, reduce = 0% 2015-07-28 04:40:53,171 Stage-9 map = 72%, reduce = 0%, Cumulative CPU 2718.83 sec 2015-07-28 04:40:54,224 Stage-9 map = 74%, reduce = 0%, Cumulative CPU 2776.36 sec 2015-07-28 04:40:55,258 Stage-9 map = 75%, reduce = 0%, Cumulative CPU 2798.32 sec 2015-07-28 04:40:56,288 Stage-9 map = 77%, reduce = 0%, Cumulative CPU 2848.15 sec SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/hive-0.14.0/lib/hive-jdbc-0.14.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 2015-07-28 04:40:57,034 Stage-14 map = 100%, reduce = 100%, Cumulative CPU 8.82 sec 2015-07-28 04:40:57,334 Stage-9 map = 78%, reduce = 0%, Cumulative CPU 2913.68 sec Execution log at: /tmp/bae/bae_20150728043838_44f49129-0e0b-4ab2-92e8-d076c22204b3.log 2015-07-28 04:40:58 Starting to launch local task to process map join; maximum memory = 2025324544 MapReduce Total cumulative CPU time: 8 seconds 820 msec Ended Job = job_1437468004903_11203 2015-07-28 04:40:58,385 Stage-9 map = 80%, reduce = 0%, Cumulative CPU 2953.57 sec 2015-07-28 04:40:59,483 Stage-9 map = 81%, reduce = 0%, Cumulative CPU 2966.49 sec 2015-07-28 04:40:59 Dump the side-table for tag: 1 with group count: 0 into file: file:/tmp/bae/5a14a54a-b09f-4c74-987a-881d303f489e/hive_2015-07-28_04-38-57_558_1149515063087051493-1/-local-10016/HashTable-Stage-18/MapJoin-mapfile01--.hashtable 2015-07-28 04:40:59 Uploaded 1 File to: file:/tmp/bae/5a14a54a-b09f-4c74-987a-881d303f489e/hive_2015-07-28_04-38-57_558_1149515063087051493-1/-local-10016/HashTable-Stage-18/MapJoin-mapfile01--.hashtable (260 bytes) 2015-07-28 04:40:59 End of local task; Time Taken: 1.917 sec. 2015-07-28 04:41:00,550 Stage-9 map = 84%, reduce = 0%, Cumulative CPU 2997.35 sec Execution completed successfully MapredLocal task succeeded Launching Job 14 out of 17 Number of reduce tasks is set to 0 since there's no reduce operator 2015-07-28 04:41:01,638 Stage-9 map = 86%, reduce = 0%, Cumulative CPU 3009.57 sec 2015-07-28 04:41:02,802 Stage-12 map = 5%, reduce = 0%, Cumulative CPU 3254.28 sec 2015-07-28 04:41:02,997 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 15.6 sec 2015-07-28 04:41:03,787 Stage-9 map = 87%, reduce = 0%, Cumulative CPU 3034.54 sec Starting Job = job_1437468004903_11224, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11224/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11224 2015-07-28 04:41:05,902 Stage-9 map = 88%, reduce = 0%, Cumulative CPU 3162.95 sec MapReduce Total cumulative CPU time: 15 seconds 600 msec Ended Job = job_1437468004903_11184 2015-07-28 04:41:06,969 Stage-9 map = 90%, reduce = 0%, Cumulative CPU 3180.2 sec 2015-07-28 04:41:07,798 Stage-15 map = 1%, reduce = 0%, Cumulative CPU 56.11 sec 2015-07-28 04:41:09,920 Stage-15 map = 2%, reduce = 0%, Cumulative CPU 136.35 sec 2015-07-28 04:41:10,149 Stage-9 map = 91%, reduce = 0%, Cumulative CPU 3249.19 sec 2015-07-28 04:41:10,978 Stage-15 map = 4%, reduce = 0%, Cumulative CPU 221.69 sec 2015-07-28 04:41:11,210 Stage-9 map = 91%, reduce = 1%, Cumulative CPU 3253.36 sec 2015-07-28 04:41:12,042 Stage-15 map = 5%, reduce = 0%, Cumulative CPU 234.76 sec 2015-07-28 04:41:12,284 Stage-17 map = 1%, reduce = 0%, Cumulative CPU 240.27 sec 2015-07-28 04:41:13,115 Stage-15 map = 7%, reduce = 0%, Cumulative CPU 336.94 sec 2015-07-28 04:41:13,355 Stage-17 map = 2%, reduce = 0%, Cumulative CPU 369.14 sec 2015-07-28 04:41:14,192 Stage-15 map = 9%, reduce = 0%, Cumulative CPU 408.15 sec 2015-07-28 04:41:14,363 Stage-9 map = 91%, reduce = 2%, Cumulative CPU 3289.38 sec 2015-07-28 04:41:15,257 Stage-15 map = 11%, reduce = 0%, Cumulative CPU 454.76 sec 2015-07-28 04:41:15,412 Stage-9 map = 92%, reduce = 3%, Cumulative CPU 3355.6 sec 2015-07-28 04:41:15,483 Stage-17 map = 3%, reduce = 0%, Cumulative CPU 512.23 sec 2015-07-28 04:41:16,311 Stage-15 map = 13%, reduce = 0%, Cumulative CPU 559.12 sec 2015-07-28 04:41:16,468 Stage-9 map = 92%, reduce = 4%, Cumulative CPU 3361.48 sec 2015-07-28 04:41:16,536 Stage-17 map = 4%, reduce = 0%, Cumulative CPU 581.74 sec Hadoop job information for Stage-18: number of mappers: 1; number of reducers: 0 2015-07-28 04:41:17,338 Stage-18 map = 0%, reduce = 0% 2015-07-28 04:41:17,361 Stage-15 map = 16%, reduce = 0%, Cumulative CPU 616.05 sec 2015-07-28 04:41:17,519 Stage-9 map = 93%, reduce = 4%, Cumulative CPU 3428.28 sec 2015-07-28 04:41:17,596 Stage-17 map = 5%, reduce = 0%, Cumulative CPU 610.48 sec 2015-07-28 04:41:18,414 Stage-15 map = 19%, reduce = 0%, Cumulative CPU 642.3 sec 2015-07-28 04:41:18,661 Stage-17 map = 7%, reduce = 0%, Cumulative CPU 719.28 sec 2015-07-28 04:41:19,475 Stage-15 map = 22%, reduce = 0%, Cumulative CPU 692.3 sec 2015-07-28 04:41:19,633 Stage-9 map = 93%, reduce = 5%, Cumulative CPU 3443.35 sec 2015-07-28 04:41:19,727 Stage-17 map = 9%, reduce = 0%, Cumulative CPU 812.91 sec 2015-07-28 04:41:20,525 Stage-15 map = 23%, reduce = 0%, Cumulative CPU 799.29 sec 2015-07-28 04:41:20,793 Stage-17 map = 10%, reduce = 0%, Cumulative CPU 902.46 sec 2015-07-28 04:41:21,333 Stage-12 map = 6%, reduce = 0%, Cumulative CPU 3986.5 sec 2015-07-28 04:41:21,578 Stage-15 map = 24%, reduce = 0%, Cumulative CPU 812.43 sec 2015-07-28 04:41:21,748 Stage-9 map = 94%, reduce = 5%, Cumulative CPU 3460.49 sec 2015-07-28 04:41:21,847 Stage-17 map = 11%, reduce = 0%, Cumulative CPU 1003.43 sec 2015-07-28 04:41:22,628 Stage-15 map = 27%, reduce = 0%, Cumulative CPU 862.68 sec 2015-07-28 04:41:22,897 Stage-17 map = 12%, reduce = 0%, Cumulative CPU 1036.26 sec 2015-07-28 04:41:23,681 Stage-15 map = 29%, reduce = 0%, Cumulative CPU 938.24 sec 2015-07-28 04:41:23,876 Stage-9 map = 95%, reduce = 6%, Cumulative CPU 3523.03 sec 2015-07-28 04:41:23,951 Stage-17 map = 13%, reduce = 0%, Cumulative CPU 1072.97 sec 2015-07-28 04:41:24,741 Stage-15 map = 30%, reduce = 0%, Cumulative CPU 949.53 sec 2015-07-28 04:41:25,022 Stage-17 map = 15%, reduce = 0%, Cumulative CPU 1121.89 sec 2015-07-28 04:41:25,792 Stage-15 map = 32%, reduce = 0%, Cumulative CPU 974.12 sec 2015-07-28 04:41:26,840 Stage-15 map = 34%, reduce = 0%, Cumulative CPU 1073.58 sec 2015-07-28 04:41:27,153 Stage-17 map = 16%, reduce = 0%, Cumulative CPU 1166.29 sec 2015-07-28 04:41:27,893 Stage-15 map = 35%, reduce = 0%, Cumulative CPU 1106.36 sec 2015-07-28 04:41:28,229 Stage-17 map = 17%, reduce = 0%, Cumulative CPU 1195.67 sec 2015-07-28 04:41:28,944 Stage-15 map = 37%, reduce = 0%, Cumulative CPU 1171.78 sec 2015-07-28 04:41:29,136 Stage-9 map = 96%, reduce = 6%, Cumulative CPU 3595.99 sec 2015-07-28 04:41:29,992 Stage-15 map = 39%, reduce = 0%, Cumulative CPU 1241.75 sec 2015-07-28 04:41:30,362 Stage-17 map = 18%, reduce = 0%, Cumulative CPU 1260.11 sec 2015-07-28 04:41:31,045 Stage-15 map = 40%, reduce = 0%, Cumulative CPU 1273.07 sec 2015-07-28 04:41:31,233 Stage-9 map = 96%, reduce = 7%, Cumulative CPU 3611.05 sec 2015-07-28 04:41:32,098 Stage-15 map = 42%, reduce = 0%, Cumulative CPU 1295.35 sec 2015-07-28 04:41:32,468 Stage-17 map = 19%, reduce = 0%, Cumulative CPU 1366.2 sec 2015-07-28 04:41:33,148 Stage-15 map = 44%, reduce = 0%, Cumulative CPU 1352.75 sec 2015-07-28 04:41:34,185 Stage-15 map = 46%, reduce = 0%, Cumulative CPU 1380.36 sec 2015-07-28 04:41:34,556 Stage-17 map = 20%, reduce = 0%, Cumulative CPU 1452.81 sec 2015-07-28 04:41:35,225 Stage-15 map = 47%, reduce = 0%, Cumulative CPU 1386.48 sec 2015-07-28 04:41:35,626 Stage-17 map = 21%, reduce = 0%, Cumulative CPU 1490.14 sec 2015-07-28 04:41:36,273 Stage-15 map = 48%, reduce = 0%, Cumulative CPU 1439.9 sec 2015-07-28 04:41:36,417 Stage-9 map = 97%, reduce = 7%, Cumulative CPU 3635.65 sec 2015-07-28 04:41:37,342 Stage-15 map = 49%, reduce = 0%, Cumulative CPU 1452.85 sec 2015-07-28 04:41:37,704 Stage-17 map = 22%, reduce = 0%, Cumulative CPU 1582.29 sec 2015-07-28 04:41:37,781 Stage-12 map = 7%, reduce = 0%, Cumulative CPU 4858.56 sec 2015-07-28 04:41:38,396 Stage-15 map = 50%, reduce = 0%, Cumulative CPU 1510.24 sec 2015-07-28 04:41:39,164 Stage-18 map = 100%, reduce = 0%, Cumulative CPU 3.56 sec 2015-07-28 04:41:39,446 Stage-15 map = 51%, reduce = 0%, Cumulative CPU 1672.2 sec 2015-07-28 04:41:39,781 Stage-17 map = 23%, reduce = 0%, Cumulative CPU 1660.13 sec 2015-07-28 04:41:40,496 Stage-15 map = 53%, reduce = 0%, Cumulative CPU 1725.53 sec MapReduce Total cumulative CPU time: 3 seconds 560 msec Ended Job = job_1437468004903_11224 2015-07-28 04:41:41,544 Stage-15 map = 54%, reduce = 0%, Cumulative CPU 1803.52 sec 2015-07-28 04:41:41,870 Stage-17 map = 24%, reduce = 0%, Cumulative CPU 1757.92 sec 2015-07-28 04:41:42,591 Stage-15 map = 55%, reduce = 0%, Cumulative CPU 1852.01 sec Launching Job 15 out of 17 Number of reduce tasks not specified. Estimated from input data size: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapreduce.job.reduces= 2015-07-28 04:41:43,628 Stage-15 map = 57%, reduce = 0%, Cumulative CPU 1867.28 sec 2015-07-28 04:41:43,929 Stage-17 map = 25%, reduce = 0%, Cumulative CPU 1816.46 sec Starting Job = job_1437468004903_11228, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11228/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11228 2015-07-28 04:41:44,674 Stage-15 map = 59%, reduce = 0%, Cumulative CPU 1932.81 sec 2015-07-28 04:41:44,961 Stage-17 map = 26%, reduce = 0%, Cumulative CPU 1872.43 sec 2015-07-28 04:41:45,722 Stage-15 map = 62%, reduce = 0%, Cumulative CPU 2019.69 sec 2015-07-28 04:41:46,006 Stage-17 map = 27%, reduce = 0%, Cumulative CPU 2036.78 sec 2015-07-28 04:41:46,766 Stage-15 map = 63%, reduce = 0%, Cumulative CPU 2080.6 sec 2015-07-28 04:41:47,815 Stage-15 map = 65%, reduce = 0%, Cumulative CPU 2180.5 sec 2015-07-28 04:41:48,093 Stage-17 map = 28%, reduce = 0%, Cumulative CPU 2114.43 sec 2015-07-28 04:41:48,844 Stage-15 map = 67%, reduce = 0%, Cumulative CPU 2230.94 sec 2015-07-28 04:41:48,976 Stage-9 map = 98%, reduce = 7%, Cumulative CPU 3709.69 sec 2015-07-28 04:41:49,124 Stage-17 map = 30%, reduce = 0%, Cumulative CPU 2208.11 sec 2015-07-28 04:41:49,890 Stage-15 map = 68%, reduce = 0%, Cumulative CPU 2280.02 sec 2015-07-28 04:41:50,929 Stage-15 map = 70%, reduce = 0%, Cumulative CPU 2333.61 sec 2015-07-28 04:41:51,050 Stage-9 map = 98%, reduce = 8%, Cumulative CPU 3730.65 sec 2015-07-28 04:41:51,181 Stage-17 map = 31%, reduce = 0%, Cumulative CPU 2376.98 sec 2015-07-28 04:41:51,956 Stage-15 map = 72%, reduce = 0%, Cumulative CPU 2412.4 sec 2015-07-28 04:41:52,219 Stage-17 map = 33%, reduce = 0%, Cumulative CPU 2418.08 sec 2015-07-28 04:41:52,992 Stage-15 map = 73%, reduce = 0%, Cumulative CPU 2448.87 sec 2015-07-28 04:41:53,947 Stage-12 map = 8%, reduce = 0%, Cumulative CPU 5530.44 sec 2015-07-28 04:41:54,041 Stage-15 map = 76%, reduce = 0%, Cumulative CPU 2489.49 sec 2015-07-28 04:41:54,281 Stage-17 map = 34%, reduce = 0%, Cumulative CPU 2513.23 sec 2015-07-28 04:41:55,070 Stage-15 map = 77%, reduce = 0%, Cumulative CPU 2551.81 sec 2015-07-28 04:41:55,336 Stage-17 map = 35%, reduce = 0%, Cumulative CPU 2571.31 sec 2015-07-28 04:41:56,116 Stage-15 map = 79%, reduce = 0%, Cumulative CPU 2573.43 sec Hadoop job information for Stage-8: number of mappers: 1; number of reducers: 1 2015-07-28 04:41:56,317 Stage-8 map = 0%, reduce = 0% 2015-07-28 04:41:56,388 Stage-17 map = 36%, reduce = 0%, Cumulative CPU 2682.75 sec 2015-07-28 04:41:57,164 Stage-15 map = 81%, reduce = 0%, Cumulative CPU 2604.25 sec 2015-07-28 04:41:57,439 Stage-17 map = 37%, reduce = 0%, Cumulative CPU 2734.39 sec 2015-07-28 04:41:58,218 Stage-15 map = 83%, reduce = 0%, Cumulative CPU 2629.08 sec 2015-07-28 04:41:58,473 Stage-17 map = 38%, reduce = 0%, Cumulative CPU 2777.47 sec 2015-07-28 04:41:59,543 Stage-17 map = 39%, reduce = 0%, Cumulative CPU 2813.93 sec 2015-07-28 04:42:00,314 Stage-15 map = 85%, reduce = 0%, Cumulative CPU 2680.9 sec 2015-07-28 04:42:00,593 Stage-17 map = 40%, reduce = 0%, Cumulative CPU 2956.64 sec 2015-07-28 04:42:01,361 Stage-15 map = 88%, reduce = 0%, Cumulative CPU 2706.24 sec 2015-07-28 04:42:02,408 Stage-15 map = 89%, reduce = 0%, Cumulative CPU 2723.19 sec 2015-07-28 04:42:02,691 Stage-17 map = 41%, reduce = 0%, Cumulative CPU 3055.57 sec 2015-07-28 04:42:03,455 Stage-15 map = 91%, reduce = 0%, Cumulative CPU 2745.92 sec 2015-07-28 04:42:03,597 Stage-9 map = 99%, reduce = 8%, Cumulative CPU 3871.23 sec 2015-07-28 04:42:03,738 Stage-17 map = 42%, reduce = 0%, Cumulative CPU 3098.56 sec 2015-07-28 04:42:04,501 Stage-15 map = 93%, reduce = 0%, Cumulative CPU 2762.44 sec 2015-07-28 04:42:04,786 Stage-17 map = 43%, reduce = 0%, Cumulative CPU 3145.03 sec 2015-07-28 04:42:05,547 Stage-15 map = 94%, reduce = 0%, Cumulative CPU 2767.85 sec 2015-07-28 04:42:05,835 Stage-17 map = 44%, reduce = 0%, Cumulative CPU 3189.45 sec 2015-07-28 04:42:06,599 Stage-15 map = 95%, reduce = 0%, Cumulative CPU 2781.61 sec 2015-07-28 04:42:06,747 Stage-9 map = 99%, reduce = 9%, Cumulative CPU 3903.19 sec 2015-07-28 04:42:06,882 Stage-17 map = 45%, reduce = 0%, Cumulative CPU 3253.6 sec 2015-07-28 04:42:07,651 Stage-15 map = 96%, reduce = 0%, Cumulative CPU 2787.02 sec 2015-07-28 04:42:07,657 Stage-12 map = 9%, reduce = 0%, Cumulative CPU 6285.59 sec 2015-07-28 04:42:07,929 Stage-17 map = 46%, reduce = 0%, Cumulative CPU 3293.56 sec 2015-07-28 04:42:08,978 Stage-17 map = 47%, reduce = 0%, Cumulative CPU 3371.76 sec 2015-07-28 04:42:09,001 Stage-8 map = 100%, reduce = 0%, Cumulative CPU 2.71 sec 2015-07-28 04:42:10,023 Stage-17 map = 48%, reduce = 0%, Cumulative CPU 3409.8 sec 2015-07-28 04:42:10,805 Stage-15 map = 97%, reduce = 0%, Cumulative CPU 2806.13 sec 2015-07-28 04:42:11,068 Stage-17 map = 49%, reduce = 0%, Cumulative CPU 3441.06 sec 2015-07-28 04:42:12,126 Stage-17 map = 50%, reduce = 0%, Cumulative CPU 3482.18 sec 2015-07-28 04:42:13,178 Stage-17 map = 51%, reduce = 0%, Cumulative CPU 3503.82 sec 2015-07-28 04:42:13,944 Stage-15 map = 98%, reduce = 1%, Cumulative CPU 2825.27 sec 2015-07-28 04:42:14,995 Stage-15 map = 98%, reduce = 2%, Cumulative CPU 2834.28 sec 2015-07-28 04:42:15,285 Stage-17 map = 52%, reduce = 0%, Cumulative CPU 3586.09 sec 2015-07-28 04:42:16,042 Stage-15 map = 98%, reduce = 3%, Cumulative CPU 2854.9 sec 2015-07-28 04:42:17,381 Stage-17 map = 53%, reduce = 0%, Cumulative CPU 3670.51 sec 2015-07-28 04:42:18,135 Stage-15 map = 98%, reduce = 5%, Cumulative CPU 2871.4 sec 2015-07-28 04:42:18,429 Stage-17 map = 54%, reduce = 0%, Cumulative CPU 3734.44 sec 2015-07-28 04:42:20,228 Stage-15 map = 98%, reduce = 6%, Cumulative CPU 2894.12 sec 2015-07-28 04:42:20,535 Stage-17 map = 55%, reduce = 0%, Cumulative CPU 3826.62 sec 2015-07-28 04:42:20,708 Stage-12 map = 10%, reduce = 0%, Cumulative CPU 7045.59 sec 2015-07-28 04:42:21,592 Stage-17 map = 56%, reduce = 0%, Cumulative CPU 3858.49 sec 2015-07-28 04:42:21,593 Stage-8 map = 100%, reduce = 100%, Cumulative CPU 5.73 sec 2015-07-28 04:42:22,322 Stage-15 map = 98%, reduce = 7%, Cumulative CPU 2897.72 sec 2015-07-28 04:42:22,644 Stage-17 map = 57%, reduce = 0%, Cumulative CPU 3949.75 sec MapReduce Total cumulative CPU time: 5 seconds 730 msec Ended Job = job_1437468004903_11228 2015-07-28 04:42:23,694 Stage-17 map = 58%, reduce = 0%, Cumulative CPU 3983.71 sec 2015-07-28 04:42:25,795 Stage-17 map = 59%, reduce = 0%, Cumulative CPU 4150.66 sec 2015-07-28 04:42:26,844 Stage-17 map = 60%, reduce = 0%, Cumulative CPU 4187.42 sec 2015-07-28 04:42:28,946 Stage-17 map = 61%, reduce = 0%, Cumulative CPU 4326.7 sec 2015-07-28 04:42:29,992 Stage-17 map = 62%, reduce = 0%, Cumulative CPU 4404.0 sec 2015-07-28 04:42:31,040 Stage-17 map = 63%, reduce = 0%, Cumulative CPU 4583.62 sec 2015-07-28 04:42:32,085 Stage-17 map = 64%, reduce = 0%, Cumulative CPU 4622.88 sec 2015-07-28 04:42:33,130 Stage-17 map = 65%, reduce = 0%, Cumulative CPU 4703.11 sec 2015-07-28 04:42:33,877 Stage-12 map = 11%, reduce = 0%, Cumulative CPU 7715.3 sec 2015-07-28 04:42:34,184 Stage-17 map = 66%, reduce = 0%, Cumulative CPU 4815.21 sec 2015-07-28 04:42:35,238 Stage-17 map = 67%, reduce = 0%, Cumulative CPU 4880.62 sec 2015-07-28 04:42:36,282 Stage-17 map = 68%, reduce = 0%, Cumulative CPU 4923.58 sec 2015-07-28 04:42:37,314 Stage-17 map = 69%, reduce = 0%, Cumulative CPU 4953.05 sec 2015-07-28 04:42:38,346 Stage-17 map = 70%, reduce = 0%, Cumulative CPU 4993.36 sec 2015-07-28 04:42:39,392 Stage-17 map = 71%, reduce = 0%, Cumulative CPU 5116.66 sec 2015-07-28 04:42:40,422 Stage-17 map = 72%, reduce = 0%, Cumulative CPU 5159.72 sec 2015-07-28 04:42:41,465 Stage-17 map = 73%, reduce = 0%, Cumulative CPU 5278.25 sec 2015-07-28 04:42:42,164 Stage-15 map = 99%, reduce = 7%, Cumulative CPU 2992.43 sec 2015-07-28 04:42:42,495 Stage-17 map = 74%, reduce = 0%, Cumulative CPU 5359.61 sec 2015-07-28 04:42:43,525 Stage-17 map = 75%, reduce = 0%, Cumulative CPU 5392.93 sec 2015-07-28 04:42:44,571 Stage-17 map = 76%, reduce = 0%, Cumulative CPU 5431.19 sec 2015-07-28 04:42:45,619 Stage-17 map = 77%, reduce = 0%, Cumulative CPU 5480.3 sec 2015-07-28 04:42:46,057 Stage-12 map = 12%, reduce = 0%, Cumulative CPU 8347.99 sec 2015-07-28 04:42:46,340 Stage-15 map = 99%, reduce = 8%, Cumulative CPU 3022.34 sec 2015-07-28 04:42:46,688 Stage-17 map = 78%, reduce = 0%, Cumulative CPU 5504.84 sec 2015-07-28 04:42:47,721 Stage-17 map = 79%, reduce = 0%, Cumulative CPU 5551.92 sec 2015-07-28 04:42:48,771 Stage-17 map = 80%, reduce = 0%, Cumulative CPU 5614.5 sec 2015-07-28 04:42:49,825 Stage-17 map = 81%, reduce = 0%, Cumulative CPU 5630.98 sec 2015-07-28 04:42:51,919 Stage-17 map = 82%, reduce = 0%, Cumulative CPU 5776.22 sec 2015-07-28 04:42:52,966 Stage-17 map = 83%, reduce = 0%, Cumulative CPU 5833.82 sec 2015-07-28 04:42:55,067 Stage-17 map = 84%, reduce = 0%, Cumulative CPU 5960.42 sec 2015-07-28 04:42:55,927 Stage-9 map = 100%, reduce = 9%, Cumulative CPU 4047.09 sec 2015-07-28 04:42:56,120 Stage-17 map = 85%, reduce = 0%, Cumulative CPU 6014.67 sec 2015-07-28 04:42:56,975 Stage-9 map = 100%, reduce = 11%, Cumulative CPU 4057.08 sec 2015-07-28 04:42:57,164 Stage-17 map = 86%, reduce = 0%, Cumulative CPU 6029.89 sec 2015-07-28 04:42:58,024 Stage-9 map = 100%, reduce = 17%, Cumulative CPU 4109.25 sec 2015-07-28 04:42:58,147 Stage-12 map = 13%, reduce = 0%, Cumulative CPU 9029.92 sec 2015-07-28 04:42:58,208 Stage-17 map = 87%, reduce = 0%, Cumulative CPU 6087.65 sec 2015-07-28 04:42:59,076 Stage-9 map = 100%, reduce = 23%, Cumulative CPU 4168.0 sec 2015-07-28 04:42:59,255 Stage-17 map = 88%, reduce = 0%, Cumulative CPU 6138.09 sec 2015-07-28 04:43:00,124 Stage-9 map = 100%, reduce = 24%, Cumulative CPU 4185.04 sec 2015-07-28 04:43:01,180 Stage-9 map = 100%, reduce = 26%, Cumulative CPU 4222.85 sec 2015-07-28 04:43:01,356 Stage-17 map = 89%, reduce = 0%, Cumulative CPU 6347.19 sec 2015-07-28 04:43:02,036 Stage-15 map = 99%, reduce = 9%, Cumulative CPU 3166.08 sec 2015-07-28 04:43:02,393 Stage-17 map = 91%, reduce = 0%, Cumulative CPU 6426.88 sec 2015-07-28 04:43:04,318 Stage-9 map = 100%, reduce = 27%, Cumulative CPU 4258.66 sec 2015-07-28 04:43:04,488 Stage-17 map = 93%, reduce = 0%, Cumulative CPU 6499.92 sec 2015-07-28 04:43:06,411 Stage-9 map = 100%, reduce = 28%, Cumulative CPU 4270.41 sec 2015-07-28 04:43:06,585 Stage-17 map = 94%, reduce = 1%, Cumulative CPU 6551.11 sec 2015-07-28 04:43:07,634 Stage-17 map = 95%, reduce = 1%, Cumulative CPU 6581.51 sec 2015-07-28 04:43:09,355 Stage-15 map = 100%, reduce = 9%, Cumulative CPU 3206.56 sec 2015-07-28 04:43:09,728 Stage-17 map = 96%, reduce = 1%, Cumulative CPU 6654.54 sec 2015-07-28 04:43:10,401 Stage-15 map = 100%, reduce = 10%, Cumulative CPU 3218.26 sec 2015-07-28 04:43:10,776 Stage-17 map = 97%, reduce = 1%, Cumulative CPU 6674.4 sec 2015-07-28 04:43:11,307 Stage-12 map = 14%, reduce = 0%, Cumulative CPU 9635.92 sec 2015-07-28 04:43:11,446 Stage-15 map = 100%, reduce = 13%, Cumulative CPU 3245.22 sec 2015-07-28 04:43:11,639 Stage-9 map = 100%, reduce = 31%, Cumulative CPU 4344.96 sec 2015-07-28 04:43:12,494 Stage-15 map = 100%, reduce = 16%, Cumulative CPU 3280.6 sec 2015-07-28 04:43:12,683 Stage-9 map = 100%, reduce = 34%, Cumulative CPU 4447.14 sec 2015-07-28 04:43:12,867 Stage-17 map = 97%, reduce = 2%, Cumulative CPU 6771.3 sec 2015-07-28 04:43:13,731 Stage-9 map = 100%, reduce = 36%, Cumulative CPU 4466.47 sec 2015-07-28 04:43:13,913 Stage-17 map = 98%, reduce = 2%, Cumulative CPU 6781.85 sec 2015-07-28 04:43:14,603 Stage-15 map = 100%, reduce = 18%, Cumulative CPU 3390.85 sec 2015-07-28 04:43:14,776 Stage-9 map = 100%, reduce = 39%, Cumulative CPU 4519.38 sec 2015-07-28 04:43:15,656 Stage-15 map = 100%, reduce = 20%, Cumulative CPU 3447.4 sec 2015-07-28 04:43:15,820 Stage-9 map = 100%, reduce = 42%, Cumulative CPU 4593.0 sec 2015-07-28 04:43:16,702 Stage-15 map = 100%, reduce = 21%, Cumulative CPU 3484.34 sec 2015-07-28 04:43:16,864 Stage-9 map = 100%, reduce = 44%, Cumulative CPU 4687.28 sec 2015-07-28 04:43:17,748 Stage-15 map = 100%, reduce = 23%, Cumulative CPU 3551.0 sec 2015-07-28 04:43:17,915 Stage-9 map = 100%, reduce = 47%, Cumulative CPU 4732.1 sec 2015-07-28 04:43:18,959 Stage-9 map = 100%, reduce = 48%, Cumulative CPU 4794.74 sec 2015-07-28 04:43:19,157 Stage-17 map = 99%, reduce = 2%, Cumulative CPU 6836.06 sec 2015-07-28 04:43:19,847 Stage-15 map = 100%, reduce = 24%, Cumulative CPU 3618.42 sec 2015-07-28 04:43:20,018 Stage-9 map = 100%, reduce = 49%, Cumulative CPU 4812.54 sec 2015-07-28 04:43:20,211 Stage-17 map = 99%, reduce = 3%, Cumulative CPU 6839.36 sec 2015-07-28 04:43:20,906 Stage-15 map = 100%, reduce = 25%, Cumulative CPU 3653.83 sec 2015-07-28 04:43:21,064 Stage-9 map = 100%, reduce = 50%, Cumulative CPU 4822.48 sec 2015-07-28 04:43:21,967 Stage-15 map = 100%, reduce = 26%, Cumulative CPU 3661.42 sec 2015-07-28 04:43:22,109 Stage-9 map = 100%, reduce = 52%, Cumulative CPU 4859.12 sec 2015-07-28 04:43:24,065 Stage-15 map = 100%, reduce = 27%, Cumulative CPU 3698.29 sec 2015-07-28 04:43:25,243 Stage-9 map = 100%, reduce = 54%, Cumulative CPU 4892.27 sec 2015-07-28 04:43:26,288 Stage-9 map = 100%, reduce = 56%, Cumulative CPU 4942.46 sec 2015-07-28 04:43:26,493 Stage-17 map = 99%, reduce = 4%, Cumulative CPU 6875.01 sec 2015-07-28 04:43:26,537 Stage-12 map = 15%, reduce = 0%, Cumulative CPU 10334.63 sec 2015-07-28 04:43:28,268 Stage-15 map = 100%, reduce = 28%, Cumulative CPU 3730.77 sec 2015-07-28 04:43:29,315 Stage-15 map = 100%, reduce = 30%, Cumulative CPU 3778.1 sec 2015-07-28 04:43:30,359 Stage-15 map = 100%, reduce = 31%, Cumulative CPU 3790.88 sec 2015-07-28 04:43:31,404 Stage-15 map = 100%, reduce = 34%, Cumulative CPU 3824.69 sec 2015-07-28 04:43:31,537 Stage-9 map = 100%, reduce = 59%, Cumulative CPU 4998.8 sec 2015-07-28 04:43:31,725 Stage-17 map = 99%, reduce = 5%, Cumulative CPU 6911.07 sec 2015-07-28 04:43:32,451 Stage-15 map = 100%, reduce = 35%, Cumulative CPU 3857.49 sec 2015-07-28 04:43:32,587 Stage-9 map = 100%, reduce = 63%, Cumulative CPU 5037.67 sec 2015-07-28 04:43:33,497 Stage-15 map = 100%, reduce = 38%, Cumulative CPU 3913.52 sec 2015-07-28 04:43:33,631 Stage-9 map = 100%, reduce = 65%, Cumulative CPU 5066.74 sec 2015-07-28 04:43:34,544 Stage-15 map = 100%, reduce = 41%, Cumulative CPU 3969.22 sec 2015-07-28 04:43:34,682 Stage-9 map = 100%, reduce = 68%, Cumulative CPU 5102.2 sec 2015-07-28 04:43:35,590 Stage-15 map = 100%, reduce = 43%, Cumulative CPU 4013.53 sec 2015-07-28 04:43:35,727 Stage-9 map = 100%, reduce = 71%, Cumulative CPU 5125.93 sec 2015-07-28 04:43:36,635 Stage-15 map = 100%, reduce = 45%, Cumulative CPU 4050.45 sec 2015-07-28 04:43:36,772 Stage-9 map = 100%, reduce = 72%, Cumulative CPU 5146.98 sec 2015-07-28 04:43:37,815 Stage-9 map = 100%, reduce = 73%, Cumulative CPU 5161.37 sec 2015-07-28 04:43:38,727 Stage-15 map = 100%, reduce = 46%, Cumulative CPU 4131.28 sec 2015-07-28 04:43:38,870 Stage-9 map = 100%, reduce = 74%, Cumulative CPU 5168.96 sec 2015-07-28 04:43:39,541 Stage-12 map = 16%, reduce = 0%, Cumulative CPU 10943.81 sec 2015-07-28 04:43:39,776 Stage-15 map = 100%, reduce = 47%, Cumulative CPU 4143.86 sec 2015-07-28 04:43:40,841 Stage-15 map = 100%, reduce = 48%, Cumulative CPU 4167.46 sec 2015-07-28 04:43:40,975 Stage-9 map = 100%, reduce = 75%, Cumulative CPU 5197.76 sec 2015-07-28 04:43:41,889 Stage-15 map = 100%, reduce = 49%, Cumulative CPU 4192.38 sec 2015-07-28 04:43:42,018 Stage-9 map = 100%, reduce = 76%, Cumulative CPU 5212.15 sec 2015-07-28 04:43:42,938 Stage-15 map = 100%, reduce = 50%, Cumulative CPU 4206.47 sec 2015-07-28 04:43:43,062 Stage-9 map = 100%, reduce = 77%, Cumulative CPU 5221.48 sec 2015-07-28 04:43:43,986 Stage-15 map = 100%, reduce = 51%, Cumulative CPU 4253.1 sec 2015-07-28 04:43:44,106 Stage-9 map = 100%, reduce = 78%, Cumulative CPU 5252.75 sec 2015-07-28 04:43:45,042 Stage-15 map = 100%, reduce = 52%, Cumulative CPU 4267.18 sec 2015-07-28 04:43:45,150 Stage-9 map = 100%, reduce = 82%, Cumulative CPU 5300.99 sec 2015-07-28 04:43:46,088 Stage-15 map = 100%, reduce = 53%, Cumulative CPU 4292.68 sec 2015-07-28 04:43:46,197 Stage-9 map = 100%, reduce = 83%, Cumulative CPU 5314.46 sec 2015-07-28 04:43:47,134 Stage-15 map = 100%, reduce = 54%, Cumulative CPU 4323.98 sec 2015-07-28 04:43:47,240 Stage-9 map = 100%, reduce = 86%, Cumulative CPU 5350.38 sec 2015-07-28 04:43:48,178 Stage-15 map = 100%, reduce = 56%, Cumulative CPU 4356.72 sec 2015-07-28 04:43:48,285 Stage-9 map = 100%, reduce = 88%, Cumulative CPU 5421.3 sec 2015-07-28 04:43:49,329 Stage-9 map = 100%, reduce = 89%, Cumulative CPU 5441.27 sec 2015-07-28 04:43:50,267 Stage-15 map = 100%, reduce = 57%, Cumulative CPU 4391.6 sec 2015-07-28 04:43:50,373 Stage-9 map = 100%, reduce = 90%, Cumulative CPU 5512.1 sec 2015-07-28 04:43:51,325 Stage-15 map = 100%, reduce = 58%, Cumulative CPU 4421.3 sec 2015-07-28 04:43:51,428 Stage-9 map = 100%, reduce = 91%, Cumulative CPU 5522.26 sec 2015-07-28 04:43:52,374 Stage-15 map = 100%, reduce = 59%, Cumulative CPU 4425.63 sec 2015-07-28 04:43:52,472 Stage-9 map = 100%, reduce = 92%, Cumulative CPU 5542.65 sec 2015-07-28 04:43:52,527 Stage-12 map = 17%, reduce = 0%, Cumulative CPU 11521.01 sec 2015-07-28 04:43:53,516 Stage-9 map = 100%, reduce = 93%, Cumulative CPU 5660.63 sec 2015-07-28 04:43:54,466 Stage-15 map = 100%, reduce = 60%, Cumulative CPU 4465.25 sec 2015-07-28 04:43:54,559 Stage-9 map = 100%, reduce = 94%, Cumulative CPU 5674.15 sec 2015-07-28 04:43:55,513 Stage-15 map = 100%, reduce = 61%, Cumulative CPU 4490.83 sec 2015-07-28 04:43:56,566 Stage-15 map = 100%, reduce = 63%, Cumulative CPU 4531.54 sec 2015-07-28 04:43:56,650 Stage-9 map = 100%, reduce = 95%, Cumulative CPU 5689.99 sec 2015-07-28 04:43:57,622 Stage-15 map = 100%, reduce = 65%, Cumulative CPU 4551.66 sec 2015-07-28 04:43:58,668 Stage-15 map = 100%, reduce = 66%, Cumulative CPU 4584.68 sec 2015-07-28 04:43:59,784 Stage-9 map = 100%, reduce = 96%, Cumulative CPU 5720.5 sec 2015-07-28 04:44:00,760 Stage-15 map = 100%, reduce = 67%, Cumulative CPU 4620.97 sec 2015-07-28 04:44:01,806 Stage-15 map = 100%, reduce = 70%, Cumulative CPU 4678.08 sec 2015-07-28 04:44:02,851 Stage-15 map = 100%, reduce = 72%, Cumulative CPU 4724.76 sec 2015-07-28 04:44:02,914 Stage-9 map = 100%, reduce = 97%, Cumulative CPU 5794.04 sec 2015-07-28 04:44:03,896 Stage-15 map = 100%, reduce = 73%, Cumulative CPU 4750.02 sec 2015-07-28 04:44:04,941 Stage-15 map = 100%, reduce = 74%, Cumulative CPU 4771.98 sec 2015-07-28 04:44:05,570 Stage-12 map = 18%, reduce = 0%, Cumulative CPU 12305.89 sec 2015-07-28 04:44:05,988 Stage-15 map = 100%, reduce = 77%, Cumulative CPU 4811.52 sec 2015-07-28 04:44:07,033 Stage-15 map = 100%, reduce = 78%, Cumulative CPU 4834.22 sec 2015-07-28 04:44:08,132 Stage-9 map = 100%, reduce = 98%, Cumulative CPU 5816.31 sec 2015-07-28 04:44:08,341 Stage-17 map = 99%, reduce = 6%, Cumulative CPU 7323.67 sec 2015-07-28 04:44:10,171 Stage-15 map = 100%, reduce = 79%, Cumulative CPU 4873.13 sec 2015-07-28 04:44:12,260 Stage-15 map = 100%, reduce = 81%, Cumulative CPU 4922.31 sec 2015-07-28 04:44:14,371 Stage-15 map = 100%, reduce = 84%, Cumulative CPU 4974.53 sec 2015-07-28 04:44:15,419 Stage-15 map = 100%, reduce = 86%, Cumulative CPU 5018.81 sec 2015-07-28 04:44:16,512 Stage-9 map = 100%, reduce = 99%, Cumulative CPU 5871.79 sec 2015-07-28 04:44:17,510 Stage-15 map = 100%, reduce = 87%, Cumulative CPU 5060.17 sec 2015-07-28 04:44:18,556 Stage-15 map = 100%, reduce = 89%, Cumulative CPU 5134.09 sec 2015-07-28 04:44:19,600 Stage-15 map = 100%, reduce = 90%, Cumulative CPU 5166.8 sec 2015-07-28 04:44:19,837 Stage-17 map = 99%, reduce = 7%, Cumulative CPU 7391.01 sec 2015-07-28 04:44:19,956 Stage-12 map = 19%, reduce = 0%, Cumulative CPU 13028.55 sec 2015-07-28 04:44:20,646 Stage-15 map = 100%, reduce = 92%, Cumulative CPU 5192.62 sec 2015-07-28 04:44:22,738 Stage-15 map = 100%, reduce = 94%, Cumulative CPU 5263.22 sec 2015-07-28 04:44:25,876 Stage-15 map = 100%, reduce = 95%, Cumulative CPU 5295.35 sec 2015-07-28 04:44:32,964 Stage-12 map = 20%, reduce = 0%, Cumulative CPU 13786.76 sec 2015-07-28 04:44:33,201 Stage-15 map = 100%, reduce = 96%, Cumulative CPU 5353.0 sec 2015-07-28 04:44:38,419 Stage-15 map = 100%, reduce = 97%, Cumulative CPU 5376.08 sec 2015-07-28 04:44:42,667 Stage-9 map = 100%, reduce = 100%, Cumulative CPU 6045.55 sec MapReduce Total cumulative CPU time: 0 days 1 hours 40 minutes 45 seconds 550 msec Ended Job = job_1437468004903_11183 2015-07-28 04:44:43,780 Stage-12 map = 21%, reduce = 0%, Cumulative CPU 14519.66 sec 2015-07-28 04:44:49,943 Stage-15 map = 100%, reduce = 98%, Cumulative CPU 5420.58 sec 2015-07-28 04:44:52,278 Stage-17 map = 100%, reduce = 7%, Cumulative CPU 7589.06 sec 2015-07-28 04:44:54,365 Stage-17 map = 100%, reduce = 8%, Cumulative CPU 7618.86 sec 2015-07-28 04:44:54,649 Stage-12 map = 22%, reduce = 0%, Cumulative CPU 15192.81 sec 2015-07-28 04:44:55,407 Stage-17 map = 100%, reduce = 10%, Cumulative CPU 7709.95 sec 2015-07-28 04:44:56,449 Stage-17 map = 100%, reduce = 12%, Cumulative CPU 7752.19 sec 2015-07-28 04:44:57,493 Stage-17 map = 100%, reduce = 13%, Cumulative CPU 7817.06 sec 2015-07-28 04:44:58,538 Stage-17 map = 100%, reduce = 14%, Cumulative CPU 7894.46 sec 2015-07-28 04:44:59,586 Stage-17 map = 100%, reduce = 15%, Cumulative CPU 7949.34 sec 2015-07-28 04:45:00,632 Stage-17 map = 100%, reduce = 16%, Cumulative CPU 8022.08 sec 2015-07-28 04:45:01,680 Stage-17 map = 100%, reduce = 17%, Cumulative CPU 8076.86 sec 2015-07-28 04:45:02,723 Stage-17 map = 100%, reduce = 18%, Cumulative CPU 8123.1 sec 2015-07-28 04:45:03,768 Stage-17 map = 100%, reduce = 19%, Cumulative CPU 8159.16 sec 2015-07-28 04:45:06,528 Stage-12 map = 23%, reduce = 0%, Cumulative CPU 16007.53 sec 2015-07-28 04:45:06,900 Stage-17 map = 100%, reduce = 20%, Cumulative CPU 8203.56 sec 2015-07-28 04:45:07,708 Stage-15 map = 100%, reduce = 99%, Cumulative CPU 5470.72 sec 2015-07-28 04:45:13,155 Stage-17 map = 100%, reduce = 21%, Cumulative CPU 8241.73 sec 2015-07-28 04:45:16,248 Stage-12 map = 24%, reduce = 0%, Cumulative CPU 16508.26 sec 2015-07-28 04:45:17,333 Stage-17 map = 100%, reduce = 22%, Cumulative CPU 8295.47 sec 2015-07-28 04:45:18,376 Stage-17 map = 100%, reduce = 23%, Cumulative CPU 8305.71 sec 2015-07-28 04:45:19,424 Stage-17 map = 100%, reduce = 24%, Cumulative CPU 8362.22 sec 2015-07-28 04:45:20,478 Stage-17 map = 100%, reduce = 25%, Cumulative CPU 8407.45 sec 2015-07-28 04:45:21,524 Stage-17 map = 100%, reduce = 27%, Cumulative CPU 8485.46 sec 2015-07-28 04:45:22,568 Stage-17 map = 100%, reduce = 28%, Cumulative CPU 8529.75 sec 2015-07-28 04:45:23,612 Stage-17 map = 100%, reduce = 29%, Cumulative CPU 8585.75 sec 2015-07-28 04:45:24,654 Stage-17 map = 100%, reduce = 30%, Cumulative CPU 8651.53 sec 2015-07-28 04:45:25,699 Stage-17 map = 100%, reduce = 31%, Cumulative CPU 8699.78 sec 2015-07-28 04:45:26,748 Stage-17 map = 100%, reduce = 33%, Cumulative CPU 8760.45 sec 2015-07-28 04:45:27,797 Stage-17 map = 100%, reduce = 34%, Cumulative CPU 8801.86 sec 2015-07-28 04:45:29,897 Stage-17 map = 100%, reduce = 35%, Cumulative CPU 8898.57 sec 2015-07-28 04:45:29,906 Stage-12 map = 25%, reduce = 0%, Cumulative CPU 17181.25 sec 2015-07-28 04:45:30,954 Stage-17 map = 100%, reduce = 36%, Cumulative CPU 8960.78 sec 2015-07-28 04:45:32,000 Stage-17 map = 100%, reduce = 37%, Cumulative CPU 9062.17 sec 2015-07-28 04:45:34,088 Stage-17 map = 100%, reduce = 38%, Cumulative CPU 9134.55 sec 2015-07-28 04:45:35,130 Stage-17 map = 100%, reduce = 39%, Cumulative CPU 9168.26 sec 2015-07-28 04:45:37,219 Stage-17 map = 100%, reduce = 40%, Cumulative CPU 9210.25 sec 2015-07-28 04:45:38,263 Stage-17 map = 100%, reduce = 41%, Cumulative CPU 9246.0 sec 2015-07-28 04:45:41,201 Stage-15 map = 100%, reduce = 100%, Cumulative CPU 5511.17 sec 2015-07-28 04:45:41,392 Stage-17 map = 100%, reduce = 42%, Cumulative CPU 9298.86 sec 2015-07-28 04:45:41,953 Stage-12 map = 26%, reduce = 0%, Cumulative CPU 17791.65 sec MapReduce Total cumulative CPU time: 0 days 1 hours 31 minutes 51 seconds 170 msec Ended Job = job_1437468004903_11214 2015-07-28 04:45:43,478 Stage-17 map = 100%, reduce = 43%, Cumulative CPU 9344.05 sec 2015-07-28 04:45:44,528 Stage-17 map = 100%, reduce = 44%, Cumulative CPU 9384.55 sec 2015-07-28 04:45:45,557 Stage-17 map = 100%, reduce = 45%, Cumulative CPU 9404.09 sec 2015-07-28 04:45:47,493 Stage-17 map = 100%, reduce = 46%, Cumulative CPU 9492.39 sec 2015-07-28 04:45:48,540 Stage-17 map = 100%, reduce = 47%, Cumulative CPU 9550.77 sec 2015-07-28 04:45:50,645 Stage-17 map = 100%, reduce = 48%, Cumulative CPU 9654.11 sec 2015-07-28 04:45:51,689 Stage-17 map = 100%, reduce = 49%, Cumulative CPU 9681.97 sec 2015-07-28 04:45:53,776 Stage-17 map = 100%, reduce = 50%, Cumulative CPU 9748.92 sec 2015-07-28 04:45:54,093 Stage-12 map = 27%, reduce = 0%, Cumulative CPU 18457.52 sec 2015-07-28 04:45:54,822 Stage-17 map = 100%, reduce = 51%, Cumulative CPU 9769.05 sec 2015-07-28 04:45:55,872 Stage-17 map = 100%, reduce = 52%, Cumulative CPU 9807.77 sec 2015-07-28 04:45:56,917 Stage-17 map = 100%, reduce = 53%, Cumulative CPU 9843.93 sec 2015-07-28 04:45:59,005 Stage-17 map = 100%, reduce = 54%, Cumulative CPU 9911.64 sec 2015-07-28 04:46:00,059 Stage-17 map = 100%, reduce = 55%, Cumulative CPU 9955.44 sec 2015-07-28 04:46:01,106 Stage-17 map = 100%, reduce = 56%, Cumulative CPU 10017.14 sec 2015-07-28 04:46:02,162 Stage-17 map = 100%, reduce = 57%, Cumulative CPU 10062.15 sec 2015-07-28 04:46:03,210 Stage-17 map = 100%, reduce = 58%, Cumulative CPU 10102.59 sec 2015-07-28 04:46:04,262 Stage-17 map = 100%, reduce = 59%, Cumulative CPU 10161.31 sec 2015-07-28 04:46:05,307 Stage-17 map = 100%, reduce = 60%, Cumulative CPU 10193.31 sec 2015-07-28 04:46:07,396 Stage-17 map = 100%, reduce = 61%, Cumulative CPU 10263.52 sec 2015-07-28 04:46:09,484 Stage-17 map = 100%, reduce = 62%, Cumulative CPU 10331.37 sec 2015-07-28 04:46:11,583 Stage-17 map = 100%, reduce = 63%, Cumulative CPU 10377.62 sec 2015-07-28 04:46:12,618 Stage-12 map = 28%, reduce = 0%, Cumulative CPU 19255.29 sec 2015-07-28 04:46:12,627 Stage-17 map = 100%, reduce = 64%, Cumulative CPU 10400.23 sec 2015-07-28 04:46:15,757 Stage-17 map = 100%, reduce = 65%, Cumulative CPU 10469.92 sec 2015-07-28 04:46:16,802 Stage-17 map = 100%, reduce = 66%, Cumulative CPU 10499.51 sec 2015-07-28 04:46:19,940 Stage-17 map = 100%, reduce = 67%, Cumulative CPU 10619.17 sec 2015-07-28 04:46:20,982 Stage-17 map = 100%, reduce = 68%, Cumulative CPU 10678.42 sec 2015-07-28 04:46:22,030 Stage-17 map = 100%, reduce = 69%, Cumulative CPU 10721.14 sec 2015-07-28 04:46:25,167 Stage-17 map = 100%, reduce = 70%, Cumulative CPU 10795.41 sec 2015-07-28 04:46:26,212 Stage-17 map = 100%, reduce = 71%, Cumulative CPU 10905.55 sec 2015-07-28 04:46:26,300 Stage-12 map = 29%, reduce = 0%, Cumulative CPU 19908.52 sec 2015-07-28 04:46:27,255 Stage-17 map = 100%, reduce = 72%, Cumulative CPU 10926.0 sec 2015-07-28 04:46:29,342 Stage-17 map = 100%, reduce = 74%, Cumulative CPU 11069.76 sec 2015-07-28 04:46:30,393 Stage-17 map = 100%, reduce = 76%, Cumulative CPU 11127.12 sec 2015-07-28 04:46:32,491 Stage-17 map = 100%, reduce = 77%, Cumulative CPU 11219.16 sec 2015-07-28 04:46:33,539 Stage-17 map = 100%, reduce = 78%, Cumulative CPU 11276.64 sec 2015-07-28 04:46:35,693 Stage-17 map = 100%, reduce = 79%, Cumulative CPU 11358.81 sec 2015-07-28 04:46:36,766 Stage-17 map = 100%, reduce = 80%, Cumulative CPU 11413.72 sec 2015-07-28 04:46:37,812 Stage-17 map = 100%, reduce = 81%, Cumulative CPU 11437.33 sec 2015-07-28 04:46:40,939 Stage-17 map = 100%, reduce = 82%, Cumulative CPU 11514.49 sec 2015-07-28 04:46:41,983 Stage-17 map = 100%, reduce = 83%, Cumulative CPU 11522.68 sec 2015-07-28 04:46:43,028 Stage-17 map = 100%, reduce = 84%, Cumulative CPU 11568.64 sec 2015-07-28 04:46:43,416 Stage-12 map = 30%, reduce = 0%, Cumulative CPU 20788.19 sec 2015-07-28 04:46:45,117 Stage-17 map = 100%, reduce = 85%, Cumulative CPU 11623.27 sec 2015-07-28 04:46:47,205 Stage-17 map = 100%, reduce = 86%, Cumulative CPU 11658.77 sec 2015-07-28 04:46:48,258 Stage-17 map = 100%, reduce = 87%, Cumulative CPU 11702.75 sec 2015-07-28 04:46:49,302 Stage-17 map = 100%, reduce = 88%, Cumulative CPU 11733.23 sec 2015-07-28 04:46:50,349 Stage-17 map = 100%, reduce = 89%, Cumulative CPU 11779.95 sec 2015-07-28 04:46:51,399 Stage-17 map = 100%, reduce = 90%, Cumulative CPU 11829.39 sec 2015-07-28 04:46:52,454 Stage-17 map = 100%, reduce = 91%, Cumulative CPU 11865.59 sec 2015-07-28 04:46:53,813 Stage-12 map = 31%, reduce = 0%, Cumulative CPU 21253.15 sec 2015-07-28 04:46:54,542 Stage-17 map = 100%, reduce = 92%, Cumulative CPU 11981.44 sec 2015-07-28 04:46:55,590 Stage-17 map = 100%, reduce = 93%, Cumulative CPU 12006.53 sec 2015-07-28 04:46:57,680 Stage-17 map = 100%, reduce = 94%, Cumulative CPU 12091.59 sec 2015-07-28 04:46:58,725 Stage-17 map = 100%, reduce = 95%, Cumulative CPU 12119.89 sec 2015-07-28 04:47:01,858 Stage-17 map = 100%, reduce = 96%, Cumulative CPU 12212.24 sec 2015-07-28 04:47:04,998 Stage-17 map = 100%, reduce = 97%, Cumulative CPU 12274.07 sec 2015-07-28 04:47:07,086 Stage-17 map = 100%, reduce = 98%, Cumulative CPU 12306.5 sec 2015-07-28 04:47:09,045 Stage-12 map = 32%, reduce = 0%, Cumulative CPU 22206.72 sec 2015-07-28 04:47:14,393 Stage-17 map = 100%, reduce = 99%, Cumulative CPU 12378.39 sec 2015-07-28 04:47:22,862 Stage-12 map = 33%, reduce = 0%, Cumulative CPU 22956.7 sec 2015-07-28 04:47:31,460 Stage-12 map = 34%, reduce = 0%, Cumulative CPU 23552.85 sec 2015-07-28 04:47:44,679 Stage-12 map = 35%, reduce = 0%, Cumulative CPU 24317.21 sec 2015-07-28 04:47:54,920 Stage-12 map = 36%, reduce = 0%, Cumulative CPU 25153.64 sec 2015-07-28 04:48:05,779 Stage-12 map = 37%, reduce = 0%, Cumulative CPU 25707.06 sec 2015-07-28 04:48:14,901 Stage-17 map = 100%, reduce = 99%, Cumulative CPU 12495.82 sec 2015-07-28 04:48:17,784 Stage-12 map = 38%, reduce = 0%, Cumulative CPU 26491.58 sec 2015-07-28 04:48:28,240 Stage-12 map = 39%, reduce = 0%, Cumulative CPU 27092.14 sec 2015-07-28 04:48:28,485 Stage-17 map = 100%, reduce = 100%, Cumulative CPU 12522.38 sec MapReduce Total cumulative CPU time: 0 days 3 hours 28 minutes 42 seconds 380 msec Ended Job = job_1437468004903_11218 Launching Job 16 out of 17 Number of reduce tasks not specified. Estimated from input data size: 12 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapreduce.job.reduces= Starting Job = job_1437468004903_11247, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11247/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11247 2015-07-28 04:48:44,380 Stage-12 map = 40%, reduce = 0%, Cumulative CPU 27625.08 sec 2015-07-28 04:49:01,607 Stage-12 map = 41%, reduce = 0%, Cumulative CPU 28542.9 sec 2015-07-28 04:49:08,187 Stage-12 map = 42%, reduce = 0%, Cumulative CPU 29179.03 sec Hadoop job information for Stage-16: number of mappers: 73; number of reducers: 12 2015-07-28 04:49:10,332 Stage-16 map = 0%, reduce = 0% 2015-07-28 04:49:21,346 Stage-16 map = 1%, reduce = 0%, Cumulative CPU 7.16 sec 2015-07-28 04:49:22,406 Stage-16 map = 3%, reduce = 0%, Cumulative CPU 17.19 sec 2015-07-28 04:49:22,568 Stage-12 map = 43%, reduce = 0%, Cumulative CPU 29996.7 sec 2015-07-28 04:49:23,465 Stage-16 map = 4%, reduce = 0%, Cumulative CPU 28.18 sec 2015-07-28 04:49:24,519 Stage-16 map = 5%, reduce = 0%, Cumulative CPU 37.98 sec 2015-07-28 04:49:25,588 Stage-16 map = 7%, reduce = 0%, Cumulative CPU 67.21 sec 2015-07-28 04:49:26,643 Stage-16 map = 9%, reduce = 0%, Cumulative CPU 185.74 sec 2015-07-28 04:49:27,695 Stage-16 map = 12%, reduce = 0%, Cumulative CPU 291.37 sec 2015-07-28 04:49:28,759 Stage-16 map = 15%, reduce = 0%, Cumulative CPU 416.93 sec 2015-07-28 04:49:29,814 Stage-16 map = 20%, reduce = 0%, Cumulative CPU 497.43 sec 2015-07-28 04:49:30,870 Stage-16 map = 23%, reduce = 0%, Cumulative CPU 575.32 sec 2015-07-28 04:49:31,923 Stage-16 map = 28%, reduce = 0%, Cumulative CPU 742.56 sec 2015-07-28 04:49:32,690 Stage-12 map = 44%, reduce = 0%, Cumulative CPU 30613.18 sec 2015-07-28 04:49:32,974 Stage-16 map = 34%, reduce = 0%, Cumulative CPU 841.4 sec 2015-07-28 04:49:34,028 Stage-16 map = 37%, reduce = 0%, Cumulative CPU 886.18 sec 2015-07-28 04:49:35,086 Stage-16 map = 41%, reduce = 0%, Cumulative CPU 982.03 sec 2015-07-28 04:49:36,152 Stage-16 map = 48%, reduce = 0%, Cumulative CPU 1126.13 sec 2015-07-28 04:49:37,207 Stage-16 map = 53%, reduce = 0%, Cumulative CPU 1165.8 sec 2015-07-28 04:49:38,268 Stage-16 map = 58%, reduce = 0%, Cumulative CPU 1234.34 sec 2015-07-28 04:49:39,318 Stage-16 map = 62%, reduce = 0%, Cumulative CPU 1268.31 sec 2015-07-28 04:49:40,367 Stage-16 map = 65%, reduce = 0%, Cumulative CPU 1310.44 sec 2015-07-28 04:49:41,420 Stage-16 map = 71%, reduce = 0%, Cumulative CPU 1379.79 sec 2015-07-28 04:49:42,472 Stage-16 map = 74%, reduce = 0%, Cumulative CPU 1431.39 sec 2015-07-28 04:49:43,522 Stage-16 map = 77%, reduce = 0%, Cumulative CPU 1506.59 sec 2015-07-28 04:49:44,573 Stage-16 map = 80%, reduce = 0%, Cumulative CPU 1539.47 sec 2015-07-28 04:49:45,630 Stage-16 map = 83%, reduce = 0%, Cumulative CPU 1566.17 sec 2015-07-28 04:49:46,678 Stage-16 map = 84%, reduce = 0%, Cumulative CPU 1576.84 sec 2015-07-28 04:49:46,896 Stage-12 map = 45%, reduce = 0%, Cumulative CPU 31448.59 sec 2015-07-28 04:49:47,726 Stage-16 map = 85%, reduce = 0%, Cumulative CPU 1598.25 sec 2015-07-28 04:49:48,770 Stage-16 map = 87%, reduce = 0%, Cumulative CPU 1607.92 sec 2015-07-28 04:49:49,816 Stage-16 map = 90%, reduce = 0%, Cumulative CPU 1634.14 sec 2015-07-28 04:49:58,205 Stage-16 map = 91%, reduce = 0%, Cumulative CPU 1656.62 sec 2015-07-28 04:49:59,256 Stage-16 map = 91%, reduce = 2%, Cumulative CPU 1658.68 sec 2015-07-28 04:49:59,686 Stage-12 map = 46%, reduce = 0%, Cumulative CPU 32310.63 sec 2015-07-28 04:50:00,314 Stage-16 map = 91%, reduce = 5%, Cumulative CPU 1681.92 sec 2015-07-28 04:50:02,423 Stage-16 map = 91%, reduce = 7%, Cumulative CPU 1688.95 sec 2015-07-28 04:50:03,453 Stage-16 map = 91%, reduce = 13%, Cumulative CPU 1699.99 sec 2015-07-28 04:50:04,482 Stage-16 map = 91%, reduce = 15%, Cumulative CPU 1709.18 sec 2015-07-28 04:50:05,512 Stage-16 map = 91%, reduce = 20%, Cumulative CPU 1753.3 sec 2015-07-28 04:50:07,593 Stage-16 map = 91%, reduce = 23%, Cumulative CPU 1769.25 sec 2015-07-28 04:50:08,653 Stage-12 map = 47%, reduce = 0%, Cumulative CPU 32855.15 sec 2015-07-28 04:50:09,688 Stage-16 map = 91%, reduce = 25%, Cumulative CPU 1787.93 sec 2015-07-28 04:50:10,745 Stage-16 map = 92%, reduce = 28%, Cumulative CPU 1803.48 sec 2015-07-28 04:50:24,181 Stage-12 map = 48%, reduce = 0%, Cumulative CPU 33823.71 sec 2015-07-28 04:50:29,610 Stage-16 map = 92%, reduce = 31%, Cumulative CPU 2023.8 sec 2015-07-28 04:50:34,141 Stage-12 map = 49%, reduce = 0%, Cumulative CPU 34685.89 sec 2015-07-28 04:50:34,832 Stage-16 map = 93%, reduce = 31%, Cumulative CPU 2038.63 sec 2015-07-28 04:50:41,127 Stage-16 map = 94%, reduce = 31%, Cumulative CPU 2058.3 sec 2015-07-28 04:50:49,822 Stage-12 map = 50%, reduce = 0%, Cumulative CPU 35411.53 sec 2015-07-28 04:50:50,532 Stage-16 map = 95%, reduce = 31%, Cumulative CPU 2170.24 sec 2015-07-28 04:50:53,679 Stage-16 map = 96%, reduce = 31%, Cumulative CPU 2199.13 sec 2015-07-28 04:50:57,825 Stage-12 map = 51%, reduce = 0%, Cumulative CPU 36101.78 sec 2015-07-28 04:50:57,877 Stage-16 map = 97%, reduce = 31%, Cumulative CPU 2212.97 sec 2015-07-28 04:50:58,918 Stage-16 map = 97%, reduce = 32%, Cumulative CPU 2213.58 sec 2015-07-28 04:51:02,055 Stage-16 map = 98%, reduce = 32%, Cumulative CPU 2231.59 sec 2015-07-28 04:51:08,939 Stage-12 map = 52%, reduce = 0%, Cumulative CPU 36760.1 sec 2015-07-28 04:51:10,401 Stage-16 map = 99%, reduce = 32%, Cumulative CPU 2249.06 sec 2015-07-28 04:51:19,506 Stage-12 map = 53%, reduce = 0%, Cumulative CPU 37388.22 sec 2015-07-28 04:51:19,757 Stage-16 map = 99%, reduce = 33%, Cumulative CPU 2265.57 sec 2015-07-28 04:51:24,984 Stage-16 map = 100%, reduce = 33%, Cumulative CPU 2267.17 sec 2015-07-28 04:51:27,059 Stage-16 map = 100%, reduce = 34%, Cumulative CPU 2284.66 sec 2015-07-28 04:51:28,092 Stage-16 map = 100%, reduce = 38%, Cumulative CPU 2290.32 sec 2015-07-28 04:51:29,139 Stage-16 map = 100%, reduce = 48%, Cumulative CPU 2310.42 sec 2015-07-28 04:51:29,767 Stage-12 map = 54%, reduce = 0%, Cumulative CPU 38036.3 sec 2015-07-28 04:51:30,183 Stage-16 map = 100%, reduce = 54%, Cumulative CPU 2324.0 sec 2015-07-28 04:51:31,224 Stage-16 map = 100%, reduce = 56%, Cumulative CPU 2327.08 sec 2015-07-28 04:51:32,253 Stage-16 map = 100%, reduce = 64%, Cumulative CPU 2350.41 sec 2015-07-28 04:51:33,297 Stage-16 map = 100%, reduce = 68%, Cumulative CPU 2359.96 sec 2015-07-28 04:51:35,386 Stage-16 map = 100%, reduce = 72%, Cumulative CPU 2381.32 sec 2015-07-28 04:51:36,429 Stage-16 map = 100%, reduce = 73%, Cumulative CPU 2410.71 sec 2015-07-28 04:51:38,513 Stage-16 map = 100%, reduce = 76%, Cumulative CPU 2427.55 sec 2015-07-28 04:51:39,558 Stage-16 map = 100%, reduce = 79%, Cumulative CPU 2443.38 sec 2015-07-28 04:51:41,651 Stage-16 map = 100%, reduce = 82%, Cumulative CPU 2470.76 sec 2015-07-28 04:51:41,804 Stage-12 map = 55%, reduce = 0%, Cumulative CPU 38870.69 sec 2015-07-28 04:51:42,696 Stage-16 map = 100%, reduce = 85%, Cumulative CPU 2480.69 sec 2015-07-28 04:51:44,789 Stage-16 map = 100%, reduce = 88%, Cumulative CPU 2501.3 sec 2015-07-28 04:51:46,890 Stage-16 map = 100%, reduce = 89%, Cumulative CPU 2503.97 sec 2015-07-28 04:51:47,939 Stage-16 map = 100%, reduce = 92%, Cumulative CPU 2524.92 sec 2015-07-28 04:51:50,032 Stage-16 map = 100%, reduce = 95%, Cumulative CPU 2530.23 sec 2015-07-28 04:51:50,624 Stage-12 map = 56%, reduce = 0%, Cumulative CPU 39619.15 sec 2015-07-28 04:51:51,090 Stage-16 map = 100%, reduce = 96%, Cumulative CPU 2538.4 sec 2015-07-28 04:51:52,142 Stage-16 map = 100%, reduce = 97%, Cumulative CPU 2541.21 sec 2015-07-28 04:51:53,185 Stage-16 map = 100%, reduce = 98%, Cumulative CPU 2544.66 sec 2015-07-28 04:51:54,231 Stage-16 map = 100%, reduce = 99%, Cumulative CPU 2551.03 sec 2015-07-28 04:51:59,702 Stage-12 map = 57%, reduce = 0%, Cumulative CPU 40272.7 sec 2015-07-28 04:52:00,496 Stage-16 map = 100%, reduce = 100%, Cumulative CPU 2563.95 sec MapReduce Total cumulative CPU time: 42 minutes 43 seconds 950 msec Ended Job = job_1437468004903_11247 2015-07-28 04:52:10,784 Stage-12 map = 58%, reduce = 0%, Cumulative CPU 40971.06 sec 2015-07-28 04:52:18,536 Stage-12 map = 59%, reduce = 0%, Cumulative CPU 41476.91 sec 2015-07-28 04:52:27,634 Stage-12 map = 60%, reduce = 0%, Cumulative CPU 42162.59 sec 2015-07-28 04:52:35,988 Stage-12 map = 61%, reduce = 0%, Cumulative CPU 42574.82 sec 2015-07-28 04:52:45,059 Stage-12 map = 62%, reduce = 0%, Cumulative CPU 43295.71 sec 2015-07-28 04:52:53,951 Stage-12 map = 63%, reduce = 0%, Cumulative CPU 43897.5 sec 2015-07-28 04:53:02,965 Stage-12 map = 64%, reduce = 0%, Cumulative CPU 44821.72 sec 2015-07-28 04:53:09,576 Stage-12 map = 65%, reduce = 0%, Cumulative CPU 45471.22 sec 2015-07-28 04:53:20,088 Stage-12 map = 66%, reduce = 0%, Cumulative CPU 46269.19 sec 2015-07-28 04:53:24,505 Stage-12 map = 67%, reduce = 0%, Cumulative CPU 46714.18 sec 2015-07-28 04:53:33,340 Stage-12 map = 68%, reduce = 0%, Cumulative CPU 47385.95 sec 2015-07-28 04:53:37,764 Stage-12 map = 69%, reduce = 0%, Cumulative CPU 47803.84 sec 2015-07-28 04:53:53,833 Stage-12 map = 71%, reduce = 0%, Cumulative CPU 48809.67 sec 2015-07-28 04:54:08,170 Stage-12 map = 72%, reduce = 0%, Cumulative CPU 49882.44 sec 2015-07-28 04:54:14,928 Stage-12 map = 73%, reduce = 0%, Cumulative CPU 50598.95 sec 2015-07-28 04:54:21,611 Stage-12 map = 74%, reduce = 0%, Cumulative CPU 51140.62 sec 2015-07-28 04:54:31,027 Stage-12 map = 75%, reduce = 0%, Cumulative CPU 51997.64 sec 2015-07-28 04:54:39,114 Stage-12 map = 76%, reduce = 0%, Cumulative CPU 52444.37 sec 2015-07-28 04:54:46,925 Stage-12 map = 77%, reduce = 0%, Cumulative CPU 53212.35 sec 2015-07-28 04:54:55,781 Stage-12 map = 78%, reduce = 0%, Cumulative CPU 53951.87 sec 2015-07-28 04:55:06,982 Stage-12 map = 78%, reduce = 1%, Cumulative CPU 54576.27 sec 2015-07-28 04:55:12,502 Stage-12 map = 79%, reduce = 1%, Cumulative CPU 54901.66 sec 2015-07-28 04:55:26,362 Stage-12 map = 80%, reduce = 1%, Cumulative CPU 55628.37 sec 2015-07-28 04:55:37,957 Stage-12 map = 81%, reduce = 1%, Cumulative CPU 56178.23 sec 2015-07-28 04:55:51,616 Stage-12 map = 82%, reduce = 1%, Cumulative CPU 56995.25 sec 2015-07-28 04:56:06,646 Stage-12 map = 83%, reduce = 1%, Cumulative CPU 58015.29 sec 2015-07-28 04:56:19,113 Stage-12 map = 84%, reduce = 1%, Cumulative CPU 58628.85 sec 2015-07-28 04:56:30,257 Stage-12 map = 85%, reduce = 1%, Cumulative CPU 59385.5 sec 2015-07-28 04:56:43,526 Stage-12 map = 86%, reduce = 1%, Cumulative CPU 60021.19 sec 2015-07-28 04:56:55,650 Stage-12 map = 87%, reduce = 1%, Cumulative CPU 60844.21 sec 2015-07-28 04:57:08,052 Stage-12 map = 88%, reduce = 1%, Cumulative CPU 61779.79 sec 2015-07-28 04:57:16,954 Stage-12 map = 89%, reduce = 1%, Cumulative CPU 62342.52 sec 2015-07-28 04:57:30,360 Stage-12 map = 90%, reduce = 1%, Cumulative CPU 63051.57 sec 2015-07-28 04:57:42,441 Stage-12 map = 91%, reduce = 1%, Cumulative CPU 64021.67 sec 2015-07-28 04:57:53,308 Stage-12 map = 92%, reduce = 1%, Cumulative CPU 64726.46 sec 2015-07-28 04:58:06,317 Stage-12 map = 93%, reduce = 1%, Cumulative CPU 65643.2 sec 2015-07-28 04:58:19,464 Stage-12 map = 94%, reduce = 1%, Cumulative CPU 66305.47 sec 2015-07-28 04:58:32,674 Stage-12 map = 95%, reduce = 1%, Cumulative CPU 67146.52 sec 2015-07-28 04:58:43,688 Stage-12 map = 96%, reduce = 1%, Cumulative CPU 67679.79 sec 2015-07-28 04:58:57,068 Stage-12 map = 97%, reduce = 1%, Cumulative CPU 68457.73 sec 2015-07-28 04:59:11,325 Stage-12 map = 98%, reduce = 1%, Cumulative CPU 69269.49 sec 2015-07-28 04:59:19,979 Stage-12 map = 99%, reduce = 1%, Cumulative CPU 69848.23 sec 2015-07-28 04:59:36,299 Stage-12 map = 99%, reduce = 2%, Cumulative CPU 70739.66 sec 2015-07-28 05:00:37,189 Stage-12 map = 99%, reduce = 2%, Cumulative CPU 71800.25 sec 2015-07-28 05:00:46,387 Stage-12 map = 99%, reduce = 3%, Cumulative CPU 71950.75 sec 2015-07-28 05:01:05,803 Stage-12 map = 100%, reduce = 3%, Cumulative CPU 72387.83 sec 2015-07-28 05:01:07,992 Stage-12 map = 100%, reduce = 6%, Cumulative CPU 72534.08 sec 2015-07-28 05:01:09,279 Stage-12 map = 100%, reduce = 8%, Cumulative CPU 72625.12 sec 2015-07-28 05:01:10,442 Stage-12 map = 100%, reduce = 9%, Cumulative CPU 72695.43 sec 2015-07-28 05:01:17,102 Stage-12 map = 100%, reduce = 10%, Cumulative CPU 72918.39 sec 2015-07-28 05:01:20,381 Stage-12 map = 100%, reduce = 12%, Cumulative CPU 73199.11 sec 2015-07-28 05:01:21,469 Stage-12 map = 100%, reduce = 13%, Cumulative CPU 73284.33 sec 2015-07-28 05:01:22,595 Stage-12 map = 100%, reduce = 14%, Cumulative CPU 73404.02 sec 2015-07-28 05:01:23,707 Stage-12 map = 100%, reduce = 15%, Cumulative CPU 73542.4 sec 2015-07-28 05:01:24,836 Stage-12 map = 100%, reduce = 16%, Cumulative CPU 73619.43 sec 2015-07-28 05:01:27,099 Stage-12 map = 100%, reduce = 17%, Cumulative CPU 73744.81 sec 2015-07-28 05:01:30,426 Stage-12 map = 100%, reduce = 18%, Cumulative CPU 73879.5 sec 2015-07-28 05:01:32,628 Stage-12 map = 100%, reduce = 19%, Cumulative CPU 73990.73 sec 2015-07-28 05:01:33,725 Stage-12 map = 100%, reduce = 20%, Cumulative CPU 74136.64 sec 2015-07-28 05:01:35,941 Stage-12 map = 100%, reduce = 21%, Cumulative CPU 74363.82 sec 2015-07-28 05:01:37,087 Stage-12 map = 100%, reduce = 22%, Cumulative CPU 74488.37 sec 2015-07-28 05:01:41,615 Stage-12 map = 100%, reduce = 24%, Cumulative CPU 74741.41 sec 2015-07-28 05:01:43,804 Stage-12 map = 100%, reduce = 25%, Cumulative CPU 75065.57 sec 2015-07-28 05:01:44,902 Stage-12 map = 100%, reduce = 26%, Cumulative CPU 75211.68 sec 2015-07-28 05:01:46,088 Stage-12 map = 100%, reduce = 27%, Cumulative CPU 75435.48 sec 2015-07-28 05:01:48,345 Stage-12 map = 100%, reduce = 28%, Cumulative CPU 75601.82 sec 2015-07-28 05:01:49,480 Stage-12 map = 100%, reduce = 29%, Cumulative CPU 75671.88 sec 2015-07-28 05:01:51,864 Stage-12 map = 100%, reduce = 30%, Cumulative CPU 75867.59 sec 2015-07-28 05:01:54,234 Stage-12 map = 100%, reduce = 31%, Cumulative CPU 76103.67 sec 2015-07-28 05:01:55,358 Stage-12 map = 100%, reduce = 32%, Cumulative CPU 76172.65 sec 2015-07-28 05:01:58,660 Stage-12 map = 100%, reduce = 33%, Cumulative CPU 76596.89 sec 2015-07-28 05:02:00,241 Stage-12 map = 100%, reduce = 34%, Cumulative CPU 76717.47 sec 2015-07-28 05:02:01,390 Stage-12 map = 100%, reduce = 35%, Cumulative CPU 76848.22 sec 2015-07-28 05:02:03,652 Stage-12 map = 100%, reduce = 36%, Cumulative CPU 76982.06 sec 2015-07-28 05:02:08,158 Stage-12 map = 100%, reduce = 37%, Cumulative CPU 77205.14 sec 2015-07-28 05:02:11,636 Stage-12 map = 100%, reduce = 38%, Cumulative CPU 77527.53 sec 2015-07-28 05:02:13,940 Stage-12 map = 100%, reduce = 39%, Cumulative CPU 77814.83 sec 2015-07-28 05:02:15,053 Stage-12 map = 100%, reduce = 40%, Cumulative CPU 77940.07 sec 2015-07-28 05:02:16,154 Stage-12 map = 100%, reduce = 41%, Cumulative CPU 78075.71 sec 2015-07-28 05:02:17,306 Stage-12 map = 100%, reduce = 42%, Cumulative CPU 78203.09 sec 2015-07-28 05:02:20,777 Stage-12 map = 100%, reduce = 43%, Cumulative CPU 78395.53 sec 2015-07-28 05:02:22,991 Stage-12 map = 100%, reduce = 44%, Cumulative CPU 78556.31 sec 2015-07-28 05:02:24,100 Stage-12 map = 100%, reduce = 45%, Cumulative CPU 78697.45 sec 2015-07-28 05:02:25,222 Stage-12 map = 100%, reduce = 46%, Cumulative CPU 78773.95 sec 2015-07-28 05:02:27,598 Stage-12 map = 100%, reduce = 47%, Cumulative CPU 79008.1 sec 2015-07-28 05:02:30,931 Stage-12 map = 100%, reduce = 48%, Cumulative CPU 79243.91 sec 2015-07-28 05:02:32,040 Stage-12 map = 100%, reduce = 49%, Cumulative CPU 79323.07 sec 2015-07-28 05:02:33,143 Stage-12 map = 100%, reduce = 50%, Cumulative CPU 79402.86 sec 2015-07-28 05:02:34,244 Stage-12 map = 100%, reduce = 51%, Cumulative CPU 79571.11 sec 2015-07-28 05:02:36,455 Stage-12 map = 100%, reduce = 52%, Cumulative CPU 79831.04 sec 2015-07-28 05:02:38,661 Stage-12 map = 100%, reduce = 53%, Cumulative CPU 79961.44 sec 2015-07-28 05:02:40,920 Stage-12 map = 100%, reduce = 54%, Cumulative CPU 80110.05 sec 2015-07-28 05:02:44,306 Stage-12 map = 100%, reduce = 55%, Cumulative CPU 80470.39 sec 2015-07-28 05:02:45,435 Stage-12 map = 100%, reduce = 56%, Cumulative CPU 80659.94 sec 2015-07-28 05:02:46,582 Stage-12 map = 100%, reduce = 57%, Cumulative CPU 80789.19 sec 2015-07-28 05:02:47,728 Stage-12 map = 100%, reduce = 58%, Cumulative CPU 80924.3 sec 2015-07-28 05:02:50,210 Stage-12 map = 100%, reduce = 59%, Cumulative CPU 81165.51 sec 2015-07-28 05:02:52,471 Stage-12 map = 100%, reduce = 60%, Cumulative CPU 81338.12 sec 2015-07-28 05:02:54,758 Stage-12 map = 100%, reduce = 61%, Cumulative CPU 81608.71 sec 2015-07-28 05:02:57,025 Stage-12 map = 100%, reduce = 62%, Cumulative CPU 81764.72 sec 2015-07-28 05:02:58,164 Stage-12 map = 100%, reduce = 63%, Cumulative CPU 81860.79 sec 2015-07-28 05:02:59,289 Stage-12 map = 100%, reduce = 64%, Cumulative CPU 82120.32 sec 2015-07-28 05:03:00,399 Stage-12 map = 100%, reduce = 65%, Cumulative CPU 82225.68 sec 2015-07-28 05:03:02,751 Stage-12 map = 100%, reduce = 66%, Cumulative CPU 82437.88 sec 2015-07-28 05:03:06,456 Stage-12 map = 100%, reduce = 68%, Cumulative CPU 82771.52 sec 2015-07-28 05:03:09,865 Stage-12 map = 100%, reduce = 69%, Cumulative CPU 83126.12 sec 2015-07-28 05:03:10,999 Stage-12 map = 100%, reduce = 70%, Cumulative CPU 83193.38 sec 2015-07-28 05:03:13,206 Stage-12 map = 100%, reduce = 71%, Cumulative CPU 83343.09 sec 2015-07-28 05:03:17,662 Stage-12 map = 100%, reduce = 72%, Cumulative CPU 83688.31 sec 2015-07-28 05:03:22,281 Stage-12 map = 100%, reduce = 73%, Cumulative CPU 84099.02 sec 2015-07-28 05:03:25,662 Stage-12 map = 100%, reduce = 74%, Cumulative CPU 84427.49 sec 2015-07-28 05:03:26,762 Stage-12 map = 100%, reduce = 75%, Cumulative CPU 84623.67 sec 2015-07-28 05:03:27,893 Stage-12 map = 100%, reduce = 76%, Cumulative CPU 84709.05 sec 2015-07-28 05:03:29,013 Stage-12 map = 100%, reduce = 77%, Cumulative CPU 84825.44 sec 2015-07-28 05:03:31,347 Stage-12 map = 100%, reduce = 78%, Cumulative CPU 85006.47 sec 2015-07-28 05:03:34,970 Stage-12 map = 100%, reduce = 79%, Cumulative CPU 85418.37 sec 2015-07-28 05:03:40,511 Stage-12 map = 100%, reduce = 80%, Cumulative CPU 85806.51 sec 2015-07-28 05:03:45,595 Stage-12 map = 100%, reduce = 81%, Cumulative CPU 86249.14 sec 2015-07-28 05:03:50,412 Stage-12 map = 100%, reduce = 82%, Cumulative CPU 86503.24 sec 2015-07-28 05:03:52,644 Stage-12 map = 100%, reduce = 83%, Cumulative CPU 86657.55 sec 2015-07-28 05:03:54,871 Stage-12 map = 100%, reduce = 84%, Cumulative CPU 86826.99 sec 2015-07-28 05:03:59,386 Stage-12 map = 100%, reduce = 85%, Cumulative CPU 87047.21 sec 2015-07-28 05:04:02,982 Stage-12 map = 100%, reduce = 86%, Cumulative CPU 87244.28 sec 2015-07-28 05:04:05,198 Stage-12 map = 100%, reduce = 87%, Cumulative CPU 87405.94 sec 2015-07-28 05:04:07,495 Stage-12 map = 100%, reduce = 88%, Cumulative CPU 87545.78 sec 2015-07-28 05:04:09,759 Stage-12 map = 100%, reduce = 89%, Cumulative CPU 87711.37 sec 2015-07-28 05:04:12,017 Stage-12 map = 100%, reduce = 90%, Cumulative CPU 87833.69 sec 2015-07-28 05:04:16,601 Stage-12 map = 100%, reduce = 91%, Cumulative CPU 88141.89 sec 2015-07-28 05:04:18,877 Stage-12 map = 100%, reduce = 92%, Cumulative CPU 88255.59 sec 2015-07-28 05:04:22,167 Stage-12 map = 100%, reduce = 93%, Cumulative CPU 88406.88 sec 2015-07-28 05:04:24,346 Stage-12 map = 100%, reduce = 94%, Cumulative CPU 88583.87 sec 2015-07-28 05:04:25,607 Stage-12 map = 100%, reduce = 95%, Cumulative CPU 88748.45 sec 2015-07-28 05:04:28,956 Stage-12 map = 100%, reduce = 96%, Cumulative CPU 88989.96 sec 2015-07-28 05:04:31,218 Stage-12 map = 100%, reduce = 97%, Cumulative CPU 89115.95 sec 2015-07-28 05:04:35,697 Stage-12 map = 100%, reduce = 98%, Cumulative CPU 89286.1 sec 2015-07-28 05:04:49,823 Stage-12 map = 100%, reduce = 99%, Cumulative CPU 89659.53 sec 2015-07-28 05:05:50,467 Stage-12 map = 100%, reduce = 99%, Cumulative CPU 90205.19 sec 2015-07-28 05:06:51,415 Stage-12 map = 100%, reduce = 99%, Cumulative CPU 90264.19 sec 2015-07-28 05:07:52,419 Stage-12 map = 100%, reduce = 99%, Cumulative CPU 90460.59 sec 2015-07-28 05:08:53,431 Stage-12 map = 100%, reduce = 99%, Cumulative CPU 90632.33 sec 2015-07-28 05:09:53,802 Stage-12 map = 100%, reduce = 99%, Cumulative CPU 90777.73 sec 2015-07-28 05:10:54,833 Stage-12 map = 100%, reduce = 99%, Cumulative CPU 90911.75 sec 2015-07-28 05:11:55,487 Stage-12 map = 100%, reduce = 99%, Cumulative CPU 91035.93 sec 2015-07-28 05:12:56,555 Stage-12 map = 100%, reduce = 99%, Cumulative CPU 91154.48 sec 2015-07-28 05:13:57,285 Stage-12 map = 100%, reduce = 99%, Cumulative CPU 91271.34 sec 2015-07-28 05:14:57,770 Stage-12 map = 100%, reduce = 99%, Cumulative CPU 91398.03 sec 2015-07-28 05:15:58,773 Stage-12 map = 100%, reduce = 99%, Cumulative CPU 91522.09 sec 2015-07-28 05:16:59,275 Stage-12 map = 100%, reduce = 99%, Cumulative CPU 91644.66 sec 2015-07-28 05:18:00,180 Stage-12 map = 100%, reduce = 99%, Cumulative CPU 91759.26 sec 2015-07-28 05:18:10,790 Stage-12 map = 100%, reduce = 100%, Cumulative CPU 91771.48 sec MapReduce Total cumulative CPU time: 1 days 1 hours 29 minutes 31 seconds 480 msec Ended Job = job_1437468004903_11186 Launching Job 17 out of 17 Number of reduce tasks not specified. Estimated from input data size: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapreduce.job.reduces= Starting Job = job_1437468004903_11296, Tracking URL = http://bjlg-44p12-rm01:8088/proxy/application_1437468004903_11296/ Kill Command = /opt/hadoop-client//bin/hadoop job -kill job_1437468004903_11296 Hadoop job information for Stage-2: number of mappers: 91; number of reducers: 1 2015-07-28 05:18:24,402 Stage-2 map = 0%, reduce = 0% 2015-07-28 05:18:31,826 Stage-2 map = 7%, reduce = 0%, Cumulative CPU 8.29 sec 2015-07-28 05:18:32,875 Stage-2 map = 36%, reduce = 0%, Cumulative CPU 58.52 sec 2015-07-28 05:18:33,924 Stage-2 map = 45%, reduce = 0%, Cumulative CPU 78.56 sec 2015-07-28 05:18:34,971 Stage-2 map = 59%, reduce = 0%, Cumulative CPU 121.95 sec 2015-07-28 05:18:36,029 Stage-2 map = 65%, reduce = 0%, Cumulative CPU 135.68 sec 2015-07-28 05:18:37,079 Stage-2 map = 71%, reduce = 0%, Cumulative CPU 163.74 sec 2015-07-28 05:18:38,134 Stage-2 map = 77%, reduce = 0%, Cumulative CPU 217.79 sec 2015-07-28 05:18:39,185 Stage-2 map = 81%, reduce = 0%, Cumulative CPU 237.89 sec 2015-07-28 05:18:41,291 Stage-2 map = 82%, reduce = 0%, Cumulative CPU 246.55 sec 2015-07-28 05:18:42,340 Stage-2 map = 86%, reduce = 0%, Cumulative CPU 441.19 sec 2015-07-28 05:18:43,387 Stage-2 map = 89%, reduce = 0%, Cumulative CPU 532.99 sec 2015-07-28 05:18:44,431 Stage-2 map = 93%, reduce = 0%, Cumulative CPU 825.19 sec 2015-07-28 05:18:45,486 Stage-2 map = 95%, reduce = 0%, Cumulative CPU 834.59 sec 2015-07-28 05:18:46,531 Stage-2 map = 96%, reduce = 0%, Cumulative CPU 837.61 sec 2015-07-28 05:18:49,660 Stage-2 map = 96%, reduce = 32%, Cumulative CPU 838.78 sec 2015-07-28 05:18:51,768 Stage-2 map = 97%, reduce = 32%, Cumulative CPU 902.63 sec 2015-07-28 05:18:52,818 Stage-2 map = 98%, reduce = 33%, Cumulative CPU 908.36 sec 2015-07-28 05:18:56,989 Stage-2 map = 99%, reduce = 33%, Cumulative CPU 910.66 sec 2015-07-28 05:19:04,294 Stage-2 map = 100%, reduce = 33%, Cumulative CPU 927.95 sec 2015-07-28 05:19:05,344 Stage-2 map = 100%, reduce = 67%, Cumulative CPU 930.25 sec 2015-07-28 05:19:06,386 Stage-2 map = 100%, reduce = 100%, Cumulative CPU 932.05 sec MapReduce Total cumulative CPU time: 15 minutes 32 seconds 50 msec Ended Job = job_1437468004903_11296 Loading data to table default.bi_fact_client_rec_dt0 partition (l_date=2015-07-27) Partition default.bi_fact_client_rec_dt0{l_date=2015-07-27} stats: [numFiles=1, numRows=0, totalSize=48245, rawDataSize=0] MapReduce Jobs Launched: Stage-Stage-11: Map: 1 Reduce: 1 Cumulative CPU: 5.36 sec HDFS Read: 235 HDFS Write: 139 SUCCESS Stage-Stage-10: Map: 1 Reduce: 1 Cumulative CPU: 11.61 sec HDFS Read: 27875476 HDFS Write: 5510 SUCCESS Stage-Stage-6: Map: 1 Reduce: 1 Cumulative CPU: 7.48 sec HDFS Read: 235 HDFS Write: 139 SUCCESS Stage-Stage-5: Map: 1 Reduce: 1 Cumulative CPU: 9.13 sec HDFS Read: 228 HDFS Write: 139 SUCCESS Stage-Stage-13: Map: 1 Reduce: 1 Cumulative CPU: 11.48 sec HDFS Read: 235 HDFS Write: 139 SUCCESS Stage-Stage-4: Map: 4 Reduce: 3 Cumulative CPU: 196.44 sec HDFS Read: 561676000 HDFS Write: 12079 SUCCESS Stage-Stage-14: Map: 1 Reduce: 1 Cumulative CPU: 8.82 sec HDFS Read: 235 HDFS Write: 139 SUCCESS Stage-Stage-1: Map: 1 Reduce: 1 Cumulative CPU: 17.02 sec HDFS Read: 235 HDFS Write: 139 SUCCESS Stage-Stage-18: Map: 1 Cumulative CPU: 3.56 sec HDFS Read: 581 HDFS Write: 139 SUCCESS Stage-Stage-8: Map: 1 Reduce: 1 Cumulative CPU: 5.73 sec HDFS Read: 581 HDFS Write: 139 SUCCESS Stage-Stage-9: Map: 101 Reduce: 120 Cumulative CPU: 6045.55 sec HDFS Read: 30532966924 HDFS Write: 32043 SUCCESS Stage-Stage-15: Map: 101 Reduce: 120 Cumulative CPU: 5511.17 sec HDFS Read: 30532966924 HDFS Write: 872401571 SUCCESS Stage-Stage-17: Map: 187 Reduce: 205 Cumulative CPU: 12522.38 sec HDFS Read: 52399454977 HDFS Write: 2086875621 SUCCESS Stage-Stage-16: Map: 73 Reduce: 12 Cumulative CPU: 2563.95 sec HDFS Read: 2959384302 HDFS Write: 27878 SUCCESS Stage-Stage-12: Map: 2529 Reduce: 1009 Cumulative CPU: 91773.15 sec HDFS Read: 769664718944 HDFS Write: 155344 SUCCESS Stage-Stage-2: Map: 91 Reduce: 1 Cumulative CPU: 932.05 sec HDFS Read: 588294 HDFS Write: 48245 SUCCESS Total MapReduce CPU Time Spent: 1 days 9 hours 13 minutes 44 seconds 880 msec task BFD_JOB_TASK_170_20150728043838 is complete.