Beginning test run at 1381798977 Configuration file fork factor: 5 INFO: ./test_harness.pl at 578 : Loading configuration file /Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/tests/serverstatus.conf INFO ./test_harness.pl: hadoopversion=${hadoopversion} INFO ./test_harness.pl: harnessCfg=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/conf/default.conf INFO ./test_harness.pl: tmpPath=/tmp/pigtest INFO ./test_harness.pl: UID=1381798977 INFO ./test_harness.pl: harness.console.level=ERROR INFO ./test_harness.pl: logDir=./log INFO ./test_harness.pl: localoutpathbase=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/testdist/ INFO ./test_harness.pl: outpathbase=/tmp/templeton_test_out INFO ./test_harness.pl: local.bin=/usr/bin INFO ./test_harness.pl: userhomePath=/Users/ekoifman INFO ./test_harness.pl: logfile=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/testdist//test_harnesss_1381798977 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , PUT , -o , /tmp/ekoifman.1381798977/_.res_body , -D , /tmp/ekoifman.1381798977/_.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/?op=MKDIRS&permission=777&user.name=ekoifman result : ( "body", "{\"boolean\":true}", "rc", 0, "stderr", undef, "header_fields", {}, "full_header", "", "stdout", undef, )INFO TestDriverCurl::run at 1235: Running TEST GROUP(TypesSupported) ****************************************************** TEST: TypesSupported_1 ****************************************************** Beginning test TypesSupported_1 at 1381798977 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/TypesSupported_1.res_body , -D , /tmp/ekoifman.1381798977/TypesSupported_1.res_header , http://localhost:50111/templeton/v1 result : ( "body", "{\"responseTypes\":[\"application/json\"]}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )INFO: TestDriverCurl::run() at 1368:Test TypesSupported_1 SUCCEEDED at 1381798977 Results so far, PASSED: 1 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 INFO TestDriverCurl::run at 1235: Running TEST GROUP(VersionsSupported) ****************************************************** TEST: VersionsSupported_1 ****************************************************** Beginning test VersionsSupported_1 at 1381798977 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/VersionsSupported_1.res_body , -D , /tmp/ekoifman.1381798977/VersionsSupported_1.res_header , http://localhost:50111/templeton/v1/version result : ( "body", "{\"supportedVersions\":[\"v1\"],\"version\":\"v1\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("version", "v1", "supportedVersions", ["v1"]) Comparing version: v1 with regex /v1/ Comparing supportedVersions: ["v1"],expected value: ["v1"]INFO: TestDriverCurl::run() at 1368:Test VersionsSupported_1 SUCCEEDED at 1381798977 Results so far, PASSED: 2 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 INFO: ./test_harness.pl at 578 : Loading configuration file /Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/tests/jobsubmission2.conf INFO ./test_harness.pl: hadoopversion=${hadoopversion} INFO ./test_harness.pl: harnessCfg=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/conf/default.conf INFO ./test_harness.pl: tmpPath=/tmp/pigtest INFO ./test_harness.pl: UID=1381798977 INFO ./test_harness.pl: harness.console.level=ERROR INFO ./test_harness.pl: logDir=./log INFO ./test_harness.pl: localoutpathbase=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/testdist/ INFO ./test_harness.pl: outpathbase=/tmp/templeton_test_out INFO ./test_harness.pl: local.bin=/usr/bin INFO ./test_harness.pl: userhomePath=/Users/ekoifman INFO ./test_harness.pl: logfile=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/testdist//test_harnesss_1381798977 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , PUT , -o , /tmp/ekoifman.1381798977/_.res_body , -D , /tmp/ekoifman.1381798977/_.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/?op=MKDIRS&permission=777&user.name=ekoifman result : ( "body", "{\"boolean\":true}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01-Jan-1970 00:00:00 GMT\r", "Server" => "Jetty(6.1.26)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834977660&s=1t+cXYVwj1dry7eEwD5dbIkRYkc=\";Path=/\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nExpires: Thu, 01-Jan-1970 00:00:00 GMT\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834977660&s=1t+cXYVwj1dry7eEwD5dbIkRYkc=\";Path=/\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )INFO TestDriverCurl::run at 1235: Running TEST GROUP(TestHeartbeat) ****************************************************** TEST: TestHeartbeat_1 ****************************************************** Beginning test TestHeartbeat_1 at 1381798977 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51242/templeton/$jobId , -d , user.name=ekoifman , -d , arg=-mt , -d , arg=42000 , -d , jar=/user/ekoifman/webhcate2e/hclient.jar , -d , class=sleep , -d , statusdir=/tmp/TestHeartbeat_1 , -X , POST , -o , /tmp/ekoifman.1381798977/TestHeartbeat_1.res_body , -D , /tmp/ekoifman.1381798977/TestHeartbeat_1.res_header , http://localhost:50111/templeton/v1/mapreduce/jar result : ( "body", "{\"id\":\"job_201310141642_0133\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834977701&s=s55Iia/DPzLDAD2+/Zm95pcznKE=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834977701&s=s55Iia/DPzLDAD2+/Zm95pcznKE=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0133") Comparing id: job_201310141642_0133 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51840/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestHeartbeat_1_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHeartbeat_1_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0133?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798978094,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":133,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0133\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0133/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0133\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":133,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0133\"},\"id\":\"job_201310141642_0133\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51242/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":\"/tmp/TestHeartbeat_1\",\"define\":[],\"arg\":[\"-mt\",\"42000\"],\"files\":null,\"enablelog\":\"false\",\"libjars\":null,\"user.name\":\"ekoifman\",\"jar\":\"/user/ekoifman/webhcate2e/hclient.jar\",\"callback\":\"http://ekoifman.local:51242/templeton/\$jobId\",\"class\":\"sleep\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835044598&s=5/TNbICSLX7gak+W3iqxQW1ClKY=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835044598&s=5/TNbICSLX7gak+W3iqxQW1ClKY=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt arg=-mtopt arg=42000opt jar=/user/ekoifman/webhcate2e/hclient.jaropt class=sleepopt statusdir=/tmp/TestHeartbeat_1opt callback=http://ekoifman.local:51242/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected statusdir ->"/tmp/TestHeartbeat_1" With result statusdir ->"/tmp/TestHeartbeat_1" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:51242/templeton/\$jobId" With result callback ->"http://ekoifman.local:51242/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected jar ->"/user/ekoifman/webhcate2e/hclient.jar" With result jar ->"/user/ekoifman/webhcate2e/hclient.jar" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected arg ->["-mt", 42000] With result arg ->["-mt", 42000] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected class ->"sleep" With result class ->"sleep" INFO: TestDriverCurl::run() at 1368:Test TestHeartbeat_1 SUCCEEDED at 1381799044 Results so far, PASSED: 1 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 INFO: ./test_harness.pl at 578 : Loading configuration file /Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/tests/jobstatus.conf INFO ./test_harness.pl: hadoopversion=${hadoopversion} INFO ./test_harness.pl: harnessCfg=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/conf/default.conf INFO ./test_harness.pl: tmpPath=/tmp/pigtest INFO ./test_harness.pl: UID=1381798977 INFO ./test_harness.pl: harness.console.level=ERROR INFO ./test_harness.pl: logDir=./log INFO ./test_harness.pl: localoutpathbase=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/testdist/ INFO ./test_harness.pl: outpathbase=/tmp/templeton_test_out INFO ./test_harness.pl: local.bin=/usr/bin INFO ./test_harness.pl: userhomePath=/Users/ekoifman INFO ./test_harness.pl: logfile=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/testdist//test_harnesss_1381798977 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , PUT , -o , /tmp/ekoifman.1381798977/_.res_body , -D , /tmp/ekoifman.1381798977/_.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/?op=MKDIRS&permission=777&user.name=ekoifman result : ( "body", "{\"boolean\":true}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01-Jan-1970 00:00:00 GMT\r", "Server" => "Jetty(6.1.26)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834977660&s=1t+cXYVwj1dry7eEwD5dbIkRYkc=\";Path=/\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nExpires: Thu, 01-Jan-1970 00:00:00 GMT\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834977660&s=1t+cXYVwj1dry7eEwD5dbIkRYkc=\";Path=/\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )INFO TestDriverCurl::run at 1235: Running TEST GROUP(JOBS) ****************************************************** TEST: JOBS_1 ****************************************************** Beginning test JOBS_1 at 1381798977 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51243/templeton/$jobId , -d , user.name=hive , -d , arg=-p , -d , arg=INPDIR=/user/ekoifman/webhcate2e , -d , arg=-p , -d , arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_1 , -d , file=/user/ekoifman/webhcate2e/loadstore.pig , -X , POST , -o , /tmp/ekoifman.1381798977/JOBS_1.res_body , -D , /tmp/ekoifman.1381798977/JOBS_1.res_header , http://localhost:50111/templeton/v1/pig result : ( "body", "{\"id\":\"job_201310141642_0134\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=hive&p=hive&t=simple&e=1381834977701&s=vZqmsfeLDZwDLaSL9y/jE9HET3Y=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=hive&p=hive&t=simple&e=1381834977701&s=vZqmsfeLDZwDLaSL9y/jE9HET3Y=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0134") Comparing id: job_201310141642_0134 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51613/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/JOBS_1_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/JOBS_1_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0134?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798978101,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":134,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0134\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0134/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0134\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":134,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0134\"},\"id\":\"job_201310141642_0134\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:51243/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_1\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:51243/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835015758&s=rVYOeCNHXg9IxJcMpI+PF8SftlU=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835015758&s=rVYOeCNHXg9IxJcMpI+PF8SftlU=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=hiveopt arg=-popt arg=INPDIR=/user/ekoifman/webhcate2eopt arg=-popt arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_1opt file=/user/ekoifman/webhcate2e/loadstore.pigopt callback=http://ekoifman.local:51243/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"hive" With result user.name ->"hive" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:51243/templeton/\$jobId" With result callback ->"http://ekoifman.local:51243/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected arg ->[ "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_1", ] With result arg ->[ "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_1", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected file ->"/user/ekoifman/webhcate2e/loadstore.pig" With result file ->"/user/ekoifman/webhcate2e/loadstore.pig" INFO: TestDriverCurl::run() at 1368:Test JOBS_1 SUCCEEDED at 1381799015 Results so far, PASSED: 1 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: JOBS_2 ****************************************************** Beginning test JOBS_2 at 1381799015 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51621/templeton/$jobId , -d , user.name=ekoifman , -d , arg=-p , -d , arg=INPDIR=/user/ekoifman/webhcate2e , -d , arg=-p , -d , arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_2 , -d , file=/user/ekoifman/webhcate2e/loadstore.pig , -X , POST , -o , /tmp/ekoifman.1381798977/JOBS_2.res_body , -D , /tmp/ekoifman.1381798977/JOBS_2.res_header , http://localhost:50111/templeton/v1/pig result : ( "body", "{\"id\":\"job_201310141642_0144\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835015836&s=/zBb/UJ5rHi72TpkppspFMcLiOY=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835015836&s=/zBb/UJ5rHi72TpkppspFMcLiOY=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0144") Comparing id: job_201310141642_0144 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51869/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/JOBS_2_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/JOBS_2_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0144?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799015922,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":144,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0144\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0144/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0144\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":144,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0144\"},\"id\":\"job_201310141642_0144\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51621/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_2\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:51621/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835048238&s=dO1TNqeD6Eo1QFubwjmgoUlxEXw=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835048238&s=dO1TNqeD6Eo1QFubwjmgoUlxEXw=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt arg=-popt arg=INPDIR=/user/ekoifman/webhcate2eopt arg=-popt arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_2opt file=/user/ekoifman/webhcate2e/loadstore.pigopt callback=http://ekoifman.local:51621/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:51621/templeton/\$jobId" With result callback ->"http://ekoifman.local:51621/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected arg ->[ "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_2", ] With result arg ->[ "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_2", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected file ->"/user/ekoifman/webhcate2e/loadstore.pig" With result file ->"/user/ekoifman/webhcate2e/loadstore.pig" INFO: TestDriverCurl::run() at 1368:Test JOBS_2 SUCCEEDED at 1381799048 Results so far, PASSED: 2 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: JOBS_3 ****************************************************** Beginning test JOBS_3 at 1381799048 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51877/templeton/$jobId , -d , user.name=hive , -d , arg=-p , -d , arg=INPDIR=/user/ekoifman/webhcate2e , -d , arg=-p , -d , arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_3 , -d , file=/user/ekoifman/webhcate2e/loadstore.pig , -X , POST , -o , /tmp/ekoifman.1381798977/JOBS_3.res_body , -D , /tmp/ekoifman.1381798977/JOBS_3.res_header , http://localhost:50111/templeton/v1/pig result : ( "body", "{\"id\":\"job_201310141642_0149\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=hive&p=hive&t=simple&e=1381835048315&s=Q3Hy3SW0RUUWjphdilazrUUtftM=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=hive&p=hive&t=simple&e=1381835048315&s=Q3Hy3SW0RUUWjphdilazrUUtftM=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0149") Comparing id: job_201310141642_0149 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52153/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/JOBS_3_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/JOBS_3_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0149?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799048399,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":149,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0149\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0149/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0149\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":149,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0149\"},\"id\":\"job_201310141642_0149\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:51877/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:51877/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835079866&s=CzBf4AoxZPgpQ+G4kM1ordlGZnk=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835079866&s=CzBf4AoxZPgpQ+G4kM1ordlGZnk=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=hiveopt arg=-popt arg=INPDIR=/user/ekoifman/webhcate2eopt arg=-popt arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_3opt file=/user/ekoifman/webhcate2e/loadstore.pigopt callback=http://ekoifman.local:51877/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"hive" With result user.name ->"hive" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:51877/templeton/\$jobId" With result callback ->"http://ekoifman.local:51877/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected arg ->[ "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_3", ] With result arg ->[ "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_3", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected file ->"/user/ekoifman/webhcate2e/loadstore.pig" With result file ->"/user/ekoifman/webhcate2e/loadstore.pig" INFO: TestDriverCurl::run() at 1368:Test JOBS_3 SUCCEEDED at 1381799079 Results so far, PASSED: 3 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: JOBS_4 ****************************************************** Beginning test JOBS_4 at 1381799079 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -H , Content-Type: application/json , -H , Content-Type: application/json , -X , GET , -o , /tmp/ekoifman.1381798977/JOBS_4.res_body , -D , /tmp/ekoifman.1381798977/JOBS_4.res_header , http://localhost:50111/templeton/v1/jobs?user.name=hive&showall=true&fields=* result : ( "body", "[{\"id\":\"job_201310141642_0008\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794261545,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":8,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0008\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0008/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0008\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":8,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0008\"},\"id\":\"job_201310141642_0008\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:60421/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381794223/JOBS_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:60421/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0012\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794272714,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":12,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0012\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0012/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0012\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":12,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0012\"},\"id\":\"job_201310141642_0012\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0039\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794658277,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":39,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0039\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0039/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0039\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":39,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0039\"},\"id\":\"job_201310141642_0039\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:61985/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":\"/user/ekoifman/webhcate2e/piggybank.jar\",\"define\":[],\"enablelog\":\"false\",\"execute\":\"add jar piggybank.jar\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:61985/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0040\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794675023,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":40,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0040\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0040/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0040\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":40,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0040\"},\"id\":\"job_201310141642_0040\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":1,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:62033/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"add jar piggybank.jar\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:62033/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0041\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796257439,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":41,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0041\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0041/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0041\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":41,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0041\"},\"id\":\"job_201310141642_0041\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:62234/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"cat\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:62234/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381796256/TestStreaming_1/mycounts\"}}},{\"id\":\"job_201310141642_0042\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":5,\"startTime\":1381796257419,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":42,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0042\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0042/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0042\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":42,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0042\"},\"id\":\"job_201310141642_0042\",\"parentId\":null,\"percentComplete\":\"map 0% reduce 0%\",\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"sleep 100\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":null,\"output\":\"/tmp/templeton_test_out/ekoifman.1381796256/TestKillJob_1/mycounts\"}}},{\"id\":\"job_201310141642_0043\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796257461,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":43,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0043\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0043/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0043\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":43,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0043\"},\"id\":\"job_201310141642_0043\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:62240/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":\"/tmp/TestHeartbeat_1\",\"define\":[],\"arg\":[\"-mt\",\"42000\"],\"files\":null,\"enablelog\":\"false\",\"libjars\":null,\"user.name\":\"ekoifman\",\"jar\":\"/user/ekoifman/webhcate2e/hclient.jar\",\"callback\":\"http://ekoifman.local:62240/templeton/\$jobId\",\"class\":\"sleep\"}}},{\"id\":\"job_201310141642_0044\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796257061,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":44,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0044\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0044/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0044\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":44,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0044\"},\"id\":\"job_201310141642_0044\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:62235/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381796256/JOBS_1\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:62235/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0045\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":5,\"startTime\":1381796264058,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":45,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0045\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0045/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0045\",\"queueName\":\"default\",\"jobName\":\"streamjob2938039988299330857.jar\",\"jobID\":{\"id\":45,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0045\"},\"id\":\"job_201310141642_0045\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0046\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796264406,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":46,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0046\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0046/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0046\",\"queueName\":\"default\",\"jobName\":\"streamjob1886652210832876994.jar\",\"jobID\":{\"id\":46,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0046\"},\"id\":\"job_201310141642_0046\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0047\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796264623,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":47,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0047\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0047/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0047\",\"queueName\":\"default\",\"jobName\":\"Sleep job\",\"jobID\":{\"id\":47,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0047\"},\"id\":\"job_201310141642_0047\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0048\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796271467,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":48,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0048\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0048/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0048\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":48,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0048\"},\"id\":\"job_201310141642_0048\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0049\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796272933,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":49,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0049\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0049/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0049\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":49,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0049\"},\"id\":\"job_201310141642_0049\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:62462/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"define\":[],\"arg\":[\"/user/ekoifman/webhcate2e/nums.txt\",\" /tmp/templeton_test_out/ekoifman.1381796256/TestMapReduce_1/wc.txt\"],\"files\":null,\"enablelog\":\"false\",\"libjars\":null,\"user.name\":\"ekoifman\",\"jar\":\"/user/ekoifman/webhcate2e/hexamples.jar\",\"callback\":\"http://ekoifman.local:62462/templeton/\$jobId\",\"class\":\"wordcount\"}}},{\"id\":\"job_201310141642_0050\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796277842,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":50,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0050\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0050/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0050\",\"queueName\":\"default\",\"jobName\":\"word count\",\"jobID\":{\"id\":50,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0050\"},\"id\":\"job_201310141642_0050\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0051\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796292524,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":51,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0051\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0051/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0051\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":51,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0051\"},\"id\":\"job_201310141642_0051\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":1,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:62583/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"ls no_such-file-12e3\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:62583/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381796256/TestStreaming_2/mycounts\"}}},{\"id\":\"job_201310141642_0052\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796293744,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":52,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0052\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0052/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0052\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":52,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0052\"},\"id\":\"job_201310141642_0052\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:62622/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381796256/JOBS_2\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:62622/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0053\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":3,\"startTime\":1381796298309,\"schedulingInfo\":\"NA\",\"failureInfo\":\"# of failed Map Tasks exceeded allowed limit. FailedCount: 1. LastFailedTask: task_201310141642_0053_m_000000\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":53,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0053\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0053/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0053\",\"queueName\":\"default\",\"jobName\":\"streamjob4567590967192924192.jar\",\"jobID\":{\"id\":53,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0053\"},\"id\":\"job_201310141642_0053\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0054\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796303859,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":54,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0054\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0054/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0054\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":54,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0054\"},\"id\":\"job_201310141642_0054\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0055\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796304985,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":55,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0055\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0055/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0055\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":55,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0055\"},\"id\":\"job_201310141642_0055\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:62726/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381796256/TestMapReduce_2/status\",\"define\":[],\"arg\":[\"/user/ekoifman/webhcate2e/nums.txt\",\" /tmp/templeton_test_out/ekoifman.1381796256/TestMapReduce_2/wc.txt\"],\"files\":null,\"enablelog\":\"true\",\"libjars\":null,\"user.name\":\"ekoifman\",\"jar\":\"/user/ekoifman/webhcate2e/hexamples.jar\",\"callback\":\"http://ekoifman.local:62726/templeton/\$jobId\",\"class\":\"wordcount\"}}},{\"id\":\"job_201310141642_0056\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796311562,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":56,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0056\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0056/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0056\",\"queueName\":\"default\",\"jobName\":\"word count\",\"jobID\":{\"id\":56,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0056\"},\"id\":\"job_201310141642_0056\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0057\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796326271,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":57,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0057\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0057/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0057\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":57,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0057\"},\"id\":\"job_201310141642_0057\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:62882/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381796256/JOBS_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:62882/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0058\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796335189,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":58,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0058\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0058/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0058\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":58,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0058\"},\"id\":\"job_201310141642_0058\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0059\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796338727,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":59,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0059\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0059/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0059\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":59,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0059\"},\"id\":\"job_201310141642_0059\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":8,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:62970/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[],\"enablelog\":\"false\",\"execute\":\"asdf\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:62970/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0060\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796344451,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":60,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0060\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0060/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0060\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":60,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0060\"},\"id\":\"job_201310141642_0060\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:63025/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381796256/TestStreaming_3/status\",\"files\":null,\"define\":[],\"mapper\":\"cat\",\"arg\":[],\"enablelog\":\"true\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:63025/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381796256/TestStreaming_3/mycounts\"}}},{\"id\":\"job_201310141642_0061\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796348700,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":61,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0061\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0061/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0061\",\"queueName\":\"default\",\"jobName\":\"streamjob7059024893002387929.jar\",\"jobID\":{\"id\":61,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0061\"},\"id\":\"job_201310141642_0061\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0062\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796356266,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":62,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0062\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0062/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0062\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":62,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0062\"},\"id\":\"job_201310141642_0062\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:63105/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[],\"enablelog\":\"false\",\"execute\":\"fs -ls /user/ekoifman/webhcate2e;\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:63105/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0063\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796373761,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":63,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0063\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0063/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0063\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":63,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0063\"},\"id\":\"job_201310141642_0063\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:63611/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-check\",\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381796256/TestPig_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:63611/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0064\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796374446,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":64,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0064\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0064/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0064\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":64,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0064\"},\"id\":\"job_201310141642_0064\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":1,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:63652/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381796256/TestStreaming_4/status\",\"files\":null,\"define\":[],\"mapper\":\"ls no_such-file-12e3\",\"arg\":[],\"enablelog\":\"true\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:63652/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381796256/TestStreaming_4/mycounts\"}}},{\"id\":\"job_201310141642_0065\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":3,\"startTime\":1381796379294,\"schedulingInfo\":\"NA\",\"failureInfo\":\"# of failed Map Tasks exceeded allowed limit. FailedCount: 1. LastFailedTask: task_201310141642_0065_m_000000\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":65,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0065\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0065/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0065\",\"queueName\":\"default\",\"jobName\":\"streamjob7710150853403675636.jar\",\"jobID\":{\"id\":65,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0065\"},\"id\":\"job_201310141642_0065\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0066\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796392306,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":66,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0066\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0066/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0066\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":66,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0066\"},\"id\":\"job_201310141642_0066\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:63741/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-d\",\"INFO\"],\"enablelog\":\"false\",\"execute\":\"fs -ls /user/ekoifman/webhcate2e \",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:63741/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0067\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796409544,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":67,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0067\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0067/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0067\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":67,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0067\"},\"id\":\"job_201310141642_0067\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:63814/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381796256/TestPig_5\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:63814/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0068\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796417913,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":68,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0068\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0068/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0068\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":68,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0068\"},\"id\":\"job_201310141642_0068\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0069\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796440096,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":69,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0069\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0069/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0069\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":69,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0069\"},\"id\":\"job_201310141642_0069\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:63955/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":\"/user/ekoifman/webhcate2e/piggybank.jar\",\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381796256/TestPig_6\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/jarregistered.pig\",\"callback\":\"http://ekoifman.local:63955/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0070\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796448599,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":70,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0070\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0070/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0070\",\"queueName\":\"default\",\"jobName\":\"PigLatin:jarregistered.pig\",\"jobID\":{\"id\":70,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0070\"},\"id\":\"job_201310141642_0070\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0071\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796470615,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":71,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0071\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0071/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0071\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":71,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0071\"},\"id\":\"job_201310141642_0071\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:64042/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":\"/user/ekoifman/webhcate2e/rowcountmacro.pig\",\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381796256/TestPig_7\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/rowcount_withmacro.pig\",\"callback\":\"http://ekoifman.local:64042/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0072\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796479179,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":72,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0072\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0072/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0072\",\"queueName\":\"default\",\"jobName\":\"PigLatin:rowcount_withmacro.pig\",\"jobID\":{\"id\":72,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0072\"},\"id\":\"job_201310141642_0072\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0073\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796506321,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":73,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0073\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0073/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0073\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":73,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0073\"},\"id\":\"job_201310141642_0073\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:64207/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381796256/TestPig_9/status\",\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381796256/TestPig_9\"],\"enablelog\":\"true\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:64207/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0074\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796514578,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":74,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0074\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0074/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0074\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":74,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0074\"},\"id\":\"job_201310141642_0074\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0075\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796536810,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":75,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0075\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0075/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0075\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":75,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0075\"},\"id\":\"job_201310141642_0075\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":64,\"user\":\"ekoifman\",\"callback\":null,\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"asdf\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}},{\"id\":\"job_201310141642_0076\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796557183,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":76,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0076\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0076/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0076\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":76,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0076\"},\"id\":\"job_201310141642_0076\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:64377/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"show tables\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:64377/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0077\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796575441,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":77,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0077\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0077/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0077\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":77,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0077\"},\"id\":\"job_201310141642_0077\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:64451/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"drop table if exists mynums;\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:64451/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0078\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796594479,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":78,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0078\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0078/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0078\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":78,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0078\"},\"id\":\"job_201310141642_0078\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:64577/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"create external table mynums(a int, b int) location '/user/ekoifman/webhcate2e/numstable/';\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:64577/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0079\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796612592,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":79,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0079\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0079/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0079\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":79,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0079\"},\"id\":\"job_201310141642_0079\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:64628/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"describe formatted mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:64628/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0080\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796630696,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":80,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0080\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0080/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0080\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":80,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0080\"},\"id\":\"job_201310141642_0080\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:64678/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select * from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:64678/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0081\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796649122,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":81,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0081\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0081/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0081\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":81,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0081\"},\"id\":\"job_201310141642_0081\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:64733/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select a,b from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:64733/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0082\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796656208,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":82,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0082\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0082/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0082\",\"queueName\":\"default\",\"jobName\":\"select a,b from mynums(Stage-1)\",\"jobID\":{\"id\":82,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0082\"},\"id\":\"job_201310141642_0082\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0083\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796672992,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":83,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0083\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0083/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0083\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":83,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0083\"},\"id\":\"job_201310141642_0083\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":null,\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select a,rand(b) from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}},{\"id\":\"job_201310141642_0084\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796680315,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":84,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0084\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0084/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0084\",\"queueName\":\"default\",\"jobName\":\"select a,rand(b) from mynums(Stage-1)\",\"jobID\":{\"id\":84,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0084\"},\"id\":\"job_201310141642_0084\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0085\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796698341,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":85,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0085\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0085/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0085\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":85,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0085\"},\"id\":\"job_201310141642_0085\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:64883/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":\"/user/ekoifman/webhcate2e/piggybank.jar\",\"define\":[],\"enablelog\":\"false\",\"execute\":\"add jar piggybank.jar\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:64883/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0086\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796715290,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":86,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0086\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0086/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0086\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":86,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0086\"},\"id\":\"job_201310141642_0086\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":1,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:64937/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"add jar piggybank.jar\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:64937/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0087\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797924958,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":87,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0087\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0087/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0087\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":87,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0087\"},\"id\":\"job_201310141642_0087\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:65134/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381797924/JOBS_1\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:65134/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0088\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797924958,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":88,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0088\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0088/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0088\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":88,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0088\"},\"id\":\"job_201310141642_0088\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:65132/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":\"/tmp/TestHeartbeat_1\",\"define\":[],\"arg\":[\"-mt\",\"42000\"],\"files\":null,\"enablelog\":\"false\",\"libjars\":null,\"user.name\":\"ekoifman\",\"jar\":\"/user/ekoifman/webhcate2e/hclient.jar\",\"callback\":\"http://ekoifman.local:65132/templeton/\$jobId\",\"class\":\"sleep\"}}},{\"id\":\"job_201310141642_0089\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797924951,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":89,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0089\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0089/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0089\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":89,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0089\"},\"id\":\"job_201310141642_0089\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:65130/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"cat\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:65130/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381797924/TestStreaming_1/mycounts\"}}},{\"id\":\"job_201310141642_0090\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":5,\"startTime\":1381797924959,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":90,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0090\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0090/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0090\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":90,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0090\"},\"id\":\"job_201310141642_0090\",\"parentId\":null,\"percentComplete\":\"map 0% reduce 0%\",\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"sleep 100\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":null,\"output\":\"/tmp/templeton_test_out/ekoifman.1381797924/TestKillJob_1/mycounts\"}}},{\"id\":\"job_201310141642_0091\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797931809,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":91,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0091\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0091/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0091\",\"queueName\":\"default\",\"jobName\":\"streamjob1568756192670113653.jar\",\"jobID\":{\"id\":91,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0091\"},\"id\":\"job_201310141642_0091\",\"parentId\":\"job_201310141642_0089\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0092\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797932555,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":92,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0092\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0092/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0092\",\"queueName\":\"default\",\"jobName\":\"Sleep job\",\"jobID\":{\"id\":92,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0092\"},\"id\":\"job_201310141642_0092\",\"parentId\":\"job_201310141642_0088\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0093\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":5,\"startTime\":1381797933080,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":93,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0093\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0093/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0093\",\"queueName\":\"default\",\"jobName\":\"streamjob7205595917877894939.jar\",\"jobID\":{\"id\":93,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0093\"},\"id\":\"job_201310141642_0093\",\"parentId\":\"job_201310141642_0090\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0094\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797939623,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":94,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0094\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0094/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0094\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":94,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0094\"},\"id\":\"job_201310141642_0094\",\"parentId\":\"job_201310141642_0087\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0095\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797940553,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":95,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0095\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0095/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0095\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":95,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0095\"},\"id\":\"job_201310141642_0095\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:65353/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"define\":[],\"arg\":[\"/user/ekoifman/webhcate2e/nums.txt\",\" /tmp/templeton_test_out/ekoifman.1381797924/TestMapReduce_1/wc.txt\"],\"files\":null,\"enablelog\":\"false\",\"libjars\":null,\"user.name\":\"ekoifman\",\"jar\":\"/user/ekoifman/webhcate2e/hexamples.jar\",\"callback\":\"http://ekoifman.local:65353/templeton/\$jobId\",\"class\":\"wordcount\"}}},{\"id\":\"job_201310141642_0096\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797945222,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":96,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0096\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0096/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0096\",\"queueName\":\"default\",\"jobName\":\"word count\",\"jobID\":{\"id\":96,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0096\"},\"id\":\"job_201310141642_0096\",\"parentId\":\"job_201310141642_0095\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0097\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797960697,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":97,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0097\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0097/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0097\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":97,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0097\"},\"id\":\"job_201310141642_0097\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":1,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:65473/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"ls no_such-file-12e3\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:65473/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381797924/TestStreaming_2/mycounts\"}}},{\"id\":\"job_201310141642_0098\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797962203,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":98,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0098\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0098/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0098\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":98,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0098\"},\"id\":\"job_201310141642_0098\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:65511/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381797924/JOBS_2\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:65511/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0099\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":3,\"startTime\":1381797966918,\"schedulingInfo\":\"NA\",\"failureInfo\":\"# of failed Map Tasks exceeded allowed limit. FailedCount: 1. LastFailedTask: task_201310141642_0099_m_000001\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":99,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0099\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0099/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0099\",\"queueName\":\"default\",\"jobName\":\"streamjob6500701761395089449.jar\",\"jobID\":{\"id\":99,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0099\"},\"id\":\"job_201310141642_0099\",\"parentId\":\"job_201310141642_0097\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0100\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797971552,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":100,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0100\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0100/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0100\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":100,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0100\"},\"id\":\"job_201310141642_0100\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:49212/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381797924/TestMapReduce_2/status\",\"define\":[],\"arg\":[\"/user/ekoifman/webhcate2e/nums.txt\",\" /tmp/templeton_test_out/ekoifman.1381797924/TestMapReduce_2/wc.txt\"],\"files\":null,\"enablelog\":\"true\",\"libjars\":null,\"user.name\":\"ekoifman\",\"jar\":\"/user/ekoifman/webhcate2e/hexamples.jar\",\"callback\":\"http://ekoifman.local:49212/templeton/\$jobId\",\"class\":\"wordcount\"}}},{\"id\":\"job_201310141642_0101\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797972769,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":101,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0101\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0101/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0101\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":101,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0101\"},\"id\":\"job_201310141642_0101\",\"parentId\":\"job_201310141642_0098\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0102\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797979084,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":102,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0102\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0102/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0102\",\"queueName\":\"default\",\"jobName\":\"word count\",\"jobID\":{\"id\":102,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0102\"},\"id\":\"job_201310141642_0102\",\"parentId\":\"job_201310141642_0100\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0103\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797995215,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":103,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0103\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0103/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0103\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":103,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0103\"},\"id\":\"job_201310141642_0103\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:49366/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381797924/JOBS_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:49366/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0104\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798004259,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":104,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0104\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0104/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0104\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":104,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0104\"},\"id\":\"job_201310141642_0104\",\"parentId\":\"job_201310141642_0103\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0105\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798005942,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":105,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0105\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0105/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0105\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":105,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0105\"},\"id\":\"job_201310141642_0105\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":8,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:49464/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[],\"enablelog\":\"false\",\"execute\":\"asdf\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:49464/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0106\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798011059,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":106,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0106\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0106/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0106\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":106,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0106\"},\"id\":\"job_201310141642_0106\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:49514/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381797924/TestStreaming_3/status\",\"files\":null,\"define\":[],\"mapper\":\"cat\",\"arg\":[],\"enablelog\":\"true\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:49514/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381797924/TestStreaming_3/mycounts\"}}},{\"id\":\"job_201310141642_0107\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798015507,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":107,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0107\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0107/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0107\",\"queueName\":\"default\",\"jobName\":\"streamjob341766648445569827.jar\",\"jobID\":{\"id\":107,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0107\"},\"id\":\"job_201310141642_0107\",\"parentId\":\"job_201310141642_0106\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0108\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798023753,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":108,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0108\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0108/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0108\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":108,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0108\"},\"id\":\"job_201310141642_0108\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:49598/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[],\"enablelog\":\"false\",\"execute\":\"fs -ls /user/ekoifman/webhcate2e;\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:49598/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0109\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798041400,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":109,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0109\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0109/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0109\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":109,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0109\"},\"id\":\"job_201310141642_0109\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":1,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:50048/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381797924/TestStreaming_4/status\",\"files\":null,\"define\":[],\"mapper\":\"ls no_such-file-12e3\",\"arg\":[],\"enablelog\":\"true\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:50048/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381797924/TestStreaming_4/mycounts\"}}},{\"id\":\"job_201310141642_0110\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798042208,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":110,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0110\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0110/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0110\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":110,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0110\"},\"id\":\"job_201310141642_0110\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:50084/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-check\",\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381797924/TestPig_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:50084/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0111\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":3,\"startTime\":1381798046785,\"schedulingInfo\":\"NA\",\"failureInfo\":\"# of failed Map Tasks exceeded allowed limit. FailedCount: 1. LastFailedTask: task_201310141642_0111_m_000000\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":111,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0111\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0111/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0111\",\"queueName\":\"default\",\"jobName\":\"streamjob2881415898898754034.jar\",\"jobID\":{\"id\":111,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0111\"},\"id\":\"job_201310141642_0111\",\"parentId\":\"job_201310141642_0109\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0112\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798060698,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":112,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0112\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0112/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0112\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":112,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0112\"},\"id\":\"job_201310141642_0112\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:50178/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-d\",\"INFO\"],\"enablelog\":\"false\",\"execute\":\"fs -ls /user/ekoifman/webhcate2e \",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:50178/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0113\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798078501,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":113,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0113\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0113/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0113\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":113,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0113\"},\"id\":\"job_201310141642_0113\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:50250/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381797924/TestPig_5\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:50250/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0114\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798087012,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":114,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0114\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0114/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0114\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":114,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0114\"},\"id\":\"job_201310141642_0114\",\"parentId\":\"job_201310141642_0113\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0115\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798109073,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":115,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0115\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0115/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0115\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":115,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0115\"},\"id\":\"job_201310141642_0115\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:50368/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":\"/user/ekoifman/webhcate2e/piggybank.jar\",\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381797924/TestPig_6\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/jarregistered.pig\",\"callback\":\"http://ekoifman.local:50368/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0116\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798117631,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":116,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0116\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0116/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0116\",\"queueName\":\"default\",\"jobName\":\"PigLatin:jarregistered.pig\",\"jobID\":{\"id\":116,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0116\"},\"id\":\"job_201310141642_0116\",\"parentId\":\"job_201310141642_0115\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0117\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798139593,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":117,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0117\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0117/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0117\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":117,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0117\"},\"id\":\"job_201310141642_0117\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:50456/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":\"/user/ekoifman/webhcate2e/rowcountmacro.pig\",\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381797924/TestPig_7\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/rowcount_withmacro.pig\",\"callback\":\"http://ekoifman.local:50456/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0118\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798148054,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":118,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0118\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0118/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0118\",\"queueName\":\"default\",\"jobName\":\"PigLatin:rowcount_withmacro.pig\",\"jobID\":{\"id\":118,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0118\"},\"id\":\"job_201310141642_0118\",\"parentId\":\"job_201310141642_0117\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0119\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798174979,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":119,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0119\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0119/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0119\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":119,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0119\"},\"id\":\"job_201310141642_0119\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:50546/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381797924/TestPig_9/status\",\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381797924/TestPig_9\"],\"enablelog\":\"true\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:50546/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0120\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798183510,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":120,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0120\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0120/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0120\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":120,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0120\"},\"id\":\"job_201310141642_0120\",\"parentId\":\"job_201310141642_0119\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0121\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798205477,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":121,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0121\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0121/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0121\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":121,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0121\"},\"id\":\"job_201310141642_0121\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":64,\"user\":\"ekoifman\",\"callback\":null,\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"asdf\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}},{\"id\":\"job_201310141642_0122\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798225800,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":122,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0122\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0122/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0122\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":122,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0122\"},\"id\":\"job_201310141642_0122\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:50680/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"show tables\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:50680/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0123\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798243832,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":123,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0123\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0123/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0123\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":123,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0123\"},\"id\":\"job_201310141642_0123\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:50729/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"drop table if exists mynums;\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:50729/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0124\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798261929,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":124,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0124\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0124/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0124\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":124,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0124\"},\"id\":\"job_201310141642_0124\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:50780/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"create external table mynums(a int, b int) location '/user/ekoifman/webhcate2e/numstable/';\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:50780/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0125\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798280076,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":125,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0125\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0125/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0125\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":125,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0125\"},\"id\":\"job_201310141642_0125\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:50830/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"describe formatted mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:50830/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0126\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798298186,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":126,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0126\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0126/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0126\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":126,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0126\"},\"id\":\"job_201310141642_0126\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:50879/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select * from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:50879/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0127\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798316617,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":127,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0127\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0127/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0127\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":127,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0127\"},\"id\":\"job_201310141642_0127\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:50930/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select a,b from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:50930/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0128\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798323674,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":128,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0128\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0128/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0128\",\"queueName\":\"default\",\"jobName\":\"select a,b from mynums(Stage-1)\",\"jobID\":{\"id\":128,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0128\"},\"id\":\"job_201310141642_0128\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0129\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798340190,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":129,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0129\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0129/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0129\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":129,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0129\"},\"id\":\"job_201310141642_0129\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":null,\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select a,rand(b) from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}},{\"id\":\"job_201310141642_0130\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798347469,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":130,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0130\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0130/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0130\",\"queueName\":\"default\",\"jobName\":\"select a,rand(b) from mynums(Stage-1)\",\"jobID\":{\"id\":130,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0130\"},\"id\":\"job_201310141642_0130\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0131\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798365541,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":131,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0131\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0131/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0131\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":131,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0131\"},\"id\":\"job_201310141642_0131\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51074/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":\"/user/ekoifman/webhcate2e/piggybank.jar\",\"define\":[],\"enablelog\":\"false\",\"execute\":\"add jar piggybank.jar\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:51074/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0132\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798382514,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":132,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0132\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0132/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0132\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":132,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0132\"},\"id\":\"job_201310141642_0132\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":1,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51123/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"add jar piggybank.jar\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:51123/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0133\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798978094,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":133,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0133\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0133/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0133\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":133,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0133\"},\"id\":\"job_201310141642_0133\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51242/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":\"/tmp/TestHeartbeat_1\",\"define\":[],\"arg\":[\"-mt\",\"42000\"],\"files\":null,\"enablelog\":\"false\",\"libjars\":null,\"user.name\":\"ekoifman\",\"jar\":\"/user/ekoifman/webhcate2e/hclient.jar\",\"callback\":\"http://ekoifman.local:51242/templeton/\$jobId\",\"class\":\"sleep\"}}},{\"id\":\"job_201310141642_0134\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798978101,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":134,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0134\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0134/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0134\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":134,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0134\"},\"id\":\"job_201310141642_0134\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:51243/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_1\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:51243/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0135\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":5,\"startTime\":1381798978094,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":135,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0135\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0135/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0135\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":135,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0135\"},\"id\":\"job_201310141642_0135\",\"parentId\":null,\"percentComplete\":\"map 0% reduce 0%\",\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"sleep 100\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":null,\"output\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestKillJob_1/mycounts\"}}},{\"id\":\"job_201310141642_0136\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798978094,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":136,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0136\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0136/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0136\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":136,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0136\"},\"id\":\"job_201310141642_0136\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51239/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"cat\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:51239/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_1/mycounts\"}}},{\"id\":\"job_201310141642_0137\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798984774,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":137,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0137\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0137/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0137\",\"queueName\":\"default\",\"jobName\":\"Sleep job\",\"jobID\":{\"id\":137,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0137\"},\"id\":\"job_201310141642_0137\",\"parentId\":\"job_201310141642_0133\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0138\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":5,\"startTime\":1381798985414,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":138,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0138\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0138/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0138\",\"queueName\":\"default\",\"jobName\":\"streamjob135013641676397139.jar\",\"jobID\":{\"id\":138,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0138\"},\"id\":\"job_201310141642_0138\",\"parentId\":\"job_201310141642_0135\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0139\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798985810,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":139,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0139\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0139/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0139\",\"queueName\":\"default\",\"jobName\":\"streamjob1398165921499422871.jar\",\"jobID\":{\"id\":139,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0139\"},\"id\":\"job_201310141642_0139\",\"parentId\":\"job_201310141642_0136\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0140\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798993471,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":140,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0140\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0140/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0140\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":140,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0140\"},\"id\":\"job_201310141642_0140\",\"parentId\":\"job_201310141642_0134\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0141\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798994354,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":141,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0141\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0141/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0141\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":141,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0141\"},\"id\":\"job_201310141642_0141\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51465/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"define\":[],\"arg\":[\"/user/ekoifman/webhcate2e/nums.txt\",\" /tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_1/wc.txt\"],\"files\":null,\"enablelog\":\"false\",\"libjars\":null,\"user.name\":\"ekoifman\",\"jar\":\"/user/ekoifman/webhcate2e/hexamples.jar\",\"callback\":\"http://ekoifman.local:51465/templeton/\$jobId\",\"class\":\"wordcount\"}}},{\"id\":\"job_201310141642_0142\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798999121,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":142,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0142\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0142/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0142\",\"queueName\":\"default\",\"jobName\":\"word count\",\"jobID\":{\"id\":142,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0142\"},\"id\":\"job_201310141642_0142\",\"parentId\":\"job_201310141642_0141\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0143\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799014723,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":143,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0143\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0143/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0143\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":143,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0143\"},\"id\":\"job_201310141642_0143\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":1,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51585/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"ls no_such-file-12e3\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:51585/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_2/mycounts\"}}},{\"id\":\"job_201310141642_0144\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799015922,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":144,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0144\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0144/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0144\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":144,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0144\"},\"id\":\"job_201310141642_0144\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51621/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_2\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:51621/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0145\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":3,\"startTime\":1381799020477,\"schedulingInfo\":\"NA\",\"failureInfo\":\"# of failed Map Tasks exceeded allowed limit. FailedCount: 1. LastFailedTask: task_201310141642_0145_m_000000\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":145,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0145\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0145/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0145\",\"queueName\":\"default\",\"jobName\":\"streamjob9085856149249209761.jar\",\"jobID\":{\"id\":145,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0145\"},\"id\":\"job_201310141642_0145\",\"parentId\":\"job_201310141642_0143\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0146\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799026053,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":146,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0146\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0146/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0146\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":146,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0146\"},\"id\":\"job_201310141642_0146\",\"parentId\":\"job_201310141642_0144\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0147\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799025956,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":147,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0147\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0147/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0147\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":147,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0147\"},\"id\":\"job_201310141642_0147\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51707/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/status\",\"define\":[],\"arg\":[\"/user/ekoifman/webhcate2e/nums.txt\",\" /tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/wc.txt\"],\"files\":null,\"enablelog\":\"true\",\"libjars\":null,\"user.name\":\"ekoifman\",\"jar\":\"/user/ekoifman/webhcate2e/hexamples.jar\",\"callback\":\"http://ekoifman.local:51707/templeton/\$jobId\",\"class\":\"wordcount\"}}},{\"id\":\"job_201310141642_0148\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799032103,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":148,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0148\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0148/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0148\",\"queueName\":\"default\",\"jobName\":\"word count\",\"jobID\":{\"id\":148,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0148\"},\"id\":\"job_201310141642_0148\",\"parentId\":\"job_201310141642_0147\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0149\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799048399,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":149,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0149\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0149/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0149\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":149,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0149\"},\"id\":\"job_201310141642_0149\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:51877/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:51877/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0150\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799057467,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":150,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0150\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0150/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0150\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":150,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0150\"},\"id\":\"job_201310141642_0150\",\"parentId\":\"job_201310141642_0149\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0151\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799059257,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":151,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0151\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0151/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0151\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":151,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0151\"},\"id\":\"job_201310141642_0151\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":8,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51984/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[],\"enablelog\":\"false\",\"execute\":\"asdf\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:51984/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0152\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":1,\"startTime\":1381799063571,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":152,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0152\",\"jobComplete\":false},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0152/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0152\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":152,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0152\"},\"id\":\"job_201310141642_0152\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:52034/templeton/\$jobId\",\"completed\":null,\"userargs\":{\"reducer\":\"wc\",\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/status\",\"files\":null,\"define\":[],\"mapper\":\"cat\",\"arg\":[],\"enablelog\":\"true\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:52034/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/mycounts\"}}},{\"id\":\"job_201310141642_0153\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":1,\"startTime\":1381799068629,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":153,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0153\",\"jobComplete\":false},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0153/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0153\",\"queueName\":\"default\",\"jobName\":\"streamjob220398907087220676.jar\",\"jobID\":{\"id\":153,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0153\"},\"id\":\"job_201310141642_0153\",\"parentId\":\"job_201310141642_0152\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0154\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":1,\"startTime\":1381799077528,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":154,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0154\",\"jobComplete\":false},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0154/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0154\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":154,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0154\"},\"id\":\"job_201310141642_0154\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:52116/templeton/\$jobId\",\"completed\":null,\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[],\"enablelog\":\"false\",\"execute\":\"fs -ls /user/ekoifman/webhcate2e;\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:52116/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0005\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794239336,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":5,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0005\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0005/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0005\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":5,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0005\"},\"id\":\"job_201310141642_0005\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0003\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794233883,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":3,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0003\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0003/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0003\",\"queueName\":\"default\",\"jobName\":\"streamjob525645056011870137.jar\",\"jobID\":{\"id\":3,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0003\"},\"id\":\"job_201310141642_0003\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0006\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794241081,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":6,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0006\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0006/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0006\",\"queueName\":\"default\",\"jobName\":\"word count\",\"jobID\":{\"id\":6,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0006\"},\"id\":\"job_201310141642_0006\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0002\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794225934,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":2,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0002\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0002/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0002\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":2,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0002\"},\"id\":\"job_201310141642_0002\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:60150/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"cat\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:60150/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381794223/TestStreaming_1/mycounts\"}}},{\"id\":\"job_201310141642_0001\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794225546,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":1,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0001\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0001/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0001\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":1,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0001\"},\"id\":\"job_201310141642_0001\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:60159/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381794223/JOBS_2\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:60159/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0004\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794235383,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":4,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0004\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0004/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0004\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":4,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0004\"},\"id\":\"job_201310141642_0004\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:60236/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"define\":[],\"arg\":[\"/user/ekoifman/webhcate2e/nums.txt\",\" /tmp/templeton_test_out/ekoifman.1381794223/TestMapReduce_1/wc.txt\"],\"files\":null,\"enablelog\":\"false\",\"libjars\":null,\"user.name\":\"ekoifman\",\"jar\":\"/user/ekoifman/webhcate2e/hexamples.jar\",\"callback\":\"http://ekoifman.local:60236/templeton/\$jobId\",\"class\":\"wordcount\"}}},{\"id\":\"job_201310141642_0011\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794271753,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":11,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0011\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0011/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0011\",\"queueName\":\"default\",\"jobName\":\"word count\",\"jobID\":{\"id\":11,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0011\"},\"id\":\"job_201310141642_0011\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0010\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":3,\"startTime\":1381794266474,\"schedulingInfo\":\"NA\",\"failureInfo\":\"# of failed Map Tasks exceeded allowed limit. FailedCount: 1. LastFailedTask: task_201310141642_0010_m_000000\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":10,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0010\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0010/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0010\",\"queueName\":\"default\",\"jobName\":\"streamjob4960691008754875067.jar\",\"jobID\":{\"id\":10,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0010\"},\"id\":\"job_201310141642_0010\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0009\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794266154,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":9,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0009\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0009/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0009\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":9,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0009\"},\"id\":\"job_201310141642_0009\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:60475/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381794223/TestMapReduce_2/status\",\"define\":[],\"arg\":[\"/user/ekoifman/webhcate2e/nums.txt\",\" /tmp/templeton_test_out/ekoifman.1381794223/TestMapReduce_2/wc.txt\"],\"files\":null,\"enablelog\":\"true\",\"libjars\":null,\"user.name\":\"ekoifman\",\"jar\":\"/user/ekoifman/webhcate2e/hexamples.jar\",\"callback\":\"http://ekoifman.local:60475/templeton/\$jobId\",\"class\":\"wordcount\"}}},{\"id\":\"job_201310141642_0007\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794260766,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":7,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0007\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0007/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0007\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":7,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0007\"},\"id\":\"job_201310141642_0007\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":1,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:60384/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"ls no_such-file-12e3\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:60384/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381794223/TestStreaming_2/mycounts\"}}},{\"id\":\"job_201310141642_0013\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794299559,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":13,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0013\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0013/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0013\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":13,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0013\"},\"id\":\"job_201310141642_0013\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":8,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:60755/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[],\"enablelog\":\"false\",\"execute\":\"asdf\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:60755/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0015\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794312230,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":15,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0015\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0015/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0015\",\"queueName\":\"default\",\"jobName\":\"streamjob1783131714801683271.jar\",\"jobID\":{\"id\":15,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0015\"},\"id\":\"job_201310141642_0015\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0016\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794316819,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":16,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0016\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0016/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0016\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":16,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0016\"},\"id\":\"job_201310141642_0016\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:60875/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[],\"enablelog\":\"false\",\"execute\":\"fs -ls /user/ekoifman/webhcate2e;\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:60875/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0014\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794308300,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":14,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0014\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0014/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0014\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":14,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0014\"},\"id\":\"job_201310141642_0014\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:60802/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381794223/TestStreaming_3/status\",\"files\":null,\"define\":[],\"mapper\":\"cat\",\"arg\":[],\"enablelog\":\"true\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:60802/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381794223/TestStreaming_3/mycounts\"}}},{\"id\":\"job_201310141642_0017\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794334067,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":17,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0017\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0017/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0017\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":17,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0017\"},\"id\":\"job_201310141642_0017\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:60930/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-check\",\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381794223/TestPig_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:60930/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0020\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794351958,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":20,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0020\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0020/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0020\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":20,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0020\"},\"id\":\"job_201310141642_0020\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:61061/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-d\",\"INFO\"],\"enablelog\":\"false\",\"execute\":\"fs -ls /user/ekoifman/webhcate2e \",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:61061/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0019\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":3,\"startTime\":1381794342588,\"schedulingInfo\":\"NA\",\"failureInfo\":\"# of failed Map Tasks exceeded allowed limit. FailedCount: 1. LastFailedTask: task_201310141642_0019_m_000000\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":19,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0019\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0019/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0019\",\"queueName\":\"default\",\"jobName\":\"streamjob6007288244830133256.jar\",\"jobID\":{\"id\":19,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0019\"},\"id\":\"job_201310141642_0019\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0022\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794378120,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":22,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0022\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0022/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0022\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":22,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0022\"},\"id\":\"job_201310141642_0022\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0018\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794338331,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":18,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0018\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0018/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0018\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":18,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0018\"},\"id\":\"job_201310141642_0018\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":1,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:60984/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381794223/TestStreaming_4/status\",\"files\":null,\"define\":[],\"mapper\":\"ls no_such-file-12e3\",\"arg\":[],\"enablelog\":\"true\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:60984/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381794223/TestStreaming_4/mycounts\"}}},{\"id\":\"job_201310141642_0021\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794369188,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":21,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0021\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0021/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0021\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":21,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0021\"},\"id\":\"job_201310141642_0021\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:61132/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381794223/TestPig_5\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:61132/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0024\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794408494,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":24,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0024\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0024/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0024\",\"queueName\":\"default\",\"jobName\":\"PigLatin:jarregistered.pig\",\"jobID\":{\"id\":24,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0024\"},\"id\":\"job_201310141642_0024\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0023\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794400084,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":23,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0023\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0023/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0023\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":23,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0023\"},\"id\":\"job_201310141642_0023\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:61248/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":\"/user/ekoifman/webhcate2e/piggybank.jar\",\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381794223/TestPig_6\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/jarregistered.pig\",\"callback\":\"http://ekoifman.local:61248/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0026\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794439146,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":26,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0026\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0026/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0026\",\"queueName\":\"default\",\"jobName\":\"PigLatin:rowcount_withmacro.pig\",\"jobID\":{\"id\":26,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0026\"},\"id\":\"job_201310141642_0026\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0025\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794430613,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":25,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0025\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0025/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0025\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":25,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0025\"},\"id\":\"job_201310141642_0025\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:61335/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":\"/user/ekoifman/webhcate2e/rowcountmacro.pig\",\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381794223/TestPig_7\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/rowcount_withmacro.pig\",\"callback\":\"http://ekoifman.local:61335/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0028\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794474628,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":28,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0028\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0028/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0028\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":28,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0028\"},\"id\":\"job_201310141642_0028\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0027\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794466280,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":27,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0027\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0027/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0027\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":27,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0027\"},\"id\":\"job_201310141642_0027\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:61435/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381794223/TestPig_9/status\",\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381794223/TestPig_9\"],\"enablelog\":\"true\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:61435/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0029\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794496818,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":29,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0029\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0029/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0029\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":29,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0029\"},\"id\":\"job_201310141642_0029\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":64,\"user\":\"ekoifman\",\"callback\":null,\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"asdf\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}},{\"id\":\"job_201310141642_0030\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794517139,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":30,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0030\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0030/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0030\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":30,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0030\"},\"id\":\"job_201310141642_0030\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:61576/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"show tables\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:61576/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0031\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794535756,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":31,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0031\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0031/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0031\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":31,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0031\"},\"id\":\"job_201310141642_0031\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:61626/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"drop table if exists mynums;\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:61626/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0032\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794553906,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":32,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0032\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0032/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0032\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":32,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0032\"},\"id\":\"job_201310141642_0032\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:61679/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"create external table mynums(a int, b int) location '/user/ekoifman/webhcate2e/numstable/';\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:61679/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0033\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794572316,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":33,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0033\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0033/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0033\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":33,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0033\"},\"id\":\"job_201310141642_0033\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:61730/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"describe formatted mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:61730/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0034\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794590436,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":34,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0034\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0034/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0034\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":34,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0034\"},\"id\":\"job_201310141642_0034\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:61780/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select * from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:61780/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0036\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794615835,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":36,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0036\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0036/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0036\",\"queueName\":\"default\",\"jobName\":\"select a,b from mynums(Stage-1)\",\"jobID\":{\"id\":36,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0036\"},\"id\":\"job_201310141642_0036\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0035\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794608864,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":35,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0035\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0035/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0035\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":35,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0035\"},\"id\":\"job_201310141642_0035\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:61834/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select a,b from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:61834/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0038\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794639693,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":38,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0038\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0038/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0038\",\"queueName\":\"default\",\"jobName\":\"select a,rand(b) from mynums(Stage-1)\",\"jobID\":{\"id\":38,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0038\"},\"id\":\"job_201310141642_0038\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0037\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794632433,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":37,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0037\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0037/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0037\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":37,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0037\"},\"id\":\"job_201310141642_0037\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":null,\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select a,rand(b) from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}}]", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=hive&p=hive&t=simple&e=1381835079944&s=I5SjGlibw+6w39m+SzOeknuuZNQ=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=hive&p=hive&t=simple&e=1381835079944&s=I5SjGlibw+6w39m+SzOeknuuZNQ=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO check failed: json pattern check failed. For field $[-2:].detail.status.username, regex did not match the result INFO: TestDriverCurl::run() at 1368:Test JOBS_4 FAILED at 1381799082 Results so far, PASSED: 3 FAILED: 1 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: JOBS_5 ****************************************************** Beginning test JOBS_5 at 1381799082 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -H , Content-Type: application/json , -H , Content-Type: application/json , -X , GET , -o , /tmp/ekoifman.1381798977/JOBS_5.res_body , -D , /tmp/ekoifman.1381798977/JOBS_5.res_header , http://localhost:50111/templeton/v1/jobs?user.name=hive&fields=* result : ( "body", "[{\"id\":\"job_201310141642_0008\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794261545,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":8,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0008\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0008/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0008\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":8,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0008\"},\"id\":\"job_201310141642_0008\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:60421/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381794223/JOBS_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:60421/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0012\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794272714,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":12,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0012\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0012/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0012\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":12,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0012\"},\"id\":\"job_201310141642_0012\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0044\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796257061,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":44,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0044\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0044/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0044\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":44,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0044\"},\"id\":\"job_201310141642_0044\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:62235/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381796256/JOBS_1\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:62235/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0048\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796271467,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":48,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0048\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0048/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0048\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":48,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0048\"},\"id\":\"job_201310141642_0048\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0057\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796326271,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":57,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0057\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0057/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0057\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":57,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0057\"},\"id\":\"job_201310141642_0057\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:62882/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381796256/JOBS_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:62882/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0058\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796335189,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":58,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0058\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0058/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0058\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":58,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0058\"},\"id\":\"job_201310141642_0058\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0087\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797924958,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":87,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0087\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0087/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0087\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":87,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0087\"},\"id\":\"job_201310141642_0087\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:65134/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381797924/JOBS_1\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:65134/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0094\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797939623,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":94,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0094\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0094/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0094\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":94,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0094\"},\"id\":\"job_201310141642_0094\",\"parentId\":\"job_201310141642_0087\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0103\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797995215,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":103,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0103\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0103/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0103\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":103,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0103\"},\"id\":\"job_201310141642_0103\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:49366/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381797924/JOBS_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:49366/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0104\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798004259,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":104,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0104\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0104/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0104\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":104,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0104\"},\"id\":\"job_201310141642_0104\",\"parentId\":\"job_201310141642_0103\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0134\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798978101,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":134,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0134\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0134/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0134\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":134,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0134\"},\"id\":\"job_201310141642_0134\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:51243/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_1\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:51243/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0140\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798993471,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":140,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0140\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0140/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0140\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":140,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0140\"},\"id\":\"job_201310141642_0140\",\"parentId\":\"job_201310141642_0134\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0149\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799048399,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":149,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0149\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0149/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0149\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":149,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0149\"},\"id\":\"job_201310141642_0149\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:51877/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:51877/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0150\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799057467,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":150,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0150\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0150/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0150\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":150,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0150\"},\"id\":\"job_201310141642_0150\",\"parentId\":\"job_201310141642_0149\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}}]", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=hive&p=hive&t=simple&e=1381835082245&s=NiJkE5irDl/MFoFlQZejVGqRdoU=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=hive&p=hive&t=simple&e=1381835082245&s=NiJkE5irDl/MFoFlQZejVGqRdoU=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )INFO: TestDriverCurl::run() at 1368:Test JOBS_5 SUCCEEDED at 1381799082 Results so far, PASSED: 4 FAILED: 1 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: JOBS_6 ****************************************************** Beginning test JOBS_6 at 1381799082 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -H , Content-Type: application/json , -H , Content-Type: application/json , -X , GET , -o , /tmp/ekoifman.1381798977/JOBS_6.res_body , -D , /tmp/ekoifman.1381798977/JOBS_6.res_header , http://localhost:50111/templeton/v1/jobs?user.name=hive result : ( "body", "[{\"id\":\"job_201310141642_0008\",\"detail\":null},{\"id\":\"job_201310141642_0012\",\"detail\":null},{\"id\":\"job_201310141642_0044\",\"detail\":null},{\"id\":\"job_201310141642_0048\",\"detail\":null},{\"id\":\"job_201310141642_0057\",\"detail\":null},{\"id\":\"job_201310141642_0058\",\"detail\":null},{\"id\":\"job_201310141642_0087\",\"detail\":null},{\"id\":\"job_201310141642_0094\",\"detail\":null},{\"id\":\"job_201310141642_0103\",\"detail\":null},{\"id\":\"job_201310141642_0104\",\"detail\":null},{\"id\":\"job_201310141642_0134\",\"detail\":null},{\"id\":\"job_201310141642_0140\",\"detail\":null},{\"id\":\"job_201310141642_0149\",\"detail\":null},{\"id\":\"job_201310141642_0150\",\"detail\":null}]", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=hive&p=hive&t=simple&e=1381835082464&s=67yrgk7Qo/y+Mvb36jybx+WIi0Q=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=hive&p=hive&t=simple&e=1381835082464&s=67yrgk7Qo/y+Mvb36jybx+WIi0Q=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )INFO: TestDriverCurl::run() at 1368:Test JOBS_6 SUCCEEDED at 1381799082 Results so far, PASSED: 5 FAILED: 1 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: JOBS_7 ****************************************************** Beginning test JOBS_7 at 1381799082 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -H , Content-Type: application/json , -H , Content-Type: application/json , -X , GET , -o , /tmp/ekoifman.1381798977/JOBS_7.res_body , -D , /tmp/ekoifman.1381798977/JOBS_7.res_header , http://localhost:50111/templeton/v1/jobs?user.name=hive&fields=* result : ( "body", "[{\"id\":\"job_201310141642_0008\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794261545,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":8,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0008\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0008/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0008\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":8,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0008\"},\"id\":\"job_201310141642_0008\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:60421/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381794223/JOBS_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:60421/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0012\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381794272714,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":12,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0012\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0012/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0012\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":12,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0012\"},\"id\":\"job_201310141642_0012\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0044\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796257061,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":44,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0044\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0044/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0044\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":44,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0044\"},\"id\":\"job_201310141642_0044\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:62235/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381796256/JOBS_1\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:62235/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0048\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796271467,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":48,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0048\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0048/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0048\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":48,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0048\"},\"id\":\"job_201310141642_0048\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0057\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796326271,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":57,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0057\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0057/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0057\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":57,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0057\"},\"id\":\"job_201310141642_0057\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:62882/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381796256/JOBS_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:62882/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0058\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381796335189,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":58,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0058\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0058/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0058\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":58,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0058\"},\"id\":\"job_201310141642_0058\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0087\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797924958,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":87,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0087\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0087/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0087\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":87,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0087\"},\"id\":\"job_201310141642_0087\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:65134/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381797924/JOBS_1\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:65134/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0094\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797939623,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":94,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0094\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0094/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0094\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":94,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0094\"},\"id\":\"job_201310141642_0094\",\"parentId\":\"job_201310141642_0087\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0103\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381797995215,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":103,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0103\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0103/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0103\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":103,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0103\"},\"id\":\"job_201310141642_0103\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:49366/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381797924/JOBS_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:49366/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0104\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798004259,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":104,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0104\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0104/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0104\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":104,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0104\"},\"id\":\"job_201310141642_0104\",\"parentId\":\"job_201310141642_0103\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0134\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798978101,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":134,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0134\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0134/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0134\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":134,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0134\"},\"id\":\"job_201310141642_0134\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:51243/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_1\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:51243/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0140\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798993471,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":140,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0140\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0140/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0140\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":140,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0140\"},\"id\":\"job_201310141642_0140\",\"parentId\":\"job_201310141642_0134\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}},{\"id\":\"job_201310141642_0149\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799048399,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":149,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0149\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0149/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0149\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":149,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0149\"},\"id\":\"job_201310141642_0149\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"hive\",\"callback\":\"http://ekoifman.local:51877/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/JOBS_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"hive\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:51877/templeton/\$jobId\"}}},{\"id\":\"job_201310141642_0150\",\"detail\":{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799057467,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"hive\",\"jobID\":{\"id\":150,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0150\",\"jobComplete\":true},\"profile\":{\"user\":\"hive\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/hive/.staging/job_201310141642_0150/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0150\",\"queueName\":\"default\",\"jobName\":\"PigLatin:loadstore.pig\",\"jobID\":{\"id\":150,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0150\"},\"id\":\"job_201310141642_0150\",\"parentId\":\"job_201310141642_0149\",\"percentComplete\":null,\"exitValue\":null,\"user\":\"hive\",\"callback\":null,\"completed\":null,\"userargs\":{}}}]", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=hive&p=hive&t=simple&e=1381835082497&s=lf8mz5awg4S0E97qHeGFRe5m0gQ=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=hive&p=hive&t=simple&e=1381835082497&s=lf8mz5awg4S0E97qHeGFRe5m0gQ=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )INFO: TestDriverCurl::run() at 1368:Test JOBS_7 SUCCEEDED at 1381799082 Results so far, PASSED: 6 FAILED: 1 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: JOBS_8 ****************************************************** Beginning test JOBS_8 at 1381799082 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -H , Content-Type: application/json , -H , Content-Type: application/json , -X , GET , -o , /tmp/ekoifman.1381798977/JOBS_8.res_body , -D , /tmp/ekoifman.1381798977/JOBS_8.res_header , http://localhost:50111/templeton/v1/queue?user.name=hive result : ( "body", "[\"job_201310141642_0008\",\"job_201310141642_0012\",\"job_201310141642_0044\",\"job_201310141642_0048\",\"job_201310141642_0057\",\"job_201310141642_0058\",\"job_201310141642_0087\",\"job_201310141642_0094\",\"job_201310141642_0103\",\"job_201310141642_0104\",\"job_201310141642_0134\",\"job_201310141642_0140\",\"job_201310141642_0149\",\"job_201310141642_0150\"]", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=hive&p=hive&t=simple&e=1381835082977&s=Ks3R7nbaAwkJEZbLNSJb8WaZp9c=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=hive&p=hive&t=simple&e=1381835082977&s=Ks3R7nbaAwkJEZbLNSJb8WaZp9c=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )ERROR TestDriverCurl::run at : 1394 Failed to run test JOBS_8 Results so far, PASSED: 6 FAILED: 1 SKIPPED: 0 ABORTED: 1 FAILED DEPENDENCY: 0 INFO: ./test_harness.pl at 578 : Loading configuration file /Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/tests/jobsubmission_streaming.conf INFO ./test_harness.pl: hadoopversion=${hadoopversion} INFO ./test_harness.pl: harnessCfg=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/conf/default.conf INFO ./test_harness.pl: tmpPath=/tmp/pigtest INFO ./test_harness.pl: UID=1381798977 INFO ./test_harness.pl: harness.console.level=ERROR INFO ./test_harness.pl: logDir=./log INFO ./test_harness.pl: localoutpathbase=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/testdist/ INFO ./test_harness.pl: outpathbase=/tmp/templeton_test_out INFO ./test_harness.pl: local.bin=/usr/bin INFO ./test_harness.pl: userhomePath=/Users/ekoifman INFO ./test_harness.pl: logfile=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/testdist//test_harnesss_1381798977 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , PUT , -o , /tmp/ekoifman.1381798977/_.res_body , -D , /tmp/ekoifman.1381798977/_.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/?op=MKDIRS&permission=777&user.name=ekoifman result : ( "body", "{\"boolean\":true}", "rc", 0, "stderr", undef, "header_fields", {}, "full_header", "", "stdout", undef, )INFO TestDriverCurl::run at 1235: Running TEST GROUP(TestStreaming) ****************************************************** TEST: TestStreaming_1 ****************************************************** Beginning test TestStreaming_1 at 1381798977 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51239/templeton/$jobId , -d , user.name=ekoifman , -d , input=/user/ekoifman/webhcate2e/nums.txt , -d , input=/user/ekoifman/webhcate2e/nums.txt , -d , output=/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_1/mycounts , -d , mapper=cat , -d , reducer=wc , -X , POST , -o , /tmp/ekoifman.1381798977/TestStreaming_1.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_1.res_header , http://localhost:50111/templeton/v1/mapreduce/streaming result : ( "body", "{\"id\":\"job_201310141642_0136\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834977674&s=oFQksfbO3hDJKXO6mL5vdMcw+JM=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834977674&s=oFQksfbO3hDJKXO6mL5vdMcw+JM=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0136") Comparing id: job_201310141642_0136 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51576/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_1_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_1_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0136?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798978094,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":136,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0136\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0136/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0136\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":136,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0136\"},\"id\":\"job_201310141642_0136\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51239/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"cat\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:51239/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_1/mycounts\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835014562&s=Z1UTwi3kRopmyrjaNMh097GiD7Q=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835014562&s=Z1UTwi3kRopmyrjaNMh097GiD7Q=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt input=/user/ekoifman/webhcate2e/nums.txtopt input=/user/ekoifman/webhcate2e/nums.txtopt output=/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_1/mycountsopt mapper=catopt reducer=wcopt callback=http://ekoifman.local:51239/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected input ->[ "/user/ekoifman/webhcate2e/nums.txt", "/user/ekoifman/webhcate2e/nums.txt", ] With result input ->[ "/user/ekoifman/webhcate2e/nums.txt", "/user/ekoifman/webhcate2e/nums.txt", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:51239/templeton/\$jobId" With result callback ->"http://ekoifman.local:51239/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected mapper ->"cat" With result mapper ->"cat" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected output ->"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_1/mycounts" With result output ->"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_1/mycounts" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected reducer ->"wc" With result reducer ->"wc" INFO: TestDriverCurl::run() at 1368:Test TestStreaming_1 SUCCEEDED at 1381799014 Results so far, PASSED: 1 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestStreaming_2 ****************************************************** Beginning test TestStreaming_2 at 1381799014 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51585/templeton/$jobId , -d , user.name=ekoifman , -d , input=/user/ekoifman/webhcate2e/nums.txt , -d , input=/user/ekoifman/webhcate2e/nums.txt , -d , output=/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_2/mycounts , -d , mapper=ls no_such-file-12e3 , -d , reducer=wc , -X , POST , -o , /tmp/ekoifman.1381798977/TestStreaming_2.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_2.res_header , http://localhost:50111/templeton/v1/mapreduce/streaming result : ( "body", "{\"id\":\"job_201310141642_0143\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835014637&s=VhhaJRHVyXno7K3wpCIscLVZ5rQ=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835014637&s=VhhaJRHVyXno7K3wpCIscLVZ5rQ=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0143") Comparing id: job_201310141642_0143 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52026/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_2_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_2_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0143?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799014723,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":143,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0143\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0143/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0143\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":143,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0143\"},\"id\":\"job_201310141642_0143\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":1,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51585/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"ls no_such-file-12e3\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:51585/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_2/mycounts\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835063405&s=zEkfNIeHZiyUpQeaDu/F3uiW8hM=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835063405&s=zEkfNIeHZiyUpQeaDu/F3uiW8hM=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt input=/user/ekoifman/webhcate2e/nums.txtopt input=/user/ekoifman/webhcate2e/nums.txtopt output=/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_2/mycountsopt mapper=ls no_such-file-12e3opt reducer=wcopt callback=http://ekoifman.local:51585/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected input ->[ "/user/ekoifman/webhcate2e/nums.txt", "/user/ekoifman/webhcate2e/nums.txt", ] With result input ->[ "/user/ekoifman/webhcate2e/nums.txt", "/user/ekoifman/webhcate2e/nums.txt", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:51585/templeton/\$jobId" With result callback ->"http://ekoifman.local:51585/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected mapper ->"ls no_such-file-12e3" With result mapper ->"ls no_such-file-12e3" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected output ->"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_2/mycounts" With result output ->"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_2/mycounts" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected reducer ->"wc" With result reducer ->"wc" INFO: TestDriverCurl::run() at 1368:Test TestStreaming_2 SUCCEEDED at 1381799063 Results so far, PASSED: 2 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestStreaming_3 ****************************************************** Beginning test TestStreaming_3 at 1381799063 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52034/templeton/$jobId , -d , user.name=ekoifman , -d , input=/user/ekoifman/webhcate2e/nums.txt , -d , input=/user/ekoifman/webhcate2e/nums.txt , -d , output=/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/mycounts , -d , mapper=cat , -d , reducer=wc , -d , statusdir=/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/status , -d , enablelog=true , -X , POST , -o , /tmp/ekoifman.1381798977/TestStreaming_3.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_3.res_header , http://localhost:50111/templeton/v1/mapreduce/streaming result : ( "body", "{\"id\":\"job_201310141642_0152\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835063484&s=5WL+Fl8TKmVVWB8AgqXuHDokcSo=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835063484&s=5WL+Fl8TKmVVWB8AgqXuHDokcSo=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0152") Comparing id: job_201310141642_0152 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52762/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_3_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_3_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0152?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799063571,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":152,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0152\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0152/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0152\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":152,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0152\"},\"id\":\"job_201310141642_0152\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:52034/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/status\",\"files\":null,\"define\":[],\"mapper\":\"cat\",\"arg\":[],\"enablelog\":\"true\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:52034/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/mycounts\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835095930&s=dQK+xq1WTPYpv/7HwikHhaJr/5g=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835095930&s=dQK+xq1WTPYpv/7HwikHhaJr/5g=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt input=/user/ekoifman/webhcate2e/nums.txtopt input=/user/ekoifman/webhcate2e/nums.txtopt output=/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/mycountsopt mapper=catopt reducer=wcopt statusdir=/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/statusopt enablelog=trueopt callback=http://ekoifman.local:52034/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected statusdir ->"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/status" With result statusdir ->"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/status" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected input ->[ "/user/ekoifman/webhcate2e/nums.txt", "/user/ekoifman/webhcate2e/nums.txt", ] With result input ->[ "/user/ekoifman/webhcate2e/nums.txt", "/user/ekoifman/webhcate2e/nums.txt", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected enablelog ->"true" With result enablelog ->"true" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected mapper ->"cat" With result mapper ->"cat" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected output ->"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/mycounts" With result output ->"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/mycounts" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected reducer ->"wc" With result reducer ->"wc" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:52034/templeton/\$jobId" With result callback ->"http://ekoifman.local:52034/templeton/\$jobId" ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52773/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_3.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_3.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/status/logs?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799093991,\"owner\":\"ekoifman\",\"pathSuffix\":\"job_201310141642_0153\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":1381799092869,\"blockSize\":67108864,\"group\":\"staff\",\"length\":762,\"modificationTime\":1381799092869,\"owner\":\"ekoifman\",\"pathSuffix\":\"list.txt\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "442\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 442\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52776/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_3.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_3.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/status/logs/job_201310141642_0153?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799093217,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0153_m_000000_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799093474,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0153_m_000001_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799094247,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0153_m_000002_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799093986,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0153_m_000003_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799093724,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0153_r_000000_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":1381799092921,\"blockSize\":67108864,\"group\":\"staff\",\"length\":27878,\"modificationTime\":1381799092921,\"owner\":\"ekoifman\",\"pathSuffix\":\"job.xml.html\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "1331\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 1331\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52780/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_3.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_3.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/status/logs/job_201310141642_0153/attempt_201310141642_0153_m_000000_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799093038,\"blockSize\":67108864,\"group\":\"staff\",\"length\":87,\"modificationTime\":1381799093038,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799093132,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799093132,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799093217,\"blockSize\":67108864,\"group\":\"staff\",\"length\":3266,\"modificationTime\":1381799093217,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "642\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 642\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52784/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_3.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_3.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/status/logs/job_201310141642_0153/attempt_201310141642_0153_m_000001_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799093302,\"blockSize\":67108864,\"group\":\"staff\",\"length\":87,\"modificationTime\":1381799093302,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799093388,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799093388,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799093474,\"blockSize\":67108864,\"group\":\"staff\",\"length\":3266,\"modificationTime\":1381799093474,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "642\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 642\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52787/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_3.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_3.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/status/logs/job_201310141642_0153/attempt_201310141642_0153_m_000002_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799094085,\"blockSize\":67108864,\"group\":\"staff\",\"length\":87,\"modificationTime\":1381799094085,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799094166,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799094166,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799094247,\"blockSize\":67108864,\"group\":\"staff\",\"length\":2322,\"modificationTime\":1381799094247,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "642\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 642\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52790/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_3.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_3.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/status/logs/job_201310141642_0153/attempt_201310141642_0153_m_000003_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799093808,\"blockSize\":67108864,\"group\":\"staff\",\"length\":87,\"modificationTime\":1381799093808,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799093893,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799093893,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799093986,\"blockSize\":67108864,\"group\":\"staff\",\"length\":2171,\"modificationTime\":1381799093986,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "642\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 642\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52793/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_3.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_3.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_3/status/logs/job_201310141642_0153/attempt_201310141642_0153_r_000000_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799093559,\"blockSize\":67108864,\"group\":\"staff\",\"length\":87,\"modificationTime\":1381799093559,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799093644,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799093644,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799093724,\"blockSize\":67108864,\"group\":\"staff\",\"length\":5666,\"modificationTime\":1381799093724,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "642\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 642\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )INFO: TestDriverCurl::run() at 1368:Test TestStreaming_3 SUCCEEDED at 1381799096 Results so far, PASSED: 3 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestStreaming_4 ****************************************************** Beginning test TestStreaming_4 at 1381799096 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52796/templeton/$jobId , -d , user.name=ekoifman , -d , input=/user/ekoifman/webhcate2e/nums.txt , -d , input=/user/ekoifman/webhcate2e/nums.txt , -d , output=/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/mycounts , -d , mapper=ls no_such-file-12e3 , -d , reducer=wc , -d , statusdir=/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status , -d , enablelog=true , -X , POST , -o , /tmp/ekoifman.1381798977/TestStreaming_4.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_4.res_header , http://localhost:50111/templeton/v1/mapreduce/streaming result : ( "body", "{\"id\":\"job_201310141642_0156\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835096206&s=udTdzD1pDbcTDrXxuPutbaSzV8w=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835096206&s=udTdzD1pDbcTDrXxuPutbaSzV8w=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0156") Comparing id: job_201310141642_0156 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53046/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_4_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_4_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0156?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799096268,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":156,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0156\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0156/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0156\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":156,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0156\"},\"id\":\"job_201310141642_0156\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":1,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:52796/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"reducer\":\"wc\",\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status\",\"files\":null,\"define\":[],\"mapper\":\"ls no_such-file-12e3\",\"arg\":[],\"enablelog\":\"true\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":\"http://ekoifman.local:52796/templeton/\$jobId\",\"output\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/mycounts\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835145271&s=1Mvq/EV8QscEUpur+fxSpXZR2Sc=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835145271&s=1Mvq/EV8QscEUpur+fxSpXZR2Sc=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt input=/user/ekoifman/webhcate2e/nums.txtopt input=/user/ekoifman/webhcate2e/nums.txtopt output=/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/mycountsopt mapper=ls no_such-file-12e3opt reducer=wcopt statusdir=/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/statusopt enablelog=trueopt callback=http://ekoifman.local:52796/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected statusdir ->"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status" With result statusdir ->"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected input ->[ "/user/ekoifman/webhcate2e/nums.txt", "/user/ekoifman/webhcate2e/nums.txt", ] With result input ->[ "/user/ekoifman/webhcate2e/nums.txt", "/user/ekoifman/webhcate2e/nums.txt", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected enablelog ->"true" With result enablelog ->"true" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected mapper ->"ls no_such-file-12e3" With result mapper ->"ls no_such-file-12e3" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected output ->"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/mycounts" With result output ->"/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/mycounts" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected reducer ->"wc" With result reducer ->"wc" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:52796/templeton/\$jobId" With result callback ->"http://ekoifman.local:52796/templeton/\$jobId" ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53055/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_4.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_4.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status/logs?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799143387,\"owner\":\"ekoifman\",\"pathSuffix\":\"job_201310141642_0157\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":1381799140619,\"blockSize\":67108864,\"group\":\"staff\",\"length\":1435,\"modificationTime\":1381799140619,\"owner\":\"ekoifman\",\"pathSuffix\":\"list.txt\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "443\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 443\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53058/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_4.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_4.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status/logs/job_201310141642_0157?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799141694,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0157_m_000000_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799141965,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0157_m_000000_1\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799142298,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0157_m_000000_2\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799142571,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0157_m_000000_3\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799142853,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0157_m_000001_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799143122,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0157_m_000001_1\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799143382,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0157_m_000001_2\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799143683,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0157_m_000001_3\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799141265,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0157_m_000002_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799140991,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0157_m_000003_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":1381799140669,\"blockSize\":67108864,\"group\":\"staff\",\"length\":27896,\"modificationTime\":1381799140669,\"owner\":\"ekoifman\",\"pathSuffix\":\"job.xml.html\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "2416\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 2416\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53061/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_4.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_4.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status/logs/job_201310141642_0157/attempt_201310141642_0157_m_000000_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799141504,\"blockSize\":67108864,\"group\":\"staff\",\"length\":1039,\"modificationTime\":1381799141504,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799141595,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799141595,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799141694,\"blockSize\":67108864,\"group\":\"staff\",\"length\":5077,\"modificationTime\":1381799141694,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "644\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 644\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53064/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_4.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_4.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status/logs/job_201310141642_0157/attempt_201310141642_0157_m_000000_1?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799141785,\"blockSize\":67108864,\"group\":\"staff\",\"length\":1039,\"modificationTime\":1381799141785,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799141876,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799141876,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799141965,\"blockSize\":67108864,\"group\":\"staff\",\"length\":5077,\"modificationTime\":1381799141965,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "644\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 644\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53067/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_4.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_4.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status/logs/job_201310141642_0157/attempt_201310141642_0157_m_000000_2?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799142122,\"blockSize\":67108864,\"group\":\"staff\",\"length\":1039,\"modificationTime\":1381799142122,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799142215,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799142215,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799142298,\"blockSize\":67108864,\"group\":\"staff\",\"length\":5077,\"modificationTime\":1381799142298,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "644\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 644\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53070/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_4.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_4.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status/logs/job_201310141642_0157/attempt_201310141642_0157_m_000000_3?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799142390,\"blockSize\":67108864,\"group\":\"staff\",\"length\":1039,\"modificationTime\":1381799142390,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799142481,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799142481,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799142571,\"blockSize\":67108864,\"group\":\"staff\",\"length\":5077,\"modificationTime\":1381799142571,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "644\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 644\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53073/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_4.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_4.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status/logs/job_201310141642_0157/attempt_201310141642_0157_m_000001_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799142661,\"blockSize\":67108864,\"group\":\"staff\",\"length\":1039,\"modificationTime\":1381799142661,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799142759,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799142759,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799142853,\"blockSize\":67108864,\"group\":\"staff\",\"length\":5077,\"modificationTime\":1381799142853,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "644\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 644\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53076/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_4.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_4.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status/logs/job_201310141642_0157/attempt_201310141642_0157_m_000001_1?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799142948,\"blockSize\":67108864,\"group\":\"staff\",\"length\":1039,\"modificationTime\":1381799142948,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799143036,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799143036,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799143122,\"blockSize\":67108864,\"group\":\"staff\",\"length\":5077,\"modificationTime\":1381799143122,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "644\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 644\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53079/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_4.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_4.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status/logs/job_201310141642_0157/attempt_201310141642_0157_m_000001_2?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799143209,\"blockSize\":67108864,\"group\":\"staff\",\"length\":1039,\"modificationTime\":1381799143209,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799143297,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799143297,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799143382,\"blockSize\":67108864,\"group\":\"staff\",\"length\":5077,\"modificationTime\":1381799143382,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "644\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 644\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53082/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_4.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_4.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status/logs/job_201310141642_0157/attempt_201310141642_0157_m_000001_3?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799143490,\"blockSize\":67108864,\"group\":\"staff\",\"length\":1039,\"modificationTime\":1381799143490,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799143587,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799143587,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799143683,\"blockSize\":67108864,\"group\":\"staff\",\"length\":5077,\"modificationTime\":1381799143683,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "644\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 644\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53085/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_4.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_4.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status/logs/job_201310141642_0157/attempt_201310141642_0157_m_000002_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799141082,\"blockSize\":67108864,\"group\":\"staff\",\"length\":87,\"modificationTime\":1381799141082,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799141182,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799141182,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799141265,\"blockSize\":67108864,\"group\":\"staff\",\"length\":2343,\"modificationTime\":1381799141265,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "642\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 642\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53088/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestStreaming_4.res_body , -D , /tmp/ekoifman.1381798977/TestStreaming_4.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestStreaming_4/status/logs/job_201310141642_0157/attempt_201310141642_0157_m_000003_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799140815,\"blockSize\":67108864,\"group\":\"staff\",\"length\":87,\"modificationTime\":1381799140815,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799140906,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799140906,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799140991,\"blockSize\":67108864,\"group\":\"staff\",\"length\":2171,\"modificationTime\":1381799140991,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "642\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 642\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )INFO: TestDriverCurl::run() at 1368:Test TestStreaming_4 SUCCEEDED at 1381799145 Results so far, PASSED: 4 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 INFO: ./test_harness.pl at 578 : Loading configuration file /Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/tests/jobsubmission.conf INFO ./test_harness.pl: hadoopversion=${hadoopversion} INFO ./test_harness.pl: harnessCfg=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/conf/default.conf INFO ./test_harness.pl: tmpPath=/tmp/pigtest INFO ./test_harness.pl: UID=1381798977 INFO ./test_harness.pl: harness.console.level=ERROR INFO ./test_harness.pl: logDir=./log INFO ./test_harness.pl: localoutpathbase=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/testdist/ INFO ./test_harness.pl: outpathbase=/tmp/templeton_test_out INFO ./test_harness.pl: local.bin=/usr/bin INFO ./test_harness.pl: userhomePath=/Users/ekoifman INFO ./test_harness.pl: logfile=/Users/ekoifman/dev/hive/hcatalog/src/test/e2e/templeton/testdist//test_harnesss_1381798977 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , PUT , -o , /tmp/ekoifman.1381798977/_.res_body , -D , /tmp/ekoifman.1381798977/_.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/?op=MKDIRS&permission=777&user.name=ekoifman result : ( "body", "{\"boolean\":true}", "rc", 0, "stderr", undef, "header_fields", {}, "full_header", "", "stdout", undef, )INFO TestDriverCurl::run at 1235: Running TEST GROUP(TestKillJob) ****************************************************** TEST: TestKillJob_1 ****************************************************** Beginning test TestKillJob_1 at 1381798977 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , user.name=ekoifman , -d , input=/user/ekoifman/webhcate2e/nums.txt , -d , input=/user/ekoifman/webhcate2e/nums.txt , -d , output=/tmp/templeton_test_out/ekoifman.1381798977/TestKillJob_1/mycounts , -d , mapper=sleep 100 , -d , reducer=wc , -X , POST , -o , /tmp/ekoifman.1381798977/TestKillJob_1.res_body , -D , /tmp/ekoifman.1381798977/TestKillJob_1.res_header , http://localhost:50111/templeton/v1/mapreduce/streaming result : ( "body", "{\"id\":\"job_201310141642_0135\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834977674&s=oFQksfbO3hDJKXO6mL5vdMcw+JM=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834977674&s=oFQksfbO3hDJKXO6mL5vdMcw+JM=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0135") Comparing id: job_201310141642_0135 with regex /\d+/ ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , DELETE , -o , /tmp/ekoifman.1381798977/TestKillJob_1_killJob.res_body , -D , /tmp/ekoifman.1381798977/TestKillJob_1_killJob.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0135?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":1,\"startTime\":1381798978094,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":135,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0135\",\"jobComplete\":false},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0135/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0135\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":135,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0135\"},\"id\":\"job_201310141642_0135\",\"parentId\":null,\"percentComplete\":\"map 0% reduce 0%\",\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"sleep 100\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":null,\"output\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestKillJob_1/mycounts\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834988834&s=LP2t3SsNeZUX9kv/kWQPLa53U/s=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834988834&s=LP2t3SsNeZUX9kv/kWQPLa53U/s=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/TestKillJob_1_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestKillJob_1_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0135?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":1,\"startTime\":1381798978094,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":135,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0135\",\"jobComplete\":false},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0135/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0135\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":135,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0135\"},\"id\":\"job_201310141642_0135\",\"parentId\":null,\"percentComplete\":\"map 0% reduce 0%\",\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"sleep 100\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":null,\"output\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestKillJob_1/mycounts\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834989174&s=kK5XoBMEGrADiPQ6QgyrReQygm4=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834989174&s=kK5XoBMEGrADiPQ6QgyrReQygm4=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/TestKillJob_1_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestKillJob_1_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0135?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":5,\"startTime\":1381798978094,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":135,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0135\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0135/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0135\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":135,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0135\"},\"id\":\"job_201310141642_0135\",\"parentId\":null,\"percentComplete\":\"map 0% reduce 0%\",\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"reducer\":\"wc\",\"statusdir\":null,\"files\":null,\"define\":[],\"mapper\":\"sleep 100\",\"arg\":[],\"enablelog\":\"false\",\"input\":[\"/user/ekoifman/webhcate2e/nums.txt\",\"/user/ekoifman/webhcate2e/nums.txt\"],\"cmdenv\":[],\"user.name\":\"ekoifman\",\"file\":[],\"combiner\":null,\"callback\":null,\"output\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestKillJob_1/mycounts\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834994239&s=j1oNhtVBPsiOxqXzjol93wngsDQ=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834994239&s=j1oNhtVBPsiOxqXzjol93wngsDQ=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt input=/user/ekoifman/webhcate2e/nums.txtopt input=/user/ekoifman/webhcate2e/nums.txtopt output=/tmp/templeton_test_out/ekoifman.1381798977/TestKillJob_1/mycountsopt mapper=sleep 100opt reducer=wc./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected input ->[ "/user/ekoifman/webhcate2e/nums.txt", "/user/ekoifman/webhcate2e/nums.txt", ] With result input ->[ "/user/ekoifman/webhcate2e/nums.txt", "/user/ekoifman/webhcate2e/nums.txt", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected mapper ->"sleep 100" With result mapper ->"sleep 100" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected output ->"/tmp/templeton_test_out/ekoifman.1381798977/TestKillJob_1/mycounts" With result output ->"/tmp/templeton_test_out/ekoifman.1381798977/TestKillJob_1/mycounts" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected reducer ->"wc" With result reducer ->"wc" INFO: TestDriverCurl::run() at 1368:Test TestKillJob_1 SUCCEEDED at 1381798994 Results so far, PASSED: 1 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 INFO TestDriverCurl::run at 1235: Running TEST GROUP(TestMapReduce) ****************************************************** TEST: TestMapReduce_1 ****************************************************** Beginning test TestMapReduce_1 at 1381798994 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51465/templeton/$jobId , -d , user.name=ekoifman , -d , arg=/user/ekoifman/webhcate2e/nums.txt , -d , arg= /tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_1/wc.txt , -d , jar=/user/ekoifman/webhcate2e/hexamples.jar , -d , class=wordcount , -X , POST , -o , /tmp/ekoifman.1381798977/TestMapReduce_1.res_body , -D , /tmp/ekoifman.1381798977/TestMapReduce_1.res_header , http://localhost:50111/templeton/v1/mapreduce/jar result : ( "body", "{\"id\":\"job_201310141642_0141\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834994276&s=Wj0bv77HisucJiIv/N2tBYI5y/w=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381834994276&s=Wj0bv77HisucJiIv/N2tBYI5y/w=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0141") Comparing id: job_201310141642_0141 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51699/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestMapReduce_1_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestMapReduce_1_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0141?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381798994354,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":141,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0141\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0141/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0141\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":141,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0141\"},\"id\":\"job_201310141642_0141\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51465/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"define\":[],\"arg\":[\"/user/ekoifman/webhcate2e/nums.txt\",\" /tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_1/wc.txt\"],\"files\":null,\"enablelog\":\"false\",\"libjars\":null,\"user.name\":\"ekoifman\",\"jar\":\"/user/ekoifman/webhcate2e/hexamples.jar\",\"callback\":\"http://ekoifman.local:51465/templeton/\$jobId\",\"class\":\"wordcount\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835025761&s=G5FErSy4HYuq7jpSQ6PQAoZYJnA=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835025761&s=G5FErSy4HYuq7jpSQ6PQAoZYJnA=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt arg=/user/ekoifman/webhcate2e/nums.txtopt arg= /tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_1/wc.txtopt jar=/user/ekoifman/webhcate2e/hexamples.jaropt class=wordcountopt callback=http://ekoifman.local:51465/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:51465/templeton/\$jobId" With result callback ->"http://ekoifman.local:51465/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected jar ->"/user/ekoifman/webhcate2e/hexamples.jar" With result jar ->"/user/ekoifman/webhcate2e/hexamples.jar" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected arg ->[ "/user/ekoifman/webhcate2e/nums.txt", " /tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_1/wc.txt", ] With result arg ->[ "/user/ekoifman/webhcate2e/nums.txt", " /tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_1/wc.txt", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected class ->"wordcount" With result class ->"wordcount" INFO: TestDriverCurl::run() at 1368:Test TestMapReduce_1 SUCCEEDED at 1381799025 Results so far, PASSED: 2 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestMapReduce_2 ****************************************************** Beginning test TestMapReduce_2 at 1381799025 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51707/templeton/$jobId , -d , user.name=ekoifman , -d , arg=/user/ekoifman/webhcate2e/nums.txt , -d , arg= /tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/wc.txt , -d , jar=/user/ekoifman/webhcate2e/hexamples.jar , -d , class=wordcount , -d , statusdir=/tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/status , -d , enablelog=true , -X , POST , -o , /tmp/ekoifman.1381798977/TestMapReduce_2.res_body , -D , /tmp/ekoifman.1381798977/TestMapReduce_2.res_header , http://localhost:50111/templeton/v1/mapreduce/jar result : ( "body", "{\"id\":\"job_201310141642_0147\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835025843&s=/RaW1eP+hq9UrlDdyJA/HuktHYE=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835025843&s=/RaW1eP+hq9UrlDdyJA/HuktHYE=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0147") Comparing id: job_201310141642_0147 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51957/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestMapReduce_2_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestMapReduce_2_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0147?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799025956,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":147,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0147\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0147/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0147\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":147,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0147\"},\"id\":\"job_201310141642_0147\",\"parentId\":null,\"percentComplete\":\"map 100% reduce 100%\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51707/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/status\",\"define\":[],\"arg\":[\"/user/ekoifman/webhcate2e/nums.txt\",\" /tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/wc.txt\"],\"files\":null,\"enablelog\":\"true\",\"libjars\":null,\"user.name\":\"ekoifman\",\"jar\":\"/user/ekoifman/webhcate2e/hexamples.jar\",\"callback\":\"http://ekoifman.local:51707/templeton/\$jobId\",\"class\":\"wordcount\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835058856&s=pTIahQNRcKqGnySNoMcQxNSCZJI=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835058856&s=pTIahQNRcKqGnySNoMcQxNSCZJI=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt arg=/user/ekoifman/webhcate2e/nums.txtopt arg= /tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/wc.txtopt jar=/user/ekoifman/webhcate2e/hexamples.jaropt class=wordcountopt statusdir=/tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/statusopt enablelog=trueopt callback=http://ekoifman.local:51707/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected statusdir ->"/tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/status" With result statusdir ->"/tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/status" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:51707/templeton/\$jobId" With result callback ->"http://ekoifman.local:51707/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected enablelog ->"true" With result enablelog ->"true" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected jar ->"/user/ekoifman/webhcate2e/hexamples.jar" With result jar ->"/user/ekoifman/webhcate2e/hexamples.jar" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected arg ->[ "/user/ekoifman/webhcate2e/nums.txt", " /tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/wc.txt", ] With result arg ->[ "/user/ekoifman/webhcate2e/nums.txt", " /tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/wc.txt", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected class ->"wordcount" With result class ->"wordcount" ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51966/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestMapReduce_2.res_body , -D , /tmp/ekoifman.1381798977/TestMapReduce_2.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/status/logs?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799057255,\"owner\":\"ekoifman\",\"pathSuffix\":\"job_201310141642_0148\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":1381799056248,\"blockSize\":67108864,\"group\":\"staff\",\"length\":607,\"modificationTime\":1381799056248,\"owner\":\"ekoifman\",\"pathSuffix\":\"list.txt\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "442\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 442\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51969/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestMapReduce_2.res_body , -D , /tmp/ekoifman.1381798977/TestMapReduce_2.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/status/logs/job_201310141642_0148?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799056733,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0148_m_000000_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799057526,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0148_m_000001_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799057250,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0148_m_000002_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799056987,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0148_r_000000_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":1381799056438,\"blockSize\":67108864,\"group\":\"staff\",\"length\":26612,\"modificationTime\":1381799056438,\"owner\":\"ekoifman\",\"pathSuffix\":\"job.xml.html\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "1114\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 1114\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51972/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestMapReduce_2.res_body , -D , /tmp/ekoifman.1381798977/TestMapReduce_2.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/status/logs/job_201310141642_0148/attempt_201310141642_0148_m_000000_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799056564,\"blockSize\":67108864,\"group\":\"staff\",\"length\":87,\"modificationTime\":1381799056564,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799056647,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799056647,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799056733,\"blockSize\":67108864,\"group\":\"staff\",\"length\":1338,\"modificationTime\":1381799056733,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "642\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 642\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51975/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestMapReduce_2.res_body , -D , /tmp/ekoifman.1381798977/TestMapReduce_2.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/status/logs/job_201310141642_0148/attempt_201310141642_0148_m_000001_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799057346,\"blockSize\":67108864,\"group\":\"staff\",\"length\":87,\"modificationTime\":1381799057346,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799057440,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799057440,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799057526,\"blockSize\":67108864,\"group\":\"staff\",\"length\":938,\"modificationTime\":1381799057526,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "641\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 641\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51978/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestMapReduce_2.res_body , -D , /tmp/ekoifman.1381798977/TestMapReduce_2.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/status/logs/job_201310141642_0148/attempt_201310141642_0148_m_000002_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799057074,\"blockSize\":67108864,\"group\":\"staff\",\"length\":87,\"modificationTime\":1381799057074,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799057159,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799057159,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799057250,\"blockSize\":67108864,\"group\":\"staff\",\"length\":787,\"modificationTime\":1381799057250,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "641\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 641\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51981/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestMapReduce_2.res_body , -D , /tmp/ekoifman.1381798977/TestMapReduce_2.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestMapReduce_2/status/logs/job_201310141642_0148/attempt_201310141642_0148_r_000000_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799056818,\"blockSize\":67108864,\"group\":\"staff\",\"length\":87,\"modificationTime\":1381799056818,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799056903,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799056903,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799056987,\"blockSize\":67108864,\"group\":\"staff\",\"length\":3655,\"modificationTime\":1381799056987,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "642\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 642\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )INFO: TestDriverCurl::run() at 1368:Test TestMapReduce_2 SUCCEEDED at 1381799059 Results so far, PASSED: 3 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 INFO TestDriverCurl::run at 1235: Running TEST GROUP(TestPig) ****************************************************** TEST: TestPig_1 ****************************************************** Beginning test TestPig_1 at 1381799059 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:51984/templeton/$jobId , -d , user.name=ekoifman , -d , execute=asdf , -X , POST , -o , /tmp/ekoifman.1381798977/TestPig_1.res_body , -D , /tmp/ekoifman.1381798977/TestPig_1.res_header , http://localhost:50111/templeton/v1/pig result : ( "body", "{\"id\":\"job_201310141642_0151\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835059159&s=1FfCS/x9bCTm6rQq5FnPumHHYSk=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835059159&s=1FfCS/x9bCTm6rQq5FnPumHHYSk=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0151") Comparing id: job_201310141642_0151 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52108/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestPig_1_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestPig_1_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0151?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799059257,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":151,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0151\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0151/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0151\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":151,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0151\"},\"id\":\"job_201310141642_0151\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":8,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:51984/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[],\"enablelog\":\"false\",\"execute\":\"asdf\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:51984/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835077408&s=G24Y2p8zbwU+4Lj4uGhstGAni30=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835077408&s=G24Y2p8zbwU+4Lj4uGhstGAni30=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt execute=asdfopt callback=http://ekoifman.local:51984/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected execute ->"asdf" With result execute ->"asdf" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:51984/templeton/\$jobId" With result callback ->"http://ekoifman.local:51984/templeton/\$jobId" INFO: TestDriverCurl::run() at 1368:Test TestPig_1 SUCCEEDED at 1381799077 Results so far, PASSED: 4 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestPig_2 ****************************************************** Beginning test TestPig_2 at 1381799077 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52116/templeton/$jobId , -d , user.name=ekoifman , -d , execute=fs -ls /user/ekoifman/webhcate2e; , -X , POST , -o , /tmp/ekoifman.1381798977/TestPig_2.res_body , -D , /tmp/ekoifman.1381798977/TestPig_2.res_header , http://localhost:50111/templeton/v1/pig result : ( "body", "{\"id\":\"job_201310141642_0154\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835077446&s=O0Mpr17gLYLucJdsoRHAFg+4oAE=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835077446&s=O0Mpr17gLYLucJdsoRHAFg+4oAE=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0154") Comparing id: job_201310141642_0154 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52731/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestPig_2_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestPig_2_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0154?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799077528,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":154,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0154\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0154/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0154\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":154,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0154\"},\"id\":\"job_201310141642_0154\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:52116/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[],\"enablelog\":\"false\",\"execute\":\"fs -ls /user/ekoifman/webhcate2e;\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:52116/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835095627&s=vgINto4ZUV+kX65xRBIXOjIh6C8=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835095627&s=vgINto4ZUV+kX65xRBIXOjIh6C8=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt execute=fs -ls /user/ekoifman/webhcate2e;opt callback=http://ekoifman.local:52116/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected execute ->"fs -ls /user/ekoifman/webhcate2e;" With result execute ->"fs -ls /user/ekoifman/webhcate2e;" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:52116/templeton/\$jobId" With result callback ->"http://ekoifman.local:52116/templeton/\$jobId" INFO: TestDriverCurl::run() at 1368:Test TestPig_2 SUCCEEDED at 1381799095 Results so far, PASSED: 5 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestPig_3 ****************************************************** Beginning test TestPig_3 at 1381799095 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52739/templeton/$jobId , -d , user.name=ekoifman , -d , arg=-check , -d , file=/user/ekoifman/webhcate2e/loadstore.pig , -d , arg=-p , -d , arg=INPDIR=/user/ekoifman/webhcate2e , -d , arg=-p , -d , arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_3 , -X , POST , -o , /tmp/ekoifman.1381798977/TestPig_3.res_body , -D , /tmp/ekoifman.1381798977/TestPig_3.res_header , http://localhost:50111/templeton/v1/pig result : ( "body", "{\"id\":\"job_201310141642_0155\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835095660&s=xkbFgDAWxRGB+fGTqgsA8w3qloQ=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835095660&s=xkbFgDAWxRGB+fGTqgsA8w3qloQ=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0155") Comparing id: job_201310141642_0155 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52878/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestPig_3_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestPig_3_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0155?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799095746,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":155,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0155\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0155/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0155\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":155,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0155\"},\"id\":\"job_201310141642_0155\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:52739/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-check\",\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_3\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:52739/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835114096&s=r+NOpIKVdWDn4YKSqHpS4GZAVYI=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835114096&s=r+NOpIKVdWDn4YKSqHpS4GZAVYI=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt arg=-checkopt file=/user/ekoifman/webhcate2e/loadstore.pigopt arg=-popt arg=INPDIR=/user/ekoifman/webhcate2eopt arg=-popt arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_3opt callback=http://ekoifman.local:52739/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:52739/templeton/\$jobId" With result callback ->"http://ekoifman.local:52739/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected arg ->[ "-check", "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_3", ] With result arg ->[ "-check", "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_3", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected file ->"/user/ekoifman/webhcate2e/loadstore.pig" With result file ->"/user/ekoifman/webhcate2e/loadstore.pig" INFO: TestDriverCurl::run() at 1368:Test TestPig_3 SUCCEEDED at 1381799114 Results so far, PASSED: 6 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestPig_4 ****************************************************** Beginning test TestPig_4 at 1381799114 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52886/templeton/$jobId , -d , user.name=ekoifman , -d , arg=-d , -d , arg=INFO , -d , execute=fs -ls /user/ekoifman/webhcate2e , -X , POST , -o , /tmp/ekoifman.1381798977/TestPig_4.res_body , -D , /tmp/ekoifman.1381798977/TestPig_4.res_header , http://localhost:50111/templeton/v1/pig result : ( "body", "{\"id\":\"job_201310141642_0158\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835114173&s=4Q8vkk0vWqyHEBny0+29LQF3mEM=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835114173&s=4Q8vkk0vWqyHEBny0+29LQF3mEM=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0158") Comparing id: job_201310141642_0158 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52951/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestPig_4_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestPig_4_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0158?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799114246,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":158,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0158\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0158/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0158\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":158,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0158\"},\"id\":\"job_201310141642_0158\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:52886/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-d\",\"INFO\"],\"enablelog\":\"false\",\"execute\":\"fs -ls /user/ekoifman/webhcate2e \",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:52886/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835131634&s=V0AAXmQ26HTrmthkXIuVcoDmQSg=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835131634&s=V0AAXmQ26HTrmthkXIuVcoDmQSg=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt arg=-dopt arg=INFOopt execute=fs -ls /user/ekoifman/webhcate2e opt callback=http://ekoifman.local:52886/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected execute ->"fs -ls /user/ekoifman/webhcate2e " With result execute ->"fs -ls /user/ekoifman/webhcate2e " ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:52886/templeton/\$jobId" With result callback ->"http://ekoifman.local:52886/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected arg ->["-d", "INFO"] With result arg ->["-d", "INFO"] INFO: TestDriverCurl::run() at 1368:Test TestPig_4 SUCCEEDED at 1381799131 Results so far, PASSED: 7 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestPig_5 ****************************************************** Beginning test TestPig_5 at 1381799131 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:52959/templeton/$jobId , -d , user.name=ekoifman , -d , arg=-p , -d , arg=INPDIR=/user/ekoifman/webhcate2e , -d , arg=-p , -d , arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_5 , -d , file=/user/ekoifman/webhcate2e/loadstore.pig , -X , POST , -o , /tmp/ekoifman.1381798977/TestPig_5.res_body , -D , /tmp/ekoifman.1381798977/TestPig_5.res_header , http://localhost:50111/templeton/v1/pig result : ( "body", "{\"id\":\"job_201310141642_0159\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835131672&s=S0hEHTRXziuT/HAnel833PTbN0Q=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835131672&s=S0hEHTRXziuT/HAnel833PTbN0Q=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0159") Comparing id: job_201310141642_0159 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53116/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestPig_5_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestPig_5_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0159?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799131751,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":159,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0159\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0159/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0159\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":159,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0159\"},\"id\":\"job_201310141642_0159\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:52959/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_5\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:52959/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835162203&s=W4AG/qsaApLszk1wbQ62Ob5l5zE=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835162203&s=W4AG/qsaApLszk1wbQ62Ob5l5zE=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt arg=-popt arg=INPDIR=/user/ekoifman/webhcate2eopt arg=-popt arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_5opt file=/user/ekoifman/webhcate2e/loadstore.pigopt callback=http://ekoifman.local:52959/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:52959/templeton/\$jobId" With result callback ->"http://ekoifman.local:52959/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected arg ->[ "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_5", ] With result arg ->[ "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_5", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected file ->"/user/ekoifman/webhcate2e/loadstore.pig" With result file ->"/user/ekoifman/webhcate2e/loadstore.pig" INFO: TestDriverCurl::run() at 1368:Test TestPig_5 SUCCEEDED at 1381799162 Results so far, PASSED: 8 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestPig_6 ****************************************************** Beginning test TestPig_6 at 1381799162 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53125/templeton/$jobId , -d , user.name=ekoifman , -d , arg=-p , -d , arg=INPDIR=/user/ekoifman/webhcate2e , -d , arg=-p , -d , arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_6 , -d , file=/user/ekoifman/webhcate2e/jarregistered.pig , -d , files=/user/ekoifman/webhcate2e/piggybank.jar , -X , POST , -o , /tmp/ekoifman.1381798977/TestPig_6.res_body , -D , /tmp/ekoifman.1381798977/TestPig_6.res_header , http://localhost:50111/templeton/v1/pig result : ( "body", "{\"id\":\"job_201310141642_0161\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835162244&s=+nMfa0iY3pTQG/iPSwQop32AZ/Q=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835162244&s=+nMfa0iY3pTQG/iPSwQop32AZ/Q=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0161") Comparing id: job_201310141642_0161 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53203/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestPig_6_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestPig_6_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0161?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799162320,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":161,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0161\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0161/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0161\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":161,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0161\"},\"id\":\"job_201310141642_0161\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:53125/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":\"/user/ekoifman/webhcate2e/piggybank.jar\",\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_6\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/jarregistered.pig\",\"callback\":\"http://ekoifman.local:53125/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835193315&s=2lp/Nso6TFDk0QN89KFXzkaYECs=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835193315&s=2lp/Nso6TFDk0QN89KFXzkaYECs=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt arg=-popt arg=INPDIR=/user/ekoifman/webhcate2eopt arg=-popt arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_6opt file=/user/ekoifman/webhcate2e/jarregistered.pigopt files=/user/ekoifman/webhcate2e/piggybank.jaropt callback=http://ekoifman.local:53125/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:53125/templeton/\$jobId" With result callback ->"http://ekoifman.local:53125/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected files ->"/user/ekoifman/webhcate2e/piggybank.jar" With result files ->"/user/ekoifman/webhcate2e/piggybank.jar" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected arg ->[ "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_6", ] With result arg ->[ "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_6", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected file ->"/user/ekoifman/webhcate2e/jarregistered.pig" With result file ->"/user/ekoifman/webhcate2e/jarregistered.pig" INFO: TestDriverCurl::run() at 1368:Test TestPig_6 SUCCEEDED at 1381799193 Results so far, PASSED: 9 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestPig_7 ****************************************************** Beginning test TestPig_7 at 1381799193 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53212/templeton/$jobId , -d , user.name=ekoifman , -d , arg=-p , -d , arg=INPDIR=/user/ekoifman/webhcate2e , -d , arg=-p , -d , arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_7 , -d , file=/user/ekoifman/webhcate2e/rowcount_withmacro.pig , -d , files=/user/ekoifman/webhcate2e/rowcountmacro.pig , -X , POST , -o , /tmp/ekoifman.1381798977/TestPig_7.res_body , -D , /tmp/ekoifman.1381798977/TestPig_7.res_header , http://localhost:50111/templeton/v1/pig result : ( "body", "{\"id\":\"job_201310141642_0163\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835193354&s=QpfWxcqLAnXy3gvG0Ut9S61/zxI=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835193354&s=QpfWxcqLAnXy3gvG0Ut9S61/zxI=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0163") Comparing id: job_201310141642_0163 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53293/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestPig_7_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestPig_7_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0163?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799193430,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":163,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0163\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0163/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0163\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":163,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0163\"},\"id\":\"job_201310141642_0163\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:53212/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":\"/user/ekoifman/webhcate2e/rowcountmacro.pig\",\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_7\"],\"enablelog\":\"false\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/rowcount_withmacro.pig\",\"callback\":\"http://ekoifman.local:53212/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835229259&s=MIZn8gkEz1k0oG4FMhddvg7hg+I=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835229259&s=MIZn8gkEz1k0oG4FMhddvg7hg+I=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt arg=-popt arg=INPDIR=/user/ekoifman/webhcate2eopt arg=-popt arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_7opt file=/user/ekoifman/webhcate2e/rowcount_withmacro.pigopt files=/user/ekoifman/webhcate2e/rowcountmacro.pigopt callback=http://ekoifman.local:53212/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:53212/templeton/\$jobId" With result callback ->"http://ekoifman.local:53212/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected files ->"/user/ekoifman/webhcate2e/rowcountmacro.pig" With result files ->"/user/ekoifman/webhcate2e/rowcountmacro.pig" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected arg ->[ "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_7", ] With result arg ->[ "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_7", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected file ->"/user/ekoifman/webhcate2e/rowcount_withmacro.pig" With result file ->"/user/ekoifman/webhcate2e/rowcount_withmacro.pig" INFO: TestDriverCurl::run() at 1368:Test TestPig_7 SUCCEEDED at 1381799229 Results so far, PASSED: 10 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestPig_8 ****************************************************** Beginning test TestPig_8 at 1381799229 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , user.name=ekoifman , -d , arg=-p , -d , arg=INPDIR=/user/ekoifman/webhcate2e , -d , arg=-p , -d , arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_8 , -d , file=/user/ekoifman/webhcate2e/no_such_file.pig , -d , files=/user/ekoifman/webhcate2e/rowcountmacro.pig , -X , POST , -o , /tmp/ekoifman.1381798977/TestPig_8.res_body , -D , /tmp/ekoifman.1381798977/TestPig_8.res_header , http://localhost:50111/templeton/v1/pig result : ( "body", "{\"error\":\"File /user/ekoifman/webhcate2e/no_such_file.pig does not exist.\"}", "rc", 0, "status_code", 400, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835229336&s=7wP+jap3D+HatMEotfebYzk+ZeE=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 400 Bad Request\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835229336&s=7wP+jap3D+HatMEotfebYzk+ZeE=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info( "error", "File /user/ekoifman/webhcate2e/no_such_file.pig does not exist.", ) Comparing error: File /user/ekoifman/webhcate2e/no_such_file.pig does not exist. with regex /does not exist/ INFO: TestDriverCurl::run() at 1368:Test TestPig_8 SUCCEEDED at 1381799229 Results so far, PASSED: 11 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 Ignoring test TestPig_9, ignore message: MS9 feature, will reenable later ****************************************************** TEST: TestPig_9 ****************************************************** Beginning test TestPig_9 at 1381799229 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53304/templeton/$jobId , -d , user.name=ekoifman , -d , arg=-p , -d , arg=INPDIR=/user/ekoifman/webhcate2e , -d , arg=-p , -d , arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9 , -d , file=/user/ekoifman/webhcate2e/loadstore.pig , -d , statusdir=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9/status , -d , enablelog=true , -X , POST , -o , /tmp/ekoifman.1381798977/TestPig_9.res_body , -D , /tmp/ekoifman.1381798977/TestPig_9.res_header , http://localhost:50111/templeton/v1/pig result : ( "body", "{\"id\":\"job_201310141642_0165\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835229369&s=DC6vg7GlUzc6WaQFHGCG0rtnUdo=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835229369&s=DC6vg7GlUzc6WaQFHGCG0rtnUdo=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0165") Comparing id: job_201310141642_0165 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53391/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestPig_9_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestPig_9_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0165?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799229430,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":165,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0165\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0165/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0165\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":165,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0165\"},\"id\":\"job_201310141642_0165\",\"parentId\":null,\"percentComplete\":\"100% complete\",\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:53304/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":\"/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9/status\",\"files\":null,\"arg\":[\"-p\",\"INPDIR=/user/ekoifman/webhcate2e\",\"-p\",\"OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9\"],\"enablelog\":\"true\",\"execute\":null,\"user.name\":\"ekoifman\",\"file\":\"/user/ekoifman/webhcate2e/loadstore.pig\",\"callback\":\"http://ekoifman.local:53304/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835260400&s=jq2gE7pdx4C49UxGYgEbcCnBimk=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835260400&s=jq2gE7pdx4C49UxGYgEbcCnBimk=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt arg=-popt arg=INPDIR=/user/ekoifman/webhcate2eopt arg=-popt arg=OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9opt file=/user/ekoifman/webhcate2e/loadstore.pigopt statusdir=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9/statusopt enablelog=trueopt callback=http://ekoifman.local:53304/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected statusdir ->"/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9/status" With result statusdir ->"/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9/status" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:53304/templeton/\$jobId" With result callback ->"http://ekoifman.local:53304/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected enablelog ->"true" With result enablelog ->"true" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected arg ->[ "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9", ] With result arg ->[ "-p", "INPDIR=/user/ekoifman/webhcate2e", "-p", "OUTDIR=/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9", ] ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected file ->"/user/ekoifman/webhcate2e/loadstore.pig" With result file ->"/user/ekoifman/webhcate2e/loadstore.pig" ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53400/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestPig_9.res_body , -D , /tmp/ekoifman.1381798977/TestPig_9.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9/status/logs?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799258878,\"owner\":\"ekoifman\",\"pathSuffix\":\"job_201310141642_0166\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":1381799258279,\"blockSize\":67108864,\"group\":\"staff\",\"length\":482,\"modificationTime\":1381799258279,\"owner\":\"ekoifman\",\"pathSuffix\":\"list.txt\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "442\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 442\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53403/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestPig_9.res_body , -D , /tmp/ekoifman.1381798977/TestPig_9.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9/status/logs/job_201310141642_0166?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799258618,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0166_m_000000_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799259123,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0166_m_000001_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":0,\"blockSize\":0,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799258874,\"owner\":\"ekoifman\",\"pathSuffix\":\"attempt_201310141642_0166_m_000002_0\",\"permission\":\"755\",\"replication\":0,\"type\":\"DIRECTORY\"},\n{\"accessTime\":1381799258329,\"blockSize\":67108864,\"group\":\"staff\",\"length\":66948,\"modificationTime\":1381799258329,\"owner\":\"ekoifman\",\"pathSuffix\":\"job.xml.html\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "897\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 897\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53406/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestPig_9.res_body , -D , /tmp/ekoifman.1381798977/TestPig_9.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9/status/logs/job_201310141642_0166/attempt_201310141642_0166_m_000000_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799258450,\"blockSize\":67108864,\"group\":\"staff\",\"length\":87,\"modificationTime\":1381799258450,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799258535,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799258535,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799258618,\"blockSize\":67108864,\"group\":\"staff\",\"length\":1761,\"modificationTime\":1381799258618,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "642\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 642\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53409/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestPig_9.res_body , -D , /tmp/ekoifman.1381798977/TestPig_9.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9/status/logs/job_201310141642_0166/attempt_201310141642_0166_m_000001_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799258956,\"blockSize\":67108864,\"group\":\"staff\",\"length\":87,\"modificationTime\":1381799258956,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799259040,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799259040,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799259123,\"blockSize\":67108864,\"group\":\"staff\",\"length\":938,\"modificationTime\":1381799259123,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "641\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 641\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53412/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestPig_9.res_body , -D , /tmp/ekoifman.1381798977/TestPig_9.res_header , http://localhost:8085/webhdfs/v1/tmp/templeton_test_out/ekoifman.1381798977/TestPig_9/status/logs/job_201310141642_0166/attempt_201310141642_0166_m_000002_0?op=LISTSTATUS result : ( "body", "{\"FileStatuses\":{\"FileStatus\":[\n{\"accessTime\":1381799258706,\"blockSize\":67108864,\"group\":\"staff\",\"length\":87,\"modificationTime\":1381799258706,\"owner\":\"ekoifman\",\"pathSuffix\":\"stderr\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799258789,\"blockSize\":67108864,\"group\":\"staff\",\"length\":0,\"modificationTime\":1381799258789,\"owner\":\"ekoifman\",\"pathSuffix\":\"stdout\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"},\n{\"accessTime\":1381799258874,\"blockSize\":67108864,\"group\":\"staff\",\"length\":787,\"modificationTime\":1381799258874,\"owner\":\"ekoifman\",\"pathSuffix\":\"syslog\",\"permission\":\"644\",\"replication\":1,\"type\":\"FILE\"}\n]}}\n", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Length" => "641\r", "Content-Type" => "application/json\r", "Server" => "Jetty(6.1.26)\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nContent-Type: application/json\r\n\\nContent-Length: 641\r\n\\nServer: Jetty(6.1.26)\r\n\\n\r\n", "stdout", undef, )INFO: TestDriverCurl::run() at 1368:Test TestPig_9 SUCCEEDED at 1381799260 Results so far, PASSED: 12 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 INFO TestDriverCurl::run at 1235: Running TEST GROUP(TestHive) ****************************************************** TEST: TestHive_1 ****************************************************** Beginning test TestHive_1 at 1381799260 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , user.name=ekoifman , -d , execute=asdf , -X , POST , -o , /tmp/ekoifman.1381798977/TestHive_1.res_body , -D , /tmp/ekoifman.1381798977/TestHive_1.res_header , http://localhost:50111/templeton/v1/hive result : ( "body", "{\"id\":\"job_201310141642_0167\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835260611&s=47rK91Zjqw0aqxVo1gxAaVDSqnA=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835260611&s=47rK91Zjqw0aqxVo1gxAaVDSqnA=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0167") Comparing id: job_201310141642_0167 with regex /\d+/ ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_1_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_1_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0167?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":4,\"startTime\":1381799260674,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":167,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0167\",\"jobComplete\":false},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0167/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0167\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":167,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0167\"},\"id\":\"job_201310141642_0167\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"asdf\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835260765&s=pYwSN1KAJ3a6ANLckJI9587+yv8=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835260765&s=pYwSN1KAJ3a6ANLckJI9587+yv8=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_1_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_1_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0167?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":1,\"startTime\":1381799260674,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":167,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0167\",\"jobComplete\":false},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0167/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0167\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":167,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0167\"},\"id\":\"job_201310141642_0167\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"asdf\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835265800&s=shmN8C+o/J16idIhLBz7dJTllxQ=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835265800&s=shmN8C+o/J16idIhLBz7dJTllxQ=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_1_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_1_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0167?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":1,\"startTime\":1381799260674,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":167,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0167\",\"jobComplete\":false},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0167/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0167\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":167,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0167\"},\"id\":\"job_201310141642_0167\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"asdf\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835270837&s=NiBr36avANxR2h77Rnrm1Iy3BY4=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835270837&s=NiBr36avANxR2h77Rnrm1Iy3BY4=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_1_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_1_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0167?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":1,\"startTime\":1381799260674,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":167,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0167\",\"jobComplete\":false},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0167/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0167\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":167,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0167\"},\"id\":\"job_201310141642_0167\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"asdf\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835275869&s=qbm8qkvFcPIe+N/k1nQucJKy7Ok=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835275869&s=qbm8qkvFcPIe+N/k1nQucJKy7Ok=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_1_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_1_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0167?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799260674,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":167,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0167\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0167/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0167\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":167,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0167\"},\"id\":\"job_201310141642_0167\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":64,\"user\":\"ekoifman\",\"callback\":null,\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"asdf\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835280904&s=HVYhDwrMUq+0zmcs4SmEDOK1pP4=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835280904&s=HVYhDwrMUq+0zmcs4SmEDOK1pP4=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt execute=asdf./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected execute ->"asdf" With result execute ->"asdf" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" INFO: TestDriverCurl::run() at 1368:Test TestHive_1 SUCCEEDED at 1381799280 Results so far, PASSED: 13 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestHive_2 ****************************************************** Beginning test TestHive_2 at 1381799280 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53463/templeton/$jobId , -d , user.name=ekoifman , -d , execute=show tables , -X , POST , -o , /tmp/ekoifman.1381798977/TestHive_2.res_body , -D , /tmp/ekoifman.1381798977/TestHive_2.res_header , http://localhost:50111/templeton/v1/hive result : ( "body", "{\"id\":\"job_201310141642_0168\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835280939&s=G/sA5c2r4pYpzBA+4PjuHzgc/c0=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835280939&s=G/sA5c2r4pYpzBA+4PjuHzgc/c0=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0168") Comparing id: job_201310141642_0168 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53506/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_2_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_2_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0168?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799281000,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":168,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0168\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0168/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0168\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":168,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0168\"},\"id\":\"job_201310141642_0168\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:53463/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"show tables\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:53463/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835299065&s=WoF2A0sWDASzLdENbtCSfBusEJQ=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835299065&s=WoF2A0sWDASzLdENbtCSfBusEJQ=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt execute=show tablesopt callback=http://ekoifman.local:53463/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected execute ->"show tables" With result execute ->"show tables" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:53463/templeton/\$jobId" With result callback ->"http://ekoifman.local:53463/templeton/\$jobId" INFO: TestDriverCurl::run() at 1368:Test TestHive_2 SUCCEEDED at 1381799299 Results so far, PASSED: 14 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestHive_3 ****************************************************** Beginning test TestHive_3 at 1381799299 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53514/templeton/$jobId , -d , user.name=ekoifman , -d , execute=drop table if exists mynums; , -X , POST , -o , /tmp/ekoifman.1381798977/TestHive_3.res_body , -D , /tmp/ekoifman.1381798977/TestHive_3.res_header , http://localhost:50111/templeton/v1/hive result : ( "body", "{\"id\":\"job_201310141642_0169\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835299136&s=MF3vaYNtNRnA4+X7GHrGN1hzCw8=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835299136&s=MF3vaYNtNRnA4+X7GHrGN1hzCw8=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0169") Comparing id: job_201310141642_0169 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53555/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_3_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_3_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0169?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799299206,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":169,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0169\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0169/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0169\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":169,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0169\"},\"id\":\"job_201310141642_0169\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:53514/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"drop table if exists mynums;\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:53514/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835317170&s=1D5Swv5SaRVJ/61rqE5wGHU/58A=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835317170&s=1D5Swv5SaRVJ/61rqE5wGHU/58A=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt execute=drop table if exists mynums;opt callback=http://ekoifman.local:53514/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected execute ->"drop table if exists mynums;" With result execute ->"drop table if exists mynums;" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:53514/templeton/\$jobId" With result callback ->"http://ekoifman.local:53514/templeton/\$jobId" INFO: TestDriverCurl::run() at 1368:Test TestHive_3 SUCCEEDED at 1381799317 Results so far, PASSED: 15 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestHive_4 ****************************************************** Beginning test TestHive_4 at 1381799317 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53563/templeton/$jobId , -d , user.name=ekoifman , -d , execute=create external table mynums(a int, b int) location '/user/ekoifman/webhcate2e/numstable/'; , -X , POST , -o , /tmp/ekoifman.1381798977/TestHive_4.res_body , -D , /tmp/ekoifman.1381798977/TestHive_4.res_header , http://localhost:50111/templeton/v1/hive result : ( "body", "{\"id\":\"job_201310141642_0170\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835317247&s=xo/dAZyNCAOjj/oeTw7sc78/eHA=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835317247&s=xo/dAZyNCAOjj/oeTw7sc78/eHA=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0170") Comparing id: job_201310141642_0170 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53605/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_4_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_4_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0170?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799317313,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":170,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0170\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0170/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0170\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":170,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0170\"},\"id\":\"job_201310141642_0170\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:53563/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"create external table mynums(a int, b int) location '/user/ekoifman/webhcate2e/numstable/';\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:53563/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835334984&s=snUVOm6FnXnWefNicTgkgcIy9jA=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835334984&s=snUVOm6FnXnWefNicTgkgcIy9jA=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt execute=create external table mynums(a int, b int) location '/user/ekoifman/webhcate2e/numstable/';opt callback=http://ekoifman.local:53563/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected execute ->"create external table mynums(a int, b int) location '/user/ekoifman/webhcate2e/numstable/';" With result execute ->"create external table mynums(a int, b int) location '/user/ekoifman/webhcate2e/numstable/';" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:53563/templeton/\$jobId" With result callback ->"http://ekoifman.local:53563/templeton/\$jobId" INFO: TestDriverCurl::run() at 1368:Test TestHive_4 SUCCEEDED at 1381799335 Results so far, PASSED: 16 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestHive_5 ****************************************************** Beginning test TestHive_5 at 1381799335 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53613/templeton/$jobId , -d , user.name=ekoifman , -d , execute=describe formatted mynums , -X , POST , -o , /tmp/ekoifman.1381798977/TestHive_5.res_body , -D , /tmp/ekoifman.1381798977/TestHive_5.res_header , http://localhost:50111/templeton/v1/hive result : ( "body", "{\"id\":\"job_201310141642_0171\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835335026&s=2wiTP9JxNVvnrq3BSzqiNfjDYFc=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835335026&s=2wiTP9JxNVvnrq3BSzqiNfjDYFc=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0171") Comparing id: job_201310141642_0171 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53656/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_5_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_5_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0171?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799335100,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":171,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0171\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0171/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0171\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":171,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0171\"},\"id\":\"job_201310141642_0171\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:53613/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"describe formatted mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:53613/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835353108&s=+X5JyoYSuWQIfTj+sCP0chOszl0=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835353108&s=+X5JyoYSuWQIfTj+sCP0chOszl0=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt execute=describe formatted mynumsopt callback=http://ekoifman.local:53613/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected execute ->"describe formatted mynums" With result execute ->"describe formatted mynums" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:53613/templeton/\$jobId" With result callback ->"http://ekoifman.local:53613/templeton/\$jobId" INFO: TestDriverCurl::run() at 1368:Test TestHive_5 SUCCEEDED at 1381799353 Results so far, PASSED: 17 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestHive_6 ****************************************************** Beginning test TestHive_6 at 1381799353 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53664/templeton/$jobId , -d , user.name=ekoifman , -d , execute=select * from mynums , -X , POST , -o , /tmp/ekoifman.1381798977/TestHive_6.res_body , -D , /tmp/ekoifman.1381798977/TestHive_6.res_header , http://localhost:50111/templeton/v1/hive result : ( "body", "{\"id\":\"job_201310141642_0172\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835353145&s=oUtEJBqXQsK98/TDVZSDU4btrUw=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835353145&s=oUtEJBqXQsK98/TDVZSDU4btrUw=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0172") Comparing id: job_201310141642_0172 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53706/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_6_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_6_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0172?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799353218,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":172,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0172\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0172/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0172\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":172,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0172\"},\"id\":\"job_201310141642_0172\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:53664/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select * from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:53664/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835371533&s=f16Kvuf5RZ3tFb6w+e75RnTl8Mg=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835371533&s=f16Kvuf5RZ3tFb6w+e75RnTl8Mg=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt execute=select * from mynumsopt callback=http://ekoifman.local:53664/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected execute ->"select * from mynums" With result execute ->"select * from mynums" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:53664/templeton/\$jobId" With result callback ->"http://ekoifman.local:53664/templeton/\$jobId" INFO: TestDriverCurl::run() at 1368:Test TestHive_6 SUCCEEDED at 1381799371 Results so far, PASSED: 18 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestHive_7 ****************************************************** Beginning test TestHive_7 at 1381799371 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53714/templeton/$jobId , -d , user.name=ekoifman , -d , execute=select a,b from mynums , -X , POST , -o , /tmp/ekoifman.1381798977/TestHive_7.res_body , -D , /tmp/ekoifman.1381798977/TestHive_7.res_header , http://localhost:50111/templeton/v1/hive result : ( "body", "{\"id\":\"job_201310141642_0173\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835371567&s=8ibU6s/sMOgcwZcBUatH+LdxGr0=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835371567&s=8ibU6s/sMOgcwZcBUatH+LdxGr0=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0173") Comparing id: job_201310141642_0173 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53776/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_7_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_7_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0173?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799371635,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":173,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0173\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0173/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0173\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":173,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0173\"},\"id\":\"job_201310141642_0173\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:53714/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select a,b from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:53714/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835395397&s=ZhiLDMEbgtvYu6dHIEGdFsQr0Yc=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835395397&s=ZhiLDMEbgtvYu6dHIEGdFsQr0Yc=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt execute=select a,b from mynumsopt callback=http://ekoifman.local:53714/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected execute ->"select a,b from mynums" With result execute ->"select a,b from mynums" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:53714/templeton/\$jobId" With result callback ->"http://ekoifman.local:53714/templeton/\$jobId" INFO: TestDriverCurl::run() at 1368:Test TestHive_7 SUCCEEDED at 1381799395 Results so far, PASSED: 19 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestHive_8 ****************************************************** Beginning test TestHive_8 at 1381799395 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , user.name=ekoifman , -d , execute=select a,rand(b) from mynums , -X , POST , -o , /tmp/ekoifman.1381798977/TestHive_8.res_body , -D , /tmp/ekoifman.1381798977/TestHive_8.res_header , http://localhost:50111/templeton/v1/hive result : ( "body", "{\"id\":\"job_201310141642_0175\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835395436&s=jP4zE4RYPKtfQ+NI6utCAhOjBPE=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835395436&s=jP4zE4RYPKtfQ+NI6utCAhOjBPE=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0175") Comparing id: job_201310141642_0175 with regex /\d+/ ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_8_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_8_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0175?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":4,\"startTime\":1381799395501,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":175,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0175\",\"jobComplete\":false},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0175/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0175\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":175,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0175\"},\"id\":\"job_201310141642_0175\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select a,rand(b) from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835395751&s=emv+TE+glKSt+mjvluNNLwtJFC8=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835395751&s=emv+TE+glKSt+mjvluNNLwtJFC8=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_8_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_8_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0175?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":1,\"startTime\":1381799395501,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":175,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0175\",\"jobComplete\":false},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0175/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0175\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":175,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0175\"},\"id\":\"job_201310141642_0175\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select a,rand(b) from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835400785&s=2My7KGvkPBsyQFzboMY3bJgwdfE=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835400785&s=2My7KGvkPBsyQFzboMY3bJgwdfE=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_8_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_8_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0175?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":1,\"startTime\":1381799395501,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":175,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0175\",\"jobComplete\":false},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0175/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0175\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":175,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0175\"},\"id\":\"job_201310141642_0175\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select a,rand(b) from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835405820&s=zJwdsa2DpSxZbwHsoEMRzzGHOkA=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835405820&s=zJwdsa2DpSxZbwHsoEMRzzGHOkA=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_8_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_8_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0175?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":1,\"startTime\":1381799395501,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":175,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0175\",\"jobComplete\":false},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0175/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0175\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":175,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0175\"},\"id\":\"job_201310141642_0175\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select a,rand(b) from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835410856&s=434NX5tdeC9O3v5qF2sPg68/b7A=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835410856&s=434NX5tdeC9O3v5qF2sPg68/b7A=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_8_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_8_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0175?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":1,\"startTime\":1381799395501,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":175,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0175\",\"jobComplete\":false},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0175/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0175\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":175,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0175\"},\"id\":\"job_201310141642_0175\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":null,\"user\":\"ekoifman\",\"callback\":null,\"completed\":null,\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select a,rand(b) from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835415889&s=HLuuI9+Clve8++mBGnIi88/o5Xw=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835415889&s=HLuuI9+Clve8++mBGnIi88/o5Xw=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_8_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_8_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0175?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799395501,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":175,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0175\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0175/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0175\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":175,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0175\"},\"id\":\"job_201310141642_0175\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":null,\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"select a,rand(b) from mynums\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":null}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835420923&s=nF8IvhTmK72UjrX2dmliu9efouI=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835420923&s=nF8IvhTmK72UjrX2dmliu9efouI=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt execute=select a,rand(b) from mynums./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected execute ->"select a,rand(b) from mynums" With result execute ->"select a,rand(b) from mynums" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" INFO: TestDriverCurl::run() at 1368:Test TestHive_8 SUCCEEDED at 1381799420 Results so far, PASSED: 20 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestHive_9 ****************************************************** Beginning test TestHive_9 at 1381799420 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53858/templeton/$jobId , -d , user.name=ekoifman , -d , execute=add jar piggybank.jar , -d , files=/user/ekoifman/webhcate2e/piggybank.jar , -X , POST , -o , /tmp/ekoifman.1381798977/TestHive_9.res_body , -D , /tmp/ekoifman.1381798977/TestHive_9.res_header , http://localhost:50111/templeton/v1/hive result : ( "body", "{\"id\":\"job_201310141642_0177\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835420958&s=noltk0BmWyiafOy/NDDl4Da5h5g=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835420958&s=noltk0BmWyiafOy/NDDl4Da5h5g=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0177") Comparing id: job_201310141642_0177 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53897/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_9_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_9_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0177?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799421022,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":177,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0177\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0177/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0177\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":177,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0177\"},\"id\":\"job_201310141642_0177\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":0,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:53858/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":\"/user/ekoifman/webhcate2e/piggybank.jar\",\"define\":[],\"enablelog\":\"false\",\"execute\":\"add jar piggybank.jar\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:53858/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835437705&s=2qdudmzWrCu/RiQZ0QDz7Zx7epE=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835437705&s=2qdudmzWrCu/RiQZ0QDz7Zx7epE=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt execute=add jar piggybank.jaropt files=/user/ekoifman/webhcate2e/piggybank.jaropt callback=http://ekoifman.local:53858/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected execute ->"add jar piggybank.jar" With result execute ->"add jar piggybank.jar" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:53858/templeton/\$jobId" With result callback ->"http://ekoifman.local:53858/templeton/\$jobId" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected files ->"/user/ekoifman/webhcate2e/piggybank.jar" With result files ->"/user/ekoifman/webhcate2e/piggybank.jar" INFO: TestDriverCurl::run() at 1368:Test TestHive_9 SUCCEEDED at 1381799437 Results so far, PASSED: 21 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 ****************************************************** TEST: TestHive_10 ****************************************************** Beginning test TestHive_10 at 1381799437 ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53905/templeton/$jobId , -d , user.name=ekoifman , -d , execute=add jar piggybank.jar , -X , POST , -o , /tmp/ekoifman.1381798977/TestHive_10.res_body , -D , /tmp/ekoifman.1381798977/TestHive_10.res_header , http://localhost:50111/templeton/v1/hive result : ( "body", "{\"id\":\"job_201310141642_0178\"}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835437748&s=BEaKjOcrZIls6KxKKU7+QbnzSRg=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835437748&s=BEaKjOcrZIls6KxKKU7+QbnzSRg=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, ) json_info("id", "job_201310141642_0178") Comparing id: job_201310141642_0178 with regex /\d+/ Expanded callback url : Waiting for call back url request Got request at url ./test_harness.pl:TestDriverCurl::execCurlCmd Going to run command : curl , --silent , --show-error , -H , Expect: , -d , callback=http://ekoifman.local:53943/templeton/$jobId , -X , GET , -o , /tmp/ekoifman.1381798977/TestHive_10_jobStatusCheck.res_body , -D , /tmp/ekoifman.1381798977/TestHive_10_jobStatusCheck.res_header , http://localhost:50111/templeton/v1/queue/job_201310141642_0178?user.name=ekoifman result : ( "body", "{\"status\":{\"jobACLs\":{},\"runState\":2,\"startTime\":1381799437835,\"schedulingInfo\":\"NA\",\"failureInfo\":\"NA\",\"jobPriority\":\"NORMAL\",\"username\":\"ekoifman\",\"jobID\":{\"id\":178,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0178\",\"jobComplete\":true},\"profile\":{\"user\":\"ekoifman\",\"jobFile\":\"hdfs://localhost:9000/tmp/hadoop-ekoifman/mapred/staging/ekoifman/.staging/job_201310141642_0178/job.xml\",\"url\":\"http://localhost:50030/jobdetails.jsp?jobid=job_201310141642_0178\",\"queueName\":\"default\",\"jobName\":\"TempletonControllerJob\",\"jobID\":{\"id\":178,\"jtIdentifier\":\"201310141642\"},\"jobId\":\"job_201310141642_0178\"},\"id\":\"job_201310141642_0178\",\"parentId\":null,\"percentComplete\":null,\"exitValue\":1,\"user\":\"ekoifman\",\"callback\":\"http://ekoifman.local:53905/templeton/\$jobId\",\"completed\":\"done\",\"userargs\":{\"statusdir\":null,\"files\":null,\"define\":[],\"enablelog\":\"false\",\"execute\":\"add jar piggybank.jar\",\"user.name\":\"ekoifman\",\"file\":null,\"callback\":\"http://ekoifman.local:53905/templeton/\$jobId\"}}", "rc", 0, "status_code", 200, "stderr", undef, "header_fields", { "Content-Type" => "application/json\r", "Expires" => "Thu, 01 Jan 1970 00:00:00 GMT\r", "Server" => "Jetty(7.6.0.v20120127)\r", "Set-Cookie" => "hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835454355&s=/PWcUWSZ7j8Pk8YRZHjGQwQgX4k=\";Version=1;Path=/;Discard\r", "Transfer-Encoding" => "chunked\r", }, "full_header", "HTTP/1.1 200 OK\r\n\\nSet-Cookie: hadoop.auth=\"u=ekoifman&p=ekoifman&t=simple&e=1381835454355&s=/PWcUWSZ7j8Pk8YRZHjGQwQgX4k=\";Version=1;Path=/;Discard\r\n\\nExpires: Thu, 01 Jan 1970 00:00:00 GMT\r\n\\nContent-Type: application/json\r\n\\nTransfer-Encoding: chunked\r\n\\nServer: Jetty(7.6.0.v20120127)\r\n\\n\r\n", "stdout", undef, )./test_harness.pl::TestDriverCurl::compare INFO Checking userargsopt user.name=ekoifmanopt execute=add jar piggybank.jaropt callback=http://ekoifman.local:53905/templeton/$jobId./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected execute ->"add jar piggybank.jar" With result execute ->"add jar piggybank.jar" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected user.name ->"ekoifman" With result user.name ->"ekoifman" ./test_harness.pl::TestDriverCurl::compare DEBUG comparing expected callback ->"http://ekoifman.local:53905/templeton/\$jobId" With result callback ->"http://ekoifman.local:53905/templeton/\$jobId" INFO: TestDriverCurl::run() at 1368:Test TestHive_10 SUCCEEDED at 1381799454 Results so far, PASSED: 22 FAILED: 0 SKIPPED: 0 ABORTED: 0 FAILED DEPENDENCY: 0 INFO TestDriverCurl::run at 1235: Running TEST GROUP() INFO TestDriverCurl::run at 1235: Running TEST GROUP() INFO TestDriverCurl::run at 1235: Running TEST GROUP() Final results , PASSED: 35 FAILED: 1 SKIPPED: 0 ABORTED: 1 FAILED DEPENDENCY: 0 [-] Finished test run at 1381799454