ABSTRACT SYNTAX TREE: TOK_QUERY TOK_FROM TOK_TABREF TOK_TABNAME portrait rec_feature_feedback a TOK_INSERT TOK_DESTINATION TOK_TAB TOK_TABNAME portrait test1 TOK_SELECT TOK_SELEXPR TOK_TABLE_OR_COL iid TOK_SELEXPR TOK_TABLE_OR_COL feedback_15day TOK_SELEXPR TOK_TABLE_OR_COL feedback_7day TOK_SELEXPR TOK_TABLE_OR_COL feedback_5day TOK_SELEXPR TOK_TABLE_OR_COL feedback_3day TOK_SELEXPR TOK_TABLE_OR_COL feedback_1day TOK_WHERE and = TOK_TABLE_OR_COL l_date '2015-09-09' TOK_FUNCTION in TOK_TABLE_OR_COL bid '949722CF_12F7_523A_EE21_E3D591B7E755' STAGE DEPENDENCIES: Stage-1 is a root stage Stage-7 depends on stages: Stage-1 , consists of Stage-4, Stage-3, Stage-5 Stage-4 Stage-0 depends on stages: Stage-4, Stage-3, Stage-6 Stage-2 depends on stages: Stage-0 Stage-3 Stage-5 Stage-6 depends on stages: Stage-5 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: a Statistics: Num rows: 209 Data size: 25098 Basic stats: COMPLETE Column stats: NONE GatherStats: false Select Operator expressions: iid (type: string), feedback_15day (type: int), feedback_7day (type: int), feedback_5day (type: int), feedback_3day (type: int), feedback_1day (type: int) outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5 Statistics: Num rows: 209 Data size: 25098 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false GlobalTableId: 1 directory: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10001 NumFilesPerFileSink: 1 Statistics: Num rows: 209 Data size: 25098 Basic stats: COMPLETE Column stats: NONE Stats Publishing Key Prefix: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10000/ table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat properties: COLUMN_STATS_ACCURATE true bucket_count -1 columns iid,feedback_15day,feedback_7day,feedback_5day,feedback_3day,feedback_1day columns.comments columns.types string:string:string:string:string:string file.inputformat org.apache.hadoop.mapred.TextInputFormat file.outputformat org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat location hdfs://bfdhadoopcool/warehouse/portrait.db/test1 name portrait.test1 numFiles 1 numRows 0 rawDataSize 0 serialization.ddl struct test1 { string iid, string feedback_15day, string feedback_7day, string feedback_5day, string feedback_3day, string feedback_1day} serialization.format 1 serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe totalSize 18 transient_lastDdlTime 1442387132 serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: portrait.test1 TotalFiles: 1 GatherStats: true MultiFileSpray: false Path -> Alias: hdfs://bfdhadoopcool/warehouse/portrait.db/rec_feature_feedback/l_date=2015-09-09/cid=Czgc_pc/bid=949722CF_12F7_523A_EE21_E3D591B7E755 [a] Path -> Partition: hdfs://bfdhadoopcool/warehouse/portrait.db/rec_feature_feedback/l_date=2015-09-09/cid=Czgc_pc/bid=949722CF_12F7_523A_EE21_E3D591B7E755 Partition base file name: bid=949722CF_12F7_523A_EE21_E3D591B7E755 input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat partition values: bid 949722CF_12F7_523A_EE21_E3D591B7E755 cid Czgc_pc l_date 2015-09-09 properties: COLUMN_STATS_ACCURATE true bucket_count -1 columns iid,feedback_15day,feedback_7day,feedback_5day,feedback_3day,feedback_1day columns.comments columns.types string:int:int:int:int:int field.delim file.inputformat org.apache.hadoop.mapred.TextInputFormat file.outputformat org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat location hdfs://bfdhadoopcool/warehouse/portrait.db/rec_feature_feedback/l_date=2015-09-09/cid=Czgc_pc/bid=949722CF_12F7_523A_EE21_E3D591B7E755 name portrait.rec_feature_feedback numFiles 27 numRows 0 partition_columns l_date/cid/bid partition_columns.types string:string:string rawDataSize 0 serialization.ddl struct rec_feature_feedback { string iid, i32 feedback_15day, i32 feedback_7day, i32 feedback_5day, i32 feedback_3day, i32 feedback_1day} serialization.format serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe totalSize 25098 transient_lastDdlTime 1442132192 serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat properties: bucket_count -1 columns iid,feedback_15day,feedback_7day,feedback_5day,feedback_3day,feedback_1day columns.comments columns.types string:int:int:int:int:int field.delim file.inputformat org.apache.hadoop.mapred.TextInputFormat file.outputformat org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat location hdfs://bfdhadoopcool/warehouse/portrait.db/rec_feature_feedback name portrait.rec_feature_feedback partition_columns l_date/cid/bid partition_columns.types string:string:string serialization.ddl struct rec_feature_feedback { string iid, i32 feedback_15day, i32 feedback_7day, i32 feedback_5day, i32 feedback_3day, i32 feedback_1day} serialization.format serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe transient_lastDdlTime 1441102832 serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: portrait.rec_feature_feedback name: portrait.rec_feature_feedback Truncated Path -> Alias: /portrait.db/rec_feature_feedback/l_date=2015-09-09/cid=Czgc_pc/bid=949722CF_12F7_523A_EE21_E3D591B7E755 [a] Stage: Stage-7 Conditional Operator Stage: Stage-4 Move Operator files: hdfs directory: true source: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10001 destination: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10000 Stage: Stage-0 Move Operator tables: replace: true source: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10000 table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat properties: COLUMN_STATS_ACCURATE true bucket_count -1 columns iid,feedback_15day,feedback_7day,feedback_5day,feedback_3day,feedback_1day columns.comments columns.types string:string:string:string:string:string file.inputformat org.apache.hadoop.mapred.TextInputFormat file.outputformat org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat location hdfs://bfdhadoopcool/warehouse/portrait.db/test1 name portrait.test1 numFiles 1 numRows 0 rawDataSize 0 serialization.ddl struct test1 { string iid, string feedback_15day, string feedback_7day, string feedback_5day, string feedback_3day, string feedback_1day} serialization.format 1 serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe totalSize 18 transient_lastDdlTime 1442387132 serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: portrait.test1 Stage: Stage-2 Stats-Aggr Operator Stats Aggregation Key Prefix: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10000/ Stage: Stage-3 Map Reduce Map Operator Tree: TableScan GatherStats: false File Output Operator compressed: false GlobalTableId: 0 directory: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10000 NumFilesPerFileSink: 1 table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat properties: COLUMN_STATS_ACCURATE true bucket_count -1 columns iid,feedback_15day,feedback_7day,feedback_5day,feedback_3day,feedback_1day columns.comments columns.types string:string:string:string:string:string file.inputformat org.apache.hadoop.mapred.TextInputFormat file.outputformat org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat location hdfs://bfdhadoopcool/warehouse/portrait.db/test1 name portrait.test1 numFiles 1 numRows 0 rawDataSize 0 serialization.ddl struct test1 { string iid, string feedback_15day, string feedback_7day, string feedback_5day, string feedback_3day, string feedback_1day} serialization.format 1 serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe totalSize 18 transient_lastDdlTime 1442387132 serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: portrait.test1 TotalFiles: 1 GatherStats: false MultiFileSpray: false Path -> Alias: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10001 [hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10001] Path -> Partition: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10001 Partition base file name: -ext-10001 input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat properties: COLUMN_STATS_ACCURATE true bucket_count -1 columns iid,feedback_15day,feedback_7day,feedback_5day,feedback_3day,feedback_1day columns.comments columns.types string:string:string:string:string:string file.inputformat org.apache.hadoop.mapred.TextInputFormat file.outputformat org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat location hdfs://bfdhadoopcool/warehouse/portrait.db/test1 name portrait.test1 numFiles 1 numRows 0 rawDataSize 0 serialization.ddl struct test1 { string iid, string feedback_15day, string feedback_7day, string feedback_5day, string feedback_3day, string feedback_1day} serialization.format 1 serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe totalSize 18 transient_lastDdlTime 1442387132 serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat properties: COLUMN_STATS_ACCURATE true bucket_count -1 columns iid,feedback_15day,feedback_7day,feedback_5day,feedback_3day,feedback_1day columns.comments columns.types string:string:string:string:string:string file.inputformat org.apache.hadoop.mapred.TextInputFormat file.outputformat org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat location hdfs://bfdhadoopcool/warehouse/portrait.db/test1 name portrait.test1 numFiles 1 numRows 0 rawDataSize 0 serialization.ddl struct test1 { string iid, string feedback_15day, string feedback_7day, string feedback_5day, string feedback_3day, string feedback_1day} serialization.format 1 serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe totalSize 18 transient_lastDdlTime 1442387132 serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: portrait.test1 name: portrait.test1 Truncated Path -> Alias: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10001 [hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10001] Stage: Stage-5 Map Reduce Map Operator Tree: TableScan GatherStats: false File Output Operator compressed: false GlobalTableId: 0 directory: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10000 NumFilesPerFileSink: 1 table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat properties: COLUMN_STATS_ACCURATE true bucket_count -1 columns iid,feedback_15day,feedback_7day,feedback_5day,feedback_3day,feedback_1day columns.comments columns.types string:string:string:string:string:string file.inputformat org.apache.hadoop.mapred.TextInputFormat file.outputformat org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat location hdfs://bfdhadoopcool/warehouse/portrait.db/test1 name portrait.test1 numFiles 1 numRows 0 rawDataSize 0 serialization.ddl struct test1 { string iid, string feedback_15day, string feedback_7day, string feedback_5day, string feedback_3day, string feedback_1day} serialization.format 1 serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe totalSize 18 transient_lastDdlTime 1442387132 serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: portrait.test1 TotalFiles: 1 GatherStats: false MultiFileSpray: false Path -> Alias: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10001 [hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10001] Path -> Partition: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10001 Partition base file name: -ext-10001 input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat properties: COLUMN_STATS_ACCURATE true bucket_count -1 columns iid,feedback_15day,feedback_7day,feedback_5day,feedback_3day,feedback_1day columns.comments columns.types string:string:string:string:string:string file.inputformat org.apache.hadoop.mapred.TextInputFormat file.outputformat org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat location hdfs://bfdhadoopcool/warehouse/portrait.db/test1 name portrait.test1 numFiles 1 numRows 0 rawDataSize 0 serialization.ddl struct test1 { string iid, string feedback_15day, string feedback_7day, string feedback_5day, string feedback_3day, string feedback_1day} serialization.format 1 serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe totalSize 18 transient_lastDdlTime 1442387132 serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat properties: COLUMN_STATS_ACCURATE true bucket_count -1 columns iid,feedback_15day,feedback_7day,feedback_5day,feedback_3day,feedback_1day columns.comments columns.types string:string:string:string:string:string file.inputformat org.apache.hadoop.mapred.TextInputFormat file.outputformat org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat location hdfs://bfdhadoopcool/warehouse/portrait.db/test1 name portrait.test1 numFiles 1 numRows 0 rawDataSize 0 serialization.ddl struct test1 { string iid, string feedback_15day, string feedback_7day, string feedback_5day, string feedback_3day, string feedback_1day} serialization.format 1 serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe totalSize 18 transient_lastDdlTime 1442387132 serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: portrait.test1 name: portrait.test1 Truncated Path -> Alias: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10001 [hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10001] Stage: Stage-6 Move Operator files: hdfs directory: true source: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10001 destination: hdfs://bfdhadoopcool/tmp/hive/hadoop/799d5a2f-cb9c-4759-be40-476626e9132b/hive_2015-09-16_15-27-57_331_2671275053153008923-1/-ext-10000