[HIVE-13871] Tez exec summary does not get the HIVE counters right

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.1.0
• Component/s: llap, Tez
• Target Version/s: 2.2.0
• Assignee: Unassigned
• Reporter: Gopal Vijayaraghavan
• Created: 27/May/16 02:01
• Updated: 27/Feb/24 22:23
• Resolved: 14/Jul/16 23:11

Description

2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) - HIVE:
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    CREATED_FILES: 1
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    DESERIALIZE_ERRORS: 0
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_1: 0
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_4: 0
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_5: 0
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_6: 0
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_7: 0
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_0: 10
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_1: 418284
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_4: 27440
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_5: 365
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_6: 101
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_7: 48000
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Reducer_2: 10
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) - Shuffle Errors:

However, the actual operator counters do indicate the total # of vectors.

2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) - TaskCounter_Map_1_INPUT_Map_4:
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    FIRST_EVENT_RECEIVED: 1
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    INPUT_RECORDS_PROCESSED: 27440

Issue Links

• is duplicated by: HIVE-14122 VectorMapOperator: Missing update to AbstractMapOperator::numRows