[PIG-4487] Pig on Tez gives wrong success message on failure in case of multiple outputs

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.15.0
• Assignee: Rohini Palaniswamy
• Reporter: Rohini Palaniswamy
• Created: 30/Mar/15 22:53
• Updated: 24/May/16 22:29
• Resolved: 01/Apr/15 23:26

Description

If there are multiple output vertices, even though commit is it at DAG level and no records are stored till the whole DAG is successful, pig stats says successfully stored records for successful vertices. It should say that only if vertex level commit is set to true.

For eg:
Input(s):
Successfully read 301 records (7930 bytes) from: "aaa"
Successfully read 301 records (7136 bytes) from: "bbb"

Output(s):
Failed to produce result in "xxx"
Successfully stored 10 records (738 bytes) in: "yyy"

Issue Links

• incorporates: PIG-4446 Support for vertex level commit for parallel outputs in Tez
• is part of: PIG-4483 Pig on Tez output statistics shows storing to same directory twice for union