Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4487

Pig on Tez gives wrong success message on failure in case of multiple outputs

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.15.0
    • Component/s: None
    • Labels:
      None

      Description

      If there are multiple output vertices, even though commit is it at DAG level and no records are stored till the whole DAG is successful, pig stats says successfully stored records for successful vertices. It should say that only if vertex level commit is set to true.

      For eg:
      Input(s):
      Successfully read 301 records (7930 bytes) from: "aaa"
      Successfully read 301 records (7136 bytes) from: "bbb"

      Output(s):
      Failed to produce result in "xxx"
      Successfully stored 10 records (738 bytes) in: "yyy"

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                rohini Rohini Palaniswamy
                Reporter:
                rohini Rohini Palaniswamy
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: