Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-5063

e2e IOErrors_1 on mapreduce is unstable

    XMLWordPrintableJSON

Details

    • Test
    • Status: Closed
    • Trivial
    • Resolution: Fixed
    • None
    • 0.17.0
    • None
    • None

    Description

      e2e test IOErrors_1 sometimes fail with

      2016-10-31 17:47:25,307 [main] ERROR org.apache.pig.tools.grunt.GruntParser - ERROR 2055: Received Error while processing the map plan: Error while reading from POStream and passing it to the streaming process:Output/Error thread failed with: java.io.IOException: Index: 0, Size: 0
      
      2016-10-31 17:47:25,405 [main] INFO  org.apache.pig.Main - Pig script completed in 1 minute, 4 seconds and 579 milliseconds (64579 ms)
      
      ./test_harness.pl::TestDriverPig::compareScript INFO Checking test stderr for regular expression _Error reading output from Streaming binary_
      ./test_harness.pl::TestDriverPig::compareScript INFO Check failed: regex match of _Error reading output from Streaming binary_ expected in stderr: 
      

      In PIG-4976, I added extra checking to make sure POStream fails reliably.
      I missed this e2e test failure since it sometimes succeed (with expected error message).

      Attachments

        1. pig-5063-v01.patch
          0.7 kB
          Koji Noguchi

        Activity

          People

            knoguchi Koji Noguchi
            knoguchi Koji Noguchi
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: