Pig
  1. Pig
  2. PIG-1453

[zebra] Intermittent failure for TestOrderPreserveUnionHDFS

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.8.0
    • Component/s: impl
    • Labels:
      None
    1. PIG-1453.patch
      16 kB
      Yan Zhou
    2. PIG-1453.patch
      17 kB
      Yan Zhou

      Activity

      Transition Time In Source Status Execution Times Last Executer Last Execution Date
      Patch Available Patch Available Open Open
      5d 23h 52m 3 Yan Zhou 23/Jun/10 20:04
      Open Open Patch Available Patch Available
      1d 2h 3m 4 Yan Zhou 23/Jun/10 20:24
      Patch Available Patch Available Resolved Resolved
      30d 1h 47m 1 Yan Zhou 23/Jul/10 22:11
      Resolved Resolved Closed Closed
      147d 1h 32m 1 Olga Natkovich 17/Dec/10 22:44
      Olga Natkovich made changes -
      Status Resolved [ 5 ] Closed [ 6 ]
      Yan Zhou made changes -
      Status Patch Available [ 10002 ] Resolved [ 5 ]
      Resolution Fixed [ 1 ]
      Hide
      Yan Zhou added a comment -

      Committed to the trunk.

      Show
      Yan Zhou added a comment - Committed to the trunk.
      Hide
      Hadoop QA added a comment -

      -1 overall. Here are the results of testing the latest attachment
      http://issues.apache.org/jira/secure/attachment/12447494/PIG-1453.patch
      against trunk revision 957277.

      +1 @author. The patch does not contain any @author tags.

      +1 tests included. The patch appears to include 36 new or modified tests.

      +1 javadoc. The javadoc tool did not generate any warning messages.

      +1 javac. The applied patch does not increase the total number of javac compiler warnings.

      +1 findbugs. The patch does not introduce any new Findbugs warnings.

      +1 release audit. The applied patch does not increase the total number of release audit warnings.

      -1 core tests. The patch failed core unit tests.

      -1 contrib tests. The patch failed contrib unit tests.

      Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/348/testReport/
      Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/348/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
      Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/348/console

      This message is automatically generated.

      Show
      Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12447494/PIG-1453.patch against trunk revision 957277. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 36 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. -1 contrib tests. The patch failed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/348/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/348/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/348/console This message is automatically generated.
      Yan Zhou made changes -
      Status Open [ 1 ] Patch Available [ 10002 ]
      Yan Zhou made changes -
      Status Patch Available [ 10002 ] Open [ 1 ]
      Yan Zhou made changes -
      Status Open [ 1 ] Patch Available [ 10002 ]
      Yan Zhou made changes -
      Status Patch Available [ 10002 ] Open [ 1 ]
      Hide
      Hadoop QA added a comment -

      -1 overall. Here are the results of testing the latest attachment
      http://issues.apache.org/jira/secure/attachment/12447494/PIG-1453.patch
      against trunk revision 955763.

      +1 @author. The patch does not contain any @author tags.

      +1 tests included. The patch appears to include 36 new or modified tests.

      -1 javadoc. The javadoc tool appears to have generated 1 warning messages.

      +1 javac. The applied patch does not increase the total number of javac compiler warnings.

      +1 findbugs. The patch does not introduce any new Findbugs warnings.

      +1 release audit. The applied patch does not increase the total number of release audit warnings.

      -1 core tests. The patch failed core unit tests.

      -1 contrib tests. The patch failed contrib unit tests.

      Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/331/testReport/
      Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/331/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
      Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/331/console

      This message is automatically generated.

      Show
      Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12447494/PIG-1453.patch against trunk revision 955763. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 36 new or modified tests. -1 javadoc. The javadoc tool appears to have generated 1 warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. -1 contrib tests. The patch failed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/331/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/331/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/331/console This message is automatically generated.
      Yan Zhou made changes -
      Status Open [ 1 ] Patch Available [ 10002 ]
      Yan Zhou made changes -
      Attachment PIG-1453.patch [ 12447494 ]
      Yan Zhou made changes -
      Status Patch Available [ 10002 ] Open [ 1 ]
      Hide
      Hadoop QA added a comment -

      -1 overall. Here are the results of testing the latest attachment
      http://issues.apache.org/jira/secure/attachment/12447373/PIG-1453.patch
      against trunk revision 955701.

      +1 @author. The patch does not contain any @author tags.

      +1 tests included. The patch appears to include 36 new or modified tests.

      -1 javadoc. The javadoc tool appears to have generated 1 warning messages.

      +1 javac. The applied patch does not increase the total number of javac compiler warnings.

      +1 findbugs. The patch does not introduce any new Findbugs warnings.

      +1 release audit. The applied patch does not increase the total number of release audit warnings.

      -1 core tests. The patch failed core unit tests.

      -1 contrib tests. The patch failed contrib unit tests.

      Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/341/testReport/
      Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/341/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
      Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/341/console

      This message is automatically generated.

      Show
      Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12447373/PIG-1453.patch against trunk revision 955701. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 36 new or modified tests. -1 javadoc. The javadoc tool appears to have generated 1 warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. -1 contrib tests. The patch failed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/341/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/341/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/341/console This message is automatically generated.
      Yan Zhou made changes -
      Status Open [ 1 ] Patch Available [ 10002 ]
      Yan Zhou made changes -
      Attachment PIG-1453.patch [ 12447373 ]
      Yan Zhou made changes -
      Fix Version/s 0.7.0 [ 12314397 ]
      Affects Version/s 0.7.0 [ 12314397 ]
      Yan Zhou made changes -
      Field Original Value New Value
      Assignee Yan Zhou [ yanz ]
      Hide
      Yan Zhou added a comment -

      There are two issues that generally make some test cases (not just TestOrderPreserveUnionHDFS) in Zebra's "pigtest" fail intermittently.

      1) There is some randomness when multiple tables are unioned. The correctness check relies on the ordering of tables in output rows, which is incorrect. Instead the table a particular row belongs to can only be associated with the table index in output;

      2) There are some failures in PIG STORE calls as the destination directory are not cleaned up properly before store.

      Show
      Yan Zhou added a comment - There are two issues that generally make some test cases (not just TestOrderPreserveUnionHDFS) in Zebra's "pigtest" fail intermittently. 1) There is some randomness when multiple tables are unioned. The correctness check relies on the ordering of tables in output rows, which is incorrect. Instead the table a particular row belongs to can only be associated with the table index in output; 2) There are some failures in PIG STORE calls as the destination directory are not cleaned up properly before store.
      Daniel Dai created issue -

        People

        • Assignee:
          Yan Zhou
          Reporter:
          Daniel Dai
        • Votes:
          0 Vote for this issue
          Watchers:
          0 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development