Hive
  1. Hive
  2. HIVE-3164

Fix non-deterministic testcases failures when running Hive0.9.0 on MapReduce2

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.10.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The following testcases are failing when running Hive0.9.0 on MapReduce2 due to non-deterministic testcase result:

      groupby7_noskew_multi_single_reducer.q
      groupby_complex_types_multi_single_reducer.q
      groupby_multi_single_reducer.q
      leftsemijoin.q

        Activity

        Ashutosh Chauhan made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Hide
        Ashutosh Chauhan added a comment -

        This issue is fixed and released as part of 0.10.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.

        Show
        Ashutosh Chauhan added a comment - This issue is fixed and released as part of 0.10.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/)
        HIVE-3164 Not deterministic testcases with MapReduce2 (Zhenxiao Luo via egc) (Revision 1352271)

        Result = ABORTED
        ecapriolo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1352271
        Files :

        • /hive/trunk/ql/src/test/queries/clientpositive/groupby7_noskew_multi_single_reducer.q
        • /hive/trunk/ql/src/test/queries/clientpositive/groupby_complex_types_multi_single_reducer.q
        • /hive/trunk/ql/src/test/queries/clientpositive/groupby_multi_single_reducer.q
        • /hive/trunk/ql/src/test/queries/clientpositive/leftsemijoin.q
        • /hive/trunk/ql/src/test/results/clientpositive/groupby7_noskew_multi_single_reducer.q.out
        • /hive/trunk/ql/src/test/results/clientpositive/groupby_complex_types_multi_single_reducer.q.out
        • /hive/trunk/ql/src/test/results/clientpositive/groupby_multi_single_reducer.q.out
        • /hive/trunk/ql/src/test/results/clientpositive/leftsemijoin.q.out
        Show
        Hudson added a comment - Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/ ) HIVE-3164 Not deterministic testcases with MapReduce2 (Zhenxiao Luo via egc) (Revision 1352271) Result = ABORTED ecapriolo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1352271 Files : /hive/trunk/ql/src/test/queries/clientpositive/groupby7_noskew_multi_single_reducer.q /hive/trunk/ql/src/test/queries/clientpositive/groupby_complex_types_multi_single_reducer.q /hive/trunk/ql/src/test/queries/clientpositive/groupby_multi_single_reducer.q /hive/trunk/ql/src/test/queries/clientpositive/leftsemijoin.q /hive/trunk/ql/src/test/results/clientpositive/groupby7_noskew_multi_single_reducer.q.out /hive/trunk/ql/src/test/results/clientpositive/groupby_complex_types_multi_single_reducer.q.out /hive/trunk/ql/src/test/results/clientpositive/groupby_multi_single_reducer.q.out /hive/trunk/ql/src/test/results/clientpositive/leftsemijoin.q.out
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-h0.21 #1500 (See https://builds.apache.org/job/Hive-trunk-h0.21/1500/)
        HIVE-3164 Not deterministic testcases with MapReduce2 (Zhenxiao Luo via egc) (Revision 1352271)

        Result = FAILURE
        ecapriolo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1352271
        Files :

        • /hive/trunk/ql/src/test/queries/clientpositive/groupby7_noskew_multi_single_reducer.q
        • /hive/trunk/ql/src/test/queries/clientpositive/groupby_complex_types_multi_single_reducer.q
        • /hive/trunk/ql/src/test/queries/clientpositive/groupby_multi_single_reducer.q
        • /hive/trunk/ql/src/test/queries/clientpositive/leftsemijoin.q
        • /hive/trunk/ql/src/test/results/clientpositive/groupby7_noskew_multi_single_reducer.q.out
        • /hive/trunk/ql/src/test/results/clientpositive/groupby_complex_types_multi_single_reducer.q.out
        • /hive/trunk/ql/src/test/results/clientpositive/groupby_multi_single_reducer.q.out
        • /hive/trunk/ql/src/test/results/clientpositive/leftsemijoin.q.out
        Show
        Hudson added a comment - Integrated in Hive-trunk-h0.21 #1500 (See https://builds.apache.org/job/Hive-trunk-h0.21/1500/ ) HIVE-3164 Not deterministic testcases with MapReduce2 (Zhenxiao Luo via egc) (Revision 1352271) Result = FAILURE ecapriolo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1352271 Files : /hive/trunk/ql/src/test/queries/clientpositive/groupby7_noskew_multi_single_reducer.q /hive/trunk/ql/src/test/queries/clientpositive/groupby_complex_types_multi_single_reducer.q /hive/trunk/ql/src/test/queries/clientpositive/groupby_multi_single_reducer.q /hive/trunk/ql/src/test/queries/clientpositive/leftsemijoin.q /hive/trunk/ql/src/test/results/clientpositive/groupby7_noskew_multi_single_reducer.q.out /hive/trunk/ql/src/test/results/clientpositive/groupby_complex_types_multi_single_reducer.q.out /hive/trunk/ql/src/test/results/clientpositive/groupby_multi_single_reducer.q.out /hive/trunk/ql/src/test/results/clientpositive/leftsemijoin.q.out
        Edward Capriolo made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 0.10.0 [ 12320745 ]
        Resolution Fixed [ 1 ]
        Hide
        Edward Capriolo added a comment -

        Thank you for cleaning up test cases.

        Show
        Edward Capriolo added a comment - Thank you for cleaning up test cases.
        Hide
        Edward Capriolo added a comment -

        + 1 will commit

        [edward@tablitha trunk]$ ant test -Dtestcase=TestCliDriver -Dqfile=groupby7_noskew_multi_single_reducer.q,leftsemijoin.q,groupby_multi_single_reducer.q,groupby_complex_types_multi_single_reducer.q
        
            [junit] Cleaning up TestCliDriver
            [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 328.183 sec
        
        Show
        Edward Capriolo added a comment - + 1 will commit [edward@tablitha trunk]$ ant test -Dtestcase=TestCliDriver -Dqfile=groupby7_noskew_multi_single_reducer.q,leftsemijoin.q,groupby_multi_single_reducer.q,groupby_complex_types_multi_single_reducer.q [junit] Cleaning up TestCliDriver [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 328.183 sec
        Zhenxiao Luo made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Zhenxiao Luo made changes -
        Field Original Value New Value
        Attachment HIVE-3164.1.patch.txt [ 12532638 ]
        Zhenxiao Luo created issue -

          People

          • Assignee:
            Zhenxiao Luo
            Reporter:
            Zhenxiao Luo
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development