Hive
  1. Hive
  2. HIVE-2929

race condition in DAG execute tasks for hive

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.10.0
    • Component/s: None
    • Labels:
      None

      Description

      select ...
      (
      SubQuery involving MapReduce
      union all
      SubQuery involving MapReduce
      );

      or

      select ...
      (SubQuery involving MapReduce)
      join
      (SubQuery involving MapReduce)
      ;

      If both the subQueries finish at nearly the same time, there is a race
      condition in which the results of the subQuery finishing last will be completely missed.

        Activity

        Show
        Namit Jain added a comment - https://reviews.facebook.net/differential/diff/8571/
        Hide
        Siying Dong added a comment -

        +1
        committed. Thanks Namit!

        Show
        Siying Dong added a comment - +1 committed. Thanks Namit!
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-h0.21 #1360 (See https://builds.apache.org/job/Hive-trunk-h0.21/1360/)
        HIVE-2929 race condition in DAG execute tasks for hive (Namit Jain via Siying Dong) (Revision 1310619)

        Result = ABORTED
        sdong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1310619
        Files :

        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java
        Show
        Hudson added a comment - Integrated in Hive-trunk-h0.21 #1360 (See https://builds.apache.org/job/Hive-trunk-h0.21/1360/ ) HIVE-2929 race condition in DAG execute tasks for hive (Namit Jain via Siying Dong) (Revision 1310619) Result = ABORTED sdong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1310619 Files : /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/)
        HIVE-2929 race condition in DAG execute tasks for hive (Namit Jain via Siying Dong) (Revision 1310619)

        Result = ABORTED
        sdong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1310619
        Files :

        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java
        Show
        Hudson added a comment - Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/ ) HIVE-2929 race condition in DAG execute tasks for hive (Namit Jain via Siying Dong) (Revision 1310619) Result = ABORTED sdong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1310619 Files : /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java
        Hide
        Ashutosh Chauhan added a comment -

        This issue is fixed and released as part of 0.10.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.

        Show
        Ashutosh Chauhan added a comment - This issue is fixed and released as part of 0.10.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.

          People

          • Assignee:
            Namit Jain
            Reporter:
            Namit Jain
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development