Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-896

Full outer join query with empty intermediate data doesn't terminate.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Trivial
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.0
    • Component/s: None
    • Labels:
      None

      Description

      See title.
      I ran the following query. Left and right subquery's result is empty.

      select a.l_orderkey 
      from (select * from lineitem where l_orderkey < 0) a
      full outer join (select * from lineitem where l_orderkey < 0) b
      on a.l_orderkey = b.l_orderkey
      

      The next log is QueryMaster's log. QueryMaster assigned 1 task for JOIN execution block.

      2014-06-30 16:18:24,987 INFO: org.apache.tajo.master.querymaster.Repartitioner (scheduleFragmentsForJoinQuery(186)) - [Distributed Join Strategy] : Symmetric Repartition Join
      2014-06-30 16:18:24,988 INFO: org.apache.tajo.master.querymaster.Repartitioner (scheduleFragmentsForJoinQuery(258)) - Larger intermediate data is approximately 0 MB
      2014-06-30 16:18:24,988 INFO: org.apache.tajo.master.querymaster.Repartitioner (scheduleFragmentsForJoinQuery(261)) - The calculated number of tasks is 0
      2014-06-30 16:18:24,988 INFO: org.apache.tajo.master.querymaster.Repartitioner (scheduleFragmentsForJoinQuery(262)) - The number of total shuffle keys is 1
      2014-06-30 16:18:24,988 INFO: org.apache.tajo.master.querymaster.Repartitioner (scheduleFragmentsForJoinQuery(266)) - The determined number of join tasks is 0
      2014-06-30 16:18:24,989 INFO: org.apache.tajo.master.querymaster.SubQuery (transition(647)) - 1 objects are scheduled
      2014-06-30 16:18:24,989 INFO: org.apache.tajo.master.DefaultTaskScheduler (start(87)) - Start TaskScheduler
      2014-06-30 16:18:24,990 INFO: org.apache.tajo.worker.TajoResourceAllocator (calculateNumRequestContainers(100)) - CalculateNumberRequestContainer - Number of Tasks=0, Number of Cluster Slots=1
      2014-06-30 16:18:24,990 INFO: org.apache.tajo.master.querymaster.SubQuery (allocateContainers(888)) - Request Container for eb_1404112701831_0001_000003 containers=0
      2014-06-30 16:18:24,990 INFO: org.apache.tajo.master.querymaster.Query (executeNextBlock(609)) - Scheduling SubQuery:eb_1404112701831_0001_000003
      2014-06-30 16:18:24,991 INFO: org.apache.tajo.worker.TajoResourceAllocator (run(217)) - Start TajoWorkerAllocationThread
      2014-06-30 16:18:26,480 INFO: org.apache.tajo.master.querymaster.QueryInProgress (heartbeat(265)) - Received QueryMaster heartbeat:q_1404112701831_0001,state=QUERY_RUNNING,progress=0.6666667, queryMaster=babokim-MacBook-Pro.local
      2014-06-30 16:18:27,992 INFO: org.apache.tajo.worker.TajoResourceAllocator (run(261)) - No available worker resource for eb_1404112701831_0001_000003
      

        Activity

        Hide
        githubbot ASF GitHub Bot added a comment -

        GitHub user babokim opened a pull request:

        https://github.com/apache/tajo/pull/51

        TAJO-896: Full outer join query with empty intermediate data doesn't terminate.

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/babokim/tajo TAJO-896

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/tajo/pull/51.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #51


        commit db4a235f588976b85e2a450010d8ac3814312de3
        Author: 김형준 <babokim@babokim-mbp.server.gruter.com>
        Date: 2014-06-30T10:24:27Z

        TAJO-896: Full outer join query with empty intermediate data doesn't terminate.


        Show
        githubbot ASF GitHub Bot added a comment - GitHub user babokim opened a pull request: https://github.com/apache/tajo/pull/51 TAJO-896 : Full outer join query with empty intermediate data doesn't terminate. You can merge this pull request into a Git repository by running: $ git pull https://github.com/babokim/tajo TAJO-896 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tajo/pull/51.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #51 commit db4a235f588976b85e2a450010d8ac3814312de3 Author: 김형준 <babokim@babokim-mbp.server.gruter.com> Date: 2014-06-30T10:24:27Z TAJO-896 : Full outer join query with empty intermediate data doesn't terminate.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user hyunsik commented on the pull request:

        https://github.com/apache/tajo/pull/51#issuecomment-47618687

        +1

        I've renamed some variable names, and others all look good to me.

        Show
        githubbot ASF GitHub Bot added a comment - Github user hyunsik commented on the pull request: https://github.com/apache/tajo/pull/51#issuecomment-47618687 +1 I've renamed some variable names, and others all look good to me.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user asfgit closed the pull request at:

        https://github.com/apache/tajo/pull/51

        Show
        githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/tajo/pull/51
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #272 (See https://builds.apache.org/job/Tajo-master-build/272/)
        TAJO-896: Full outer join query with empty intermediate data doesn't terminate. (Hyoungjun Kim via hyunsik) (hyunsik: rev f5e999915a852473a77aa6958c46ae2389bafa2f)

        • tajo-core/src/main/java/org/apache/tajo/master/querymaster/Repartitioner.java
        • tajo-core/src/test/java/org/apache/tajo/engine/query/TestJoinQuery.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #272 (See https://builds.apache.org/job/Tajo-master-build/272/ ) TAJO-896 : Full outer join query with empty intermediate data doesn't terminate. (Hyoungjun Kim via hyunsik) (hyunsik: rev f5e999915a852473a77aa6958c46ae2389bafa2f) tajo-core/src/main/java/org/apache/tajo/master/querymaster/Repartitioner.java tajo-core/src/test/java/org/apache/tajo/engine/query/TestJoinQuery.java
        Hide
        hyunsik Hyunsik Choi added a comment -

        already committed to master branch. Fixing it as resolved.

        Show
        hyunsik Hyunsik Choi added a comment - already committed to master branch. Fixing it as resolved.

          People

          • Assignee:
            hjkim Hyoungjun Kim
            Reporter:
            hjkim Hyoungjun Kim
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development