Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-2081

Incorrect task locality on single node

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.11.0, 0.11.1
    • Fix Version/s: 0.12.0, 0.11.2
    • Component/s: QueryMaster
    • Labels:
      None

      Description

      local tasks is still remaining but DefaultTaskScheduler is not found local task and it try to find a task in remote task list

      2016-02-23 22:46:32,818 INFO org.apache.tajo.querymaster.DefaultTaskScheduler: Assigned host : host1, Remaining local tasks : 2, Remote Concurrency : 1
      2016-02-23 22:46:32,820 INFO org.apache.tajo.querymaster.DefaultTaskScheduler: Assigned Local/Rack/Total: (348/1/349), Attempted Cancel/Assign/Total: (10/349/359), Locality: 99.71%, Rack host: host1
      

        Activity

        Hide
        githubbot ASF GitHub Bot added a comment -

        GitHub user jinossy opened a pull request:

        https://github.com/apache/tajo/pull/968

        TAJO-2081: Incorrect task locality on single node.

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/jinossy/tajo TAJO-2081

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/tajo/pull/968.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #968


        commit 53b6f9f9e4f6419ae1e9481ec53ac703dee53df8
        Author: Jinho Kim <jhkim@apache.org>
        Date: 2016-02-25T05:22:57Z

        TAJO-2081: Incorrect task locality on single node.


        Show
        githubbot ASF GitHub Bot added a comment - GitHub user jinossy opened a pull request: https://github.com/apache/tajo/pull/968 TAJO-2081 : Incorrect task locality on single node. You can merge this pull request into a Git repository by running: $ git pull https://github.com/jinossy/tajo TAJO-2081 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tajo/pull/968.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #968 commit 53b6f9f9e4f6419ae1e9481ec53ac703dee53df8 Author: Jinho Kim <jhkim@apache.org> Date: 2016-02-25T05:22:57Z TAJO-2081 : Incorrect task locality on single node.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user jihoonson commented on the pull request:

        https://github.com/apache/tajo/pull/968#issuecomment-192078866

        +1 LGTM!

        Show
        githubbot ASF GitHub Bot added a comment - Github user jihoonson commented on the pull request: https://github.com/apache/tajo/pull/968#issuecomment-192078866 +1 LGTM!
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user asfgit closed the pull request at:

        https://github.com/apache/tajo/pull/968

        Show
        githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/tajo/pull/968
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-master-CODEGEN-build #688 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/688/)
        TAJO-2081: Incorrect task locality on single node. (jhkim: rev fdb76ed2c7c06e7a9b43bbea18e202586b88606a)

        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        • tajo-core/src/main/java/org/apache/tajo/querymaster/DefaultTaskScheduler.java
        • CHANGES
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-master-CODEGEN-build #688 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/688/ ) TAJO-2081 : Incorrect task locality on single node. (jhkim: rev fdb76ed2c7c06e7a9b43bbea18e202586b88606a) tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java tajo-core/src/main/java/org/apache/tajo/querymaster/DefaultTaskScheduler.java CHANGES
        Hide
        jhkim Jinho Kim added a comment -

        committed it
        Thanks for your review!

        Show
        jhkim Jinho Kim added a comment - committed it Thanks for your review!
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-0.11.2-build #176 (See https://builds.apache.org/job/Tajo-0.11.2-build/176/)
        TAJO-2081: Incorrect task locality on single node. (jhkim: rev f6417f4ea40d0ca6801f19392c8ab9ded2f46cdf)

        • tajo-core/src/main/java/org/apache/tajo/querymaster/DefaultTaskScheduler.java
        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        • CHANGES
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-0.11.2-build #176 (See https://builds.apache.org/job/Tajo-0.11.2-build/176/ ) TAJO-2081 : Incorrect task locality on single node. (jhkim: rev f6417f4ea40d0ca6801f19392c8ab9ded2f46cdf) tajo-core/src/main/java/org/apache/tajo/querymaster/DefaultTaskScheduler.java tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java CHANGES
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #1096 (See https://builds.apache.org/job/Tajo-master-build/1096/)
        TAJO-2081: Incorrect task locality on single node. (jhkim: rev fdb76ed2c7c06e7a9b43bbea18e202586b88606a)

        • tajo-core/src/main/java/org/apache/tajo/querymaster/DefaultTaskScheduler.java
        • CHANGES
        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #1096 (See https://builds.apache.org/job/Tajo-master-build/1096/ ) TAJO-2081 : Incorrect task locality on single node. (jhkim: rev fdb76ed2c7c06e7a9b43bbea18e202586b88606a) tajo-core/src/main/java/org/apache/tajo/querymaster/DefaultTaskScheduler.java CHANGES tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java

          People

          • Assignee:
            jhkim Jinho Kim
            Reporter:
            jhkim Jinho Kim
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development