Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-1200

Invalid shuffle data of multiple worker in same server

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: 0.10.0
    • Component/s: Data Shuffle
    • Labels:
      None

      Description

      If multiple worker is running in same server, the local chunks has incorrect to create path.

        Activity

        Hide
        githubbot ASF GitHub Bot added a comment -

        GitHub user jinossy opened a pull request:

        https://github.com/apache/tajo/pull/259

        TAJO-1200: Invalid shuffle data of multiple worker in same server

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/jinossy/tajo TAJO-1200

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/tajo/pull/259.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #259


        commit 67bdc71b17b54da731eaf01b9fac51ad8983353b
        Author: JaeHwa Jung <blrunner@apache.org>
        Date: 2014-11-19T06:46:47Z

        TAJO-1195: Remove unused CachedDNSResolver Class. (DaeMyung Kang via jaehwa)

        Closes #253

        commit 962ae766beaa461a47a267c4ce9ee69517ac3011
        Author: jhkim <jhkim@apache.org>
        Date: 2014-11-19T11:10:22Z

        TAJO-1200: Invalid shuffle data of multiple worker in same server

        commit ef282ebec579c512bbb3860a49d7322e1fb45199
        Author: jhkim <jhkim@apache.org>
        Date: 2014-11-19T11:14:21Z

        TAJO-1197: Unit test failed: unable to create new native thread. (jinho)

        Closes #255

        commit 033635c2134a11cdb6cab631b954817b9fbdd815
        Author: jhkim <jhkim@apache.org>
        Date: 2014-11-19T11:17:44Z

        Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/tajo into TAJO-1200


        Show
        githubbot ASF GitHub Bot added a comment - GitHub user jinossy opened a pull request: https://github.com/apache/tajo/pull/259 TAJO-1200 : Invalid shuffle data of multiple worker in same server You can merge this pull request into a Git repository by running: $ git pull https://github.com/jinossy/tajo TAJO-1200 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tajo/pull/259.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #259 commit 67bdc71b17b54da731eaf01b9fac51ad8983353b Author: JaeHwa Jung <blrunner@apache.org> Date: 2014-11-19T06:46:47Z TAJO-1195 : Remove unused CachedDNSResolver Class. (DaeMyung Kang via jaehwa) Closes #253 commit 962ae766beaa461a47a267c4ce9ee69517ac3011 Author: jhkim <jhkim@apache.org> Date: 2014-11-19T11:10:22Z TAJO-1200 : Invalid shuffle data of multiple worker in same server commit ef282ebec579c512bbb3860a49d7322e1fb45199 Author: jhkim <jhkim@apache.org> Date: 2014-11-19T11:14:21Z TAJO-1197 : Unit test failed: unable to create new native thread. (jinho) Closes #255 commit 033635c2134a11cdb6cab631b954817b9fbdd815 Author: jhkim <jhkim@apache.org> Date: 2014-11-19T11:17:44Z Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/tajo into TAJO-1200
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user hyunsik commented on the pull request:

        https://github.com/apache/tajo/pull/259#issuecomment-63666127

        +1
        I also found this bug while I'm testing Tajo on Slider. It seems to be an urgent issue. The patch looks good to me. Ship it!

        Show
        githubbot ASF GitHub Bot added a comment - Github user hyunsik commented on the pull request: https://github.com/apache/tajo/pull/259#issuecomment-63666127 +1 I also found this bug while I'm testing Tajo on Slider. It seems to be an urgent issue. The patch looks good to me. Ship it!
        Hide
        jhkim Jinho Kim added a comment -

        Committed it!
        Thanks.

        Show
        jhkim Jinho Kim added a comment - Committed it! Thanks.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #458 (See https://builds.apache.org/job/Tajo-master-build/458/)
        TAJO-1200: Invalid shuffle data of multiple worker in same server. (jinho) (jhkim: rev c544ffc088d685f1ad66963351d71d7a925c7025)

        • CHANGES
        • tajo-core/src/main/java/org/apache/tajo/worker/Task.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #458 (See https://builds.apache.org/job/Tajo-master-build/458/ ) TAJO-1200 : Invalid shuffle data of multiple worker in same server. (jinho) (jhkim: rev c544ffc088d685f1ad66963351d71d7a925c7025) CHANGES tajo-core/src/main/java/org/apache/tajo/worker/Task.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-master-CODEGEN-build #100 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/100/)
        TAJO-1200: Invalid shuffle data of multiple worker in same server. (jinho) (jhkim: rev c544ffc088d685f1ad66963351d71d7a925c7025)

        • tajo-core/src/main/java/org/apache/tajo/worker/Task.java
        • CHANGES
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-master-CODEGEN-build #100 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/100/ ) TAJO-1200 : Invalid shuffle data of multiple worker in same server. (jinho) (jhkim: rev c544ffc088d685f1ad66963351d71d7a925c7025) tajo-core/src/main/java/org/apache/tajo/worker/Task.java CHANGES
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user asfgit closed the pull request at:

        https://github.com/apache/tajo/pull/259

        Show
        githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/tajo/pull/259

          People

          • Assignee:
            jhkim Jinho Kim
            Reporter:
            jhkim Jinho Kim
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development