Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-969

Distributed sort on a large data set may result in incorrect results.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.0
    • Component/s: Data Shuffle
    • Labels:
      None

      Description

      This is a recently added bug. This bug causes incorrect order results when the number of partition ranges are more than one. This patch fixes the bug.

      This is an urgent bug fix. The unit test to reproduce this case requires session variables to change the default TajoConf settings. In other words, for it, we need the resolution of TAJO-928. After TAJO-928, I'll add an unit test in another Jira (TAJO-970).

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Tajo-master-build #312 (See https://builds.apache.org/job/Tajo-master-build/312/)
          TAJO-969: Distributed sort on a large data set may result in incorrect results. (hyunsik: rev 45559ce60c1da55ac7be1a5900afab45cc9deb06)

          • tajo-core/src/main/java/org/apache/tajo/master/querymaster/QueryUnit.java
          • tajo-core/src/main/java/org/apache/tajo/master/querymaster/Repartitioner.java
          • tajo-core/src/main/java/org/apache/tajo/worker/FetchImpl.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #312 (See https://builds.apache.org/job/Tajo-master-build/312/ ) TAJO-969 : Distributed sort on a large data set may result in incorrect results. (hyunsik: rev 45559ce60c1da55ac7be1a5900afab45cc9deb06) tajo-core/src/main/java/org/apache/tajo/master/querymaster/QueryUnit.java tajo-core/src/main/java/org/apache/tajo/master/querymaster/Repartitioner.java tajo-core/src/main/java/org/apache/tajo/worker/FetchImpl.java
          Hide
          hyunsik Hyunsik Choi added a comment -

          committed.

          Show
          hyunsik Hyunsik Choi added a comment - committed.
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user asfgit closed the pull request at:

          https://github.com/apache/tajo/pull/87

          Show
          githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/tajo/pull/87
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user hyunsik commented on the pull request:

          https://github.com/apache/tajo/pull/87#issuecomment-49850329

          Thank you for quick review. I've just committed it to master branch.

          Show
          githubbot ASF GitHub Bot added a comment - Github user hyunsik commented on the pull request: https://github.com/apache/tajo/pull/87#issuecomment-49850329 Thank you for quick review. I've just committed it to master branch.
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user blrunner commented on the pull request:

          https://github.com/apache/tajo/pull/87#issuecomment-49849587

          +1

          Thanks your contribution.
          It ran as expected, push it.

          Show
          githubbot ASF GitHub Bot added a comment - Github user blrunner commented on the pull request: https://github.com/apache/tajo/pull/87#issuecomment-49849587 +1 Thanks your contribution. It ran as expected, push it.
          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user hyunsik opened a pull request:

          https://github.com/apache/tajo/pull/87

          TAJO-969: Distributed sort on a large data set may result in incorrect r...

          ...esults.

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/hyunsik/tajo TAJO-969

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/tajo/pull/87.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #87


          commit 2d1b880094f05bd0ab574817265f53125aa9f304
          Author: Hyunsik Choi <hyunsik@apache.org>
          Date: 2014-07-22T07:59:57Z

          TAJO-969: Distributed sort on a large data set may result in incorrect results.


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user hyunsik opened a pull request: https://github.com/apache/tajo/pull/87 TAJO-969 : Distributed sort on a large data set may result in incorrect r... ...esults. You can merge this pull request into a Git repository by running: $ git pull https://github.com/hyunsik/tajo TAJO-969 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tajo/pull/87.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #87 commit 2d1b880094f05bd0ab574817265f53125aa9f304 Author: Hyunsik Choi <hyunsik@apache.org> Date: 2014-07-22T07:59:57Z TAJO-969 : Distributed sort on a large data set may result in incorrect results.

            People

            • Assignee:
              hyunsik Hyunsik Choi
              Reporter:
              hyunsik Hyunsik Choi
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development