Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-993

Cleanup the result data in HDFS after query finished.

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11.0, 0.12.0
    • Component/s: Storage, TajoMaster
    • Labels:
      None

      Description

      Tajo doesn't remove the result data in HDFS after SELECT query finished. Currently user must remove manually. Tajo should remove automatically that data.

        Activity

        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-0.11.0-build #7 (See https://builds.apache.org/job/Tajo-0.11.0-build/7/)
        TAJO-993: Cleanup the result data in HDFS after query finished. (jhkim: rev 458345f6eee3dff29e1370e81c8abd409de34039)

        • tajo-core-tests/src/test/resources/results/TestQueryResult/testTableResultOnClose.result
        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        • CHANGES
        • tajo-core/src/main/java/org/apache/tajo/master/exec/NonForwardQueryResultFileScanner.java
        • tajo-core-tests/src/test/resources/results/TestQueryResult/testTemporalResultOnClose.result
        • tajo-core-tests/src/test/java/org/apache/tajo/master/TestQueryResult.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-0.11.0-build #7 (See https://builds.apache.org/job/Tajo-0.11.0-build/7/ ) TAJO-993 : Cleanup the result data in HDFS after query finished. (jhkim: rev 458345f6eee3dff29e1370e81c8abd409de34039) tajo-core-tests/src/test/resources/results/TestQueryResult/testTableResultOnClose.result tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java CHANGES tajo-core/src/main/java/org/apache/tajo/master/exec/NonForwardQueryResultFileScanner.java tajo-core-tests/src/test/resources/results/TestQueryResult/testTemporalResultOnClose.result tajo-core-tests/src/test/java/org/apache/tajo/master/TestQueryResult.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #826 (See https://builds.apache.org/job/Tajo-master-build/826/)
        TAJO-993: Cleanup the result data in HDFS after query finished. (jhkim: rev 22ab1cf974031bc58d2ff1a6d34102c0c4997184)

        • tajo-core-tests/src/test/java/org/apache/tajo/master/TestQueryResult.java
        • CHANGES
        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        • tajo-core/src/main/java/org/apache/tajo/master/exec/NonForwardQueryResultFileScanner.java
        • tajo-core-tests/src/test/resources/results/TestQueryResult/testTemporalResultOnClose.result
        • tajo-core-tests/src/test/resources/results/TestQueryResult/testTableResultOnClose.result
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #826 (See https://builds.apache.org/job/Tajo-master-build/826/ ) TAJO-993 : Cleanup the result data in HDFS after query finished. (jhkim: rev 22ab1cf974031bc58d2ff1a6d34102c0c4997184) tajo-core-tests/src/test/java/org/apache/tajo/master/TestQueryResult.java CHANGES tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java tajo-core/src/main/java/org/apache/tajo/master/exec/NonForwardQueryResultFileScanner.java tajo-core-tests/src/test/resources/results/TestQueryResult/testTemporalResultOnClose.result tajo-core-tests/src/test/resources/results/TestQueryResult/testTableResultOnClose.result
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-master-CODEGEN-build #470 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/470/)
        TAJO-993: Cleanup the result data in HDFS after query finished. (jhkim: rev 22ab1cf974031bc58d2ff1a6d34102c0c4997184)

        • tajo-core/src/main/java/org/apache/tajo/master/exec/NonForwardQueryResultFileScanner.java
        • tajo-core-tests/src/test/resources/results/TestQueryResult/testTemporalResultOnClose.result
        • tajo-core-tests/src/test/resources/results/TestQueryResult/testTableResultOnClose.result
        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        • tajo-core-tests/src/test/java/org/apache/tajo/master/TestQueryResult.java
        • CHANGES
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-master-CODEGEN-build #470 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/470/ ) TAJO-993 : Cleanup the result data in HDFS after query finished. (jhkim: rev 22ab1cf974031bc58d2ff1a6d34102c0c4997184) tajo-core/src/main/java/org/apache/tajo/master/exec/NonForwardQueryResultFileScanner.java tajo-core-tests/src/test/resources/results/TestQueryResult/testTemporalResultOnClose.result tajo-core-tests/src/test/resources/results/TestQueryResult/testTableResultOnClose.result tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java tajo-core-tests/src/test/java/org/apache/tajo/master/TestQueryResult.java CHANGES
        Hide
        jhkim Jinho Kim added a comment -

        committed it
        Thanks

        Show
        jhkim Jinho Kim added a comment - committed it Thanks
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user asfgit closed the pull request at:

        https://github.com/apache/tajo/pull/720

        Show
        githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/tajo/pull/720
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user hyunsik commented on the pull request:

        https://github.com/apache/tajo/pull/720#issuecomment-137278005

        +1
        The change is straightforward. Ship it.

        Show
        githubbot ASF GitHub Bot added a comment - Github user hyunsik commented on the pull request: https://github.com/apache/tajo/pull/720#issuecomment-137278005 +1 The change is straightforward. Ship it.
        Hide
        githubbot ASF GitHub Bot added a comment -

        GitHub user jinossy opened a pull request:

        https://github.com/apache/tajo/pull/720

        TAJO-993: Cleanup the result data in HDFS after query finished.

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/jinossy/tajo TAJO-993

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/tajo/pull/720.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #720


        commit c364dbc08d0cb5d87beb5e8c1d37573c9cdb9c77
        Author: Jinho Kim <jhkim@apache.org>
        Date: 2015-09-02T15:34:24Z

        TAJO-993: Cleanup the result data in HDFS after query finished.


        Show
        githubbot ASF GitHub Bot added a comment - GitHub user jinossy opened a pull request: https://github.com/apache/tajo/pull/720 TAJO-993 : Cleanup the result data in HDFS after query finished. You can merge this pull request into a Git repository by running: $ git pull https://github.com/jinossy/tajo TAJO-993 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tajo/pull/720.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #720 commit c364dbc08d0cb5d87beb5e8c1d37573c9cdb9c77 Author: Jinho Kim <jhkim@apache.org> Date: 2015-09-02T15:34:24Z TAJO-993 : Cleanup the result data in HDFS after query finished.

          People

          • Assignee:
            jhkim Jinho Kim
            Reporter:
            hjkim Hyoungjun Kim
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development