Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-993

Cleanup the result data in HDFS after query finished.

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11.0, 0.12.0
    • Component/s: Storage, TajoMaster
    • Labels:
      None

      Description

      Tajo doesn't remove the result data in HDFS after SELECT query finished. Currently user must remove manually. Tajo should remove automatically that data.

        Activity

        Hide
        githubbot ASF GitHub Bot added a comment -

        GitHub user jinossy opened a pull request:

        https://github.com/apache/tajo/pull/720

        TAJO-993: Cleanup the result data in HDFS after query finished.

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/jinossy/tajo TAJO-993

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/tajo/pull/720.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #720


        commit c364dbc08d0cb5d87beb5e8c1d37573c9cdb9c77
        Author: Jinho Kim <jhkim@apache.org>
        Date: 2015-09-02T15:34:24Z

        TAJO-993: Cleanup the result data in HDFS after query finished.


        Show
        githubbot ASF GitHub Bot added a comment - GitHub user jinossy opened a pull request: https://github.com/apache/tajo/pull/720 TAJO-993 : Cleanup the result data in HDFS after query finished. You can merge this pull request into a Git repository by running: $ git pull https://github.com/jinossy/tajo TAJO-993 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tajo/pull/720.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #720 commit c364dbc08d0cb5d87beb5e8c1d37573c9cdb9c77 Author: Jinho Kim <jhkim@apache.org> Date: 2015-09-02T15:34:24Z TAJO-993 : Cleanup the result data in HDFS after query finished.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user hyunsik commented on the pull request:

        https://github.com/apache/tajo/pull/720#issuecomment-137278005

        +1
        The change is straightforward. Ship it.

        Show
        githubbot ASF GitHub Bot added a comment - Github user hyunsik commented on the pull request: https://github.com/apache/tajo/pull/720#issuecomment-137278005 +1 The change is straightforward. Ship it.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user asfgit closed the pull request at:

        https://github.com/apache/tajo/pull/720

        Show
        githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/tajo/pull/720
        Hide
        jhkim Jinho Kim added a comment -

        committed it
        Thanks

        Show
        jhkim Jinho Kim added a comment - committed it Thanks
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-master-CODEGEN-build #470 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/470/)
        TAJO-993: Cleanup the result data in HDFS after query finished. (jhkim: rev 22ab1cf974031bc58d2ff1a6d34102c0c4997184)

        • tajo-core/src/main/java/org/apache/tajo/master/exec/NonForwardQueryResultFileScanner.java
        • tajo-core-tests/src/test/resources/results/TestQueryResult/testTemporalResultOnClose.result
        • tajo-core-tests/src/test/resources/results/TestQueryResult/testTableResultOnClose.result
        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        • tajo-core-tests/src/test/java/org/apache/tajo/master/TestQueryResult.java
        • CHANGES
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-master-CODEGEN-build #470 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/470/ ) TAJO-993 : Cleanup the result data in HDFS after query finished. (jhkim: rev 22ab1cf974031bc58d2ff1a6d34102c0c4997184) tajo-core/src/main/java/org/apache/tajo/master/exec/NonForwardQueryResultFileScanner.java tajo-core-tests/src/test/resources/results/TestQueryResult/testTemporalResultOnClose.result tajo-core-tests/src/test/resources/results/TestQueryResult/testTableResultOnClose.result tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java tajo-core-tests/src/test/java/org/apache/tajo/master/TestQueryResult.java CHANGES
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #826 (See https://builds.apache.org/job/Tajo-master-build/826/)
        TAJO-993: Cleanup the result data in HDFS after query finished. (jhkim: rev 22ab1cf974031bc58d2ff1a6d34102c0c4997184)

        • tajo-core-tests/src/test/java/org/apache/tajo/master/TestQueryResult.java
        • CHANGES
        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        • tajo-core/src/main/java/org/apache/tajo/master/exec/NonForwardQueryResultFileScanner.java
        • tajo-core-tests/src/test/resources/results/TestQueryResult/testTemporalResultOnClose.result
        • tajo-core-tests/src/test/resources/results/TestQueryResult/testTableResultOnClose.result
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #826 (See https://builds.apache.org/job/Tajo-master-build/826/ ) TAJO-993 : Cleanup the result data in HDFS after query finished. (jhkim: rev 22ab1cf974031bc58d2ff1a6d34102c0c4997184) tajo-core-tests/src/test/java/org/apache/tajo/master/TestQueryResult.java CHANGES tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java tajo-core/src/main/java/org/apache/tajo/master/exec/NonForwardQueryResultFileScanner.java tajo-core-tests/src/test/resources/results/TestQueryResult/testTemporalResultOnClose.result tajo-core-tests/src/test/resources/results/TestQueryResult/testTableResultOnClose.result
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-0.11.0-build #7 (See https://builds.apache.org/job/Tajo-0.11.0-build/7/)
        TAJO-993: Cleanup the result data in HDFS after query finished. (jhkim: rev 458345f6eee3dff29e1370e81c8abd409de34039)

        • tajo-core-tests/src/test/resources/results/TestQueryResult/testTableResultOnClose.result
        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        • CHANGES
        • tajo-core/src/main/java/org/apache/tajo/master/exec/NonForwardQueryResultFileScanner.java
        • tajo-core-tests/src/test/resources/results/TestQueryResult/testTemporalResultOnClose.result
        • tajo-core-tests/src/test/java/org/apache/tajo/master/TestQueryResult.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-0.11.0-build #7 (See https://builds.apache.org/job/Tajo-0.11.0-build/7/ ) TAJO-993 : Cleanup the result data in HDFS after query finished. (jhkim: rev 458345f6eee3dff29e1370e81c8abd409de34039) tajo-core-tests/src/test/resources/results/TestQueryResult/testTableResultOnClose.result tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java CHANGES tajo-core/src/main/java/org/apache/tajo/master/exec/NonForwardQueryResultFileScanner.java tajo-core-tests/src/test/resources/results/TestQueryResult/testTemporalResultOnClose.result tajo-core-tests/src/test/java/org/apache/tajo/master/TestQueryResult.java

          People

          • Assignee:
            jhkim Jinho Kim
            Reporter:
            hjkim Hyoungjun Kim
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development