Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-2013

FilterPushDownRule fails due to the unsupported index

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.11.0
    • Fix Version/s: 0.12.0, 0.11.1
    • Component/s: Planner/Optimizer
    • Labels:
      None

      Description

      The error can cause, if the catalog is HiveCatalogStore

      2015-12-07 18:54:16,054 ERROR org.apache.tajo.catalog.CatalogServer: 
      Stack Trace:
      java.lang.UnsupportedOperationException
      	at org.apache.tajo.catalog.store.HiveCatalogStore.existIndexByColumns(HiveCatalogStore.java:970)
      	at org.apache.tajo.catalog.CatalogServer$CatalogProtocolHandler.existIndexByColumnNames(CatalogServer.java:1153)
      	at org.apache.tajo.catalog.AbstractCatalogClient.existIndexByColumnNames(AbstractCatalogClient.java:659)
      	at org.apache.tajo.catalog.AbstractCatalogClient.existIndexByColumns(AbstractCatalogClient.java:644)
      	at org.apache.tajo.plan.rewrite.rules.FilterPushDownRule.visitScan(FilterPushDownRule.java:994)
      	at org.apache.tajo.plan.rewrite.rules.FilterPushDownRule.visitScan(FilterPushDownRule.java:52)
      	at org.apache.tajo.plan.visitor.BasicLogicalPlanVisitor.visit(BasicLogicalPlanVisitor.java:110)
      	at org.apache.tajo.plan.rewrite.rules.FilterPushDownRule.visitFilter(FilterPushDownRule.java:135)
      	at org.apache.tajo.plan.rewrite.rules.FilterPushDownRule.visitFilter(FilterPushDownRule.java:52)
      	at org.apache.tajo.plan.visitor.BasicLogicalPlanVisitor.visit(BasicLogicalPlanVisitor.java:92)
      	at org.apache.tajo.plan.visitor.BasicLogicalPlanVisitor.visitGroupBy(BasicLogicalPlanVisitor.java:221)
      	at org.apache.tajo.plan.rewrite.rules.FilterPushDownRule.visitGroupBy(FilterPushDownRule.java:884)
      	at org.apache.tajo.plan.rewrite.rules.FilterPushDownRule.visitGroupBy(FilterPushDownRule.java:52)
      	at org.apache.tajo.plan.visitor.BasicLogicalPlanVisitor.visit(BasicLogicalPlanVisitor.java:83)
      	at org.apache.tajo.plan.visitor.BasicLogicalPlanVisitor.visitSort(BasicLogicalPlanVisitor.java:203)
      	at org.apache.tajo.plan.visitor.BasicLogicalPlanVisitor.visit(BasicLogicalPlanVisitor.java:77)
      	at org.apache.tajo.plan.rewrite.rules.FilterPushDownRule.visitProjection(FilterPushDownRule.java:603)
      	at org.apache.tajo.plan.rewrite.rules.FilterPushDownRule.visitProjection(FilterPushDownRule.java:52)
      	at org.apache.tajo.plan.visitor.BasicLogicalPlanVisitor.visit(BasicLogicalPlanVisitor.java:71)
      	at org.apache.tajo.plan.visitor.BasicLogicalPlanVisitor.visitRoot(BasicLogicalPlanVisitor.java:163)
      	at org.apache.tajo.plan.visitor.BasicLogicalPlanVisitor.visit(BasicLogicalPlanVisitor.java:62)
      	at org.apache.tajo.plan.rewrite.rules.FilterPushDownRule.rewrite(FilterPushDownRule.java:118)
      	at org.apache.tajo.plan.rewrite.BaseLogicalPlanRewriteEngine.rewrite(BaseLogicalPlanRewriteEngine.java:84)
      	at org.apache.tajo.plan.LogicalOptimizer.optimize(LogicalOptimizer.java:87)
      	at org.apache.tajo.master.GlobalEngine.createLogicalPlan(GlobalEngine.java:281)
      	at org.apache.tajo.master.GlobalEngine.executeQuery(GlobalEngine.java:190)
      	at org.apache.tajo.master.TajoMasterClientService$TajoMasterClientProtocolServiceHandler.submitQuery(TajoMasterClientService.java:303)
      

        Activity

        Hide
        githubbot ASF GitHub Bot added a comment -

        GitHub user jinossy opened a pull request:

        https://github.com/apache/tajo/pull/904

        TAJO-2013: FilterPushDownRule fails due to the unsupported index.

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/jinossy/tajo TAJO-2013

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/tajo/pull/904.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #904


        commit ba31828bff1113081c11f58d43ed153b45a18719
        Author: Jinho Kim <jhkim@apache.org>
        Date: 2015-12-08T07:39:35Z

        TAJO-2013: FilterPushDownRule fails due to the unsupported index.


        Show
        githubbot ASF GitHub Bot added a comment - GitHub user jinossy opened a pull request: https://github.com/apache/tajo/pull/904 TAJO-2013 : FilterPushDownRule fails due to the unsupported index. You can merge this pull request into a Git repository by running: $ git pull https://github.com/jinossy/tajo TAJO-2013 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tajo/pull/904.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #904 commit ba31828bff1113081c11f58d43ed153b45a18719 Author: Jinho Kim <jhkim@apache.org> Date: 2015-12-08T07:39:35Z TAJO-2013 : FilterPushDownRule fails due to the unsupported index.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user blrunner commented on the pull request:

        https://github.com/apache/tajo/pull/904#issuecomment-163490042

        +1

        Thank you for your contribution.
        I found that ```UnsupportedOperationException``` doesn't appear after using this patch on HiveCatalogStore.

        Show
        githubbot ASF GitHub Bot added a comment - Github user blrunner commented on the pull request: https://github.com/apache/tajo/pull/904#issuecomment-163490042 +1 Thank you for your contribution. I found that ```UnsupportedOperationException``` doesn't appear after using this patch on HiveCatalogStore.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user asfgit closed the pull request at:

        https://github.com/apache/tajo/pull/904

        Show
        githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/tajo/pull/904
        Hide
        jhkim Jinho Kim added a comment -

        committed it.
        Thanks for your review!

        Show
        jhkim Jinho Kim added a comment - committed it. Thanks for your review!
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-master-CODEGEN-build #626 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/626/)
        TAJO-2013: FilterPushDownRule fails due to the unsupported index. (jhkim: rev 3d59eebd57c3af9809a7ea9199472925904ecc1c)

        • CHANGES
        • tajo-plan/src/main/java/org/apache/tajo/plan/rewrite/rules/FilterPushDownRule.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-master-CODEGEN-build #626 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/626/ ) TAJO-2013 : FilterPushDownRule fails due to the unsupported index. (jhkim: rev 3d59eebd57c3af9809a7ea9199472925904ecc1c) CHANGES tajo-plan/src/main/java/org/apache/tajo/plan/rewrite/rules/FilterPushDownRule.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #1022 (See https://builds.apache.org/job/Tajo-master-build/1022/)
        TAJO-2013: FilterPushDownRule fails due to the unsupported index. (jhkim: rev 3d59eebd57c3af9809a7ea9199472925904ecc1c)

        • CHANGES
        • tajo-plan/src/main/java/org/apache/tajo/plan/rewrite/rules/FilterPushDownRule.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #1022 (See https://builds.apache.org/job/Tajo-master-build/1022/ ) TAJO-2013 : FilterPushDownRule fails due to the unsupported index. (jhkim: rev 3d59eebd57c3af9809a7ea9199472925904ecc1c) CHANGES tajo-plan/src/main/java/org/apache/tajo/plan/rewrite/rules/FilterPushDownRule.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-0.11.1-build #135 (See https://builds.apache.org/job/Tajo-0.11.1-build/135/)
        TAJO-2013: FilterPushDownRule fails due to the unsupported index. (jhkim: rev 04d6d8e8057d462223ab162c9c50b73506f40dae)

        • CHANGES
        • tajo-plan/src/main/java/org/apache/tajo/plan/rewrite/rules/FilterPushDownRule.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-0.11.1-build #135 (See https://builds.apache.org/job/Tajo-0.11.1-build/135/ ) TAJO-2013 : FilterPushDownRule fails due to the unsupported index. (jhkim: rev 04d6d8e8057d462223ab162c9c50b73506f40dae) CHANGES tajo-plan/src/main/java/org/apache/tajo/plan/rewrite/rules/FilterPushDownRule.java
        Hide
        githubbot ASF GitHub Bot added a comment -

        GitHub user blrunner opened a pull request:

        https://github.com/apache/tajo/pull/987

        TAJO-2013: JdbcMetadataProviderBase need to differentiate between database name in DBMS and database name in Tajo.

        <img width="1351" alt="review_button" src="https://cloud.githubusercontent.com/assets/3724310/14071280/a3444fa4-f4ed-11e5-8336-940f30835c7e.png">

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/blrunner/tajo jdbc-mapped-database

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/tajo/pull/987.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #987


        commit 5d8bfcc1bedc0de0dff82aa22784ca5286cb4662
        Author: JaeHwa Jung <blrunner@apache.org>
        Date: 2016-03-28T04:31:41Z

        Add mappedDatabaseName to JdbcMetadataProviderBase


        Show
        githubbot ASF GitHub Bot added a comment - GitHub user blrunner opened a pull request: https://github.com/apache/tajo/pull/987 TAJO-2013 : JdbcMetadataProviderBase need to differentiate between database name in DBMS and database name in Tajo. <img width="1351" alt="review_button" src="https://cloud.githubusercontent.com/assets/3724310/14071280/a3444fa4-f4ed-11e5-8336-940f30835c7e.png"> You can merge this pull request into a Git repository by running: $ git pull https://github.com/blrunner/tajo jdbc-mapped-database Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tajo/pull/987.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #987 commit 5d8bfcc1bedc0de0dff82aa22784ca5286cb4662 Author: JaeHwa Jung <blrunner@apache.org> Date: 2016-03-28T04:31:41Z Add mappedDatabaseName to JdbcMetadataProviderBase
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user blrunner commented on the pull request:

        https://github.com/apache/tajo/pull/987#issuecomment-203270325

        Mismatched issue number.

        Show
        githubbot ASF GitHub Bot added a comment - Github user blrunner commented on the pull request: https://github.com/apache/tajo/pull/987#issuecomment-203270325 Mismatched issue number.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user blrunner closed the pull request at:

        https://github.com/apache/tajo/pull/987

        Show
        githubbot ASF GitHub Bot added a comment - Github user blrunner closed the pull request at: https://github.com/apache/tajo/pull/987

          People

          • Assignee:
            jhkim Jinho Kim
            Reporter:
            jhkim Jinho Kim
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development