Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.8.0
    • Component/s: Catalog
    • Labels:
      None

      Description

      If we write partitioned columns at where clause on tsql, tajo print a error message as follows:

      tajo> select * from table1 where id = 1;
      ERROR: no such a column name default
      

      For reference, hive table schema is as the following:

      CREATE  TABLE table1(
        id int, 
        name string, 
        score float, 
        type string); 
      

      It occurred on both managed tables and partitioned tables.

      1. TAJO-558.patch
        4 kB
        Jaehwa Jung

        Activity

        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #40 (See https://builds.apache.org/job/Tajo-master-build/40/)
        TAJO-558: HCatalogStore can't scan columns. (adding missed file) (jhjung: https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=32775bb5e4ca6877cb8fe4452552d44efc56b03e)

        • tajo-catalog/tajo-catalog-drivers/tajo-hcatalog/src/test/java/org/apache/tajo/catalog/store/TestHCatalogStore.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #40 (See https://builds.apache.org/job/Tajo-master-build/40/ ) TAJO-558 : HCatalogStore can't scan columns. (adding missed file) (jhjung: https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=32775bb5e4ca6877cb8fe4452552d44efc56b03e ) tajo-catalog/tajo-catalog-drivers/tajo-hcatalog/src/test/java/org/apache/tajo/catalog/store/TestHCatalogStore.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #36 (See https://builds.apache.org/job/Tajo-master-build/36/)
        TAJO-558: HCatalogStore can't scan columns. (jaehwa) (jhjung: https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=2046c0b62f3fc1e3f0dfd82927d3ffd9c25d5b27)

        • tajo-catalog/tajo-catalog-drivers/tajo-hcatalog/src/main/java/org/apache/tajo/catalog/store/HCatalogStore.java
        • tajo-algebra/src/main/java/org/apache/tajo/algebra/ColumnReferenceExpr.java
        • tajo-catalog/tajo-catalog-common/src/main/java/org/apache/tajo/catalog/Schema.java
        • CHANGES.txt
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #36 (See https://builds.apache.org/job/Tajo-master-build/36/ ) TAJO-558 : HCatalogStore can't scan columns. (jaehwa) (jhjung: https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=2046c0b62f3fc1e3f0dfd82927d3ffd9c25d5b27 ) tajo-catalog/tajo-catalog-drivers/tajo-hcatalog/src/main/java/org/apache/tajo/catalog/store/HCatalogStore.java tajo-algebra/src/main/java/org/apache/tajo/algebra/ColumnReferenceExpr.java tajo-catalog/tajo-catalog-common/src/main/java/org/apache/tajo/catalog/Schema.java CHANGES.txt
        Hide
        blrunner Jaehwa Jung added a comment -

        Thanks Hyunsik Choi.
        I just committed it to master branch.

        Show
        blrunner Jaehwa Jung added a comment - Thanks Hyunsik Choi . I just committed it to master branch.
        Hide
        blrunner Jaehwa Jung added a comment - - edited

        For reference, tajo didn't recognize it beforehand because there was no test cases which were working under similar conditions. So, I'm going to add test cases to verify physical operators based on HCatalogStore.

        Show
        blrunner Jaehwa Jung added a comment - - edited For reference, tajo didn't recognize it beforehand because there was no test cases which were working under similar conditions. So, I'm going to add test cases to verify physical operators based on HCatalogStore.
        Hide
        blrunner Jaehwa Jung added a comment - - edited

        I created a new RB https://reviews.apache.org/r/17453/.

        Refactoring LogicalPlanner made this error, and I found that column qualifier just support pair of table name and column name. But if users use HCatalogStore, they can use different databases which stored on same HiveMetaStore. As a result, database name and table name and column name can be used at one column phase. So, I updated ColumnReferenceExpr and Schema to use database name.

        You can verify it as follows:

        mvn clean install -Phcatalog-0.11.0
        mvn clean install -Phcatalog-0.12.0
        

        I already verified it on my local cluster.
        Please review it.

        Show
        blrunner Jaehwa Jung added a comment - - edited I created a new RB https://reviews.apache.org/r/17453/ . Refactoring LogicalPlanner made this error, and I found that column qualifier just support pair of table name and column name. But if users use HCatalogStore, they can use different databases which stored on same HiveMetaStore. As a result, database name and table name and column name can be used at one column phase. So, I updated ColumnReferenceExpr and Schema to use database name. You can verify it as follows: mvn clean install -Phcatalog-0.11.0 mvn clean install -Phcatalog-0.12.0 I already verified it on my local cluster. Please review it.

          People

          • Assignee:
            blrunner Jaehwa Jung
            Reporter:
            blrunner Jaehwa Jung
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development