Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-1307

HBaseStorageManager need to support for users to use hbase-site.xml file.

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.10.0
    • Component/s: Storage
    • Labels:
      None

      Description

      Currently, tajo provides hbase storage integration and you can create a hbase table as follows:

      CREATE  TABLE blog (rowkey text, author text, register_date text, title text)
      USING hbase WITH (
        'table'='blog_backup'
        , 'columns'=':key,info:author,info:date,content:title'
        ,'hbase.zookeeper.quorum'='localhost');
      

      But if you don't use the zookeeper property, you will find an error as follows:

      CREATE  TABLE blog (rowkey text, author text, register_date text, title text)
      USING hbase WITH (
        'table'='blog_backup'
        , 'columns'=':key,info:author,info:date,content:title');
      
      java.io.IOException: HBase mapped table is required a 'hbase.zookeeper.quorum' attribute.
              at org.apache.tajo.storage.hbase.HBaseStorageManager.getHBaseConfiguration(HBaseStorageManager.java:304)
      

      Currently, HBaseStorageManager just refer table meta properties and it will be very useful to use multiple hbase cluster. But if users with small hbase cluster may be uncomfortable to above configuration. Thus we need to support for users to create a hbase table without the tajo zookeeper property.

      For example, if users doesn't set the zookeeper property with create statement, tajo should refer hbase-site.xml. And if users set the zookeeper property with the create statement, tajo should use the property.

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Tajo-master-build #558 (See https://builds.apache.org/job/Tajo-master-build/558/)
          TAJO-1307: HBaseStorageManager need to support for users to use hbase-site.xml file. (jaehwa) (blrunner: rev 6f07cefd224c8da420ec7ec37974917993a05fc5)

          • tajo-dist/src/main/conf/tajo-env.sh
          • CHANGES
          • tajo-storage/tajo-storage-hbase/src/main/java/org/apache/tajo/storage/hbase/HBaseStorageManager.java
          • tajo-dist/src/main/bin/tajo
          • tajo-core/src/test/java/org/apache/tajo/engine/query/TestHBaseTable.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #558 (See https://builds.apache.org/job/Tajo-master-build/558/ ) TAJO-1307 : HBaseStorageManager need to support for users to use hbase-site.xml file. (jaehwa) (blrunner: rev 6f07cefd224c8da420ec7ec37974917993a05fc5) tajo-dist/src/main/conf/tajo-env.sh CHANGES tajo-storage/tajo-storage-hbase/src/main/java/org/apache/tajo/storage/hbase/HBaseStorageManager.java tajo-dist/src/main/bin/tajo tajo-core/src/test/java/org/apache/tajo/engine/query/TestHBaseTable.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Tajo-master-CODEGEN-build #197 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/197/)
          TAJO-1307: HBaseStorageManager need to support for users to use hbase-site.xml file. (jaehwa) (blrunner: rev 6f07cefd224c8da420ec7ec37974917993a05fc5)

          • CHANGES
          • tajo-dist/src/main/bin/tajo
          • tajo-dist/src/main/conf/tajo-env.sh
          • tajo-core/src/test/java/org/apache/tajo/engine/query/TestHBaseTable.java
          • tajo-storage/tajo-storage-hbase/src/main/java/org/apache/tajo/storage/hbase/HBaseStorageManager.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Tajo-master-CODEGEN-build #197 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/197/ ) TAJO-1307 : HBaseStorageManager need to support for users to use hbase-site.xml file. (jaehwa) (blrunner: rev 6f07cefd224c8da420ec7ec37974917993a05fc5) CHANGES tajo-dist/src/main/bin/tajo tajo-dist/src/main/conf/tajo-env.sh tajo-core/src/test/java/org/apache/tajo/engine/query/TestHBaseTable.java tajo-storage/tajo-storage-hbase/src/main/java/org/apache/tajo/storage/hbase/HBaseStorageManager.java
          Hide
          blrunner Jaehwa Jung added a comment -

          Thanks Jihoon Son

          I've just committed the patch to the master branch.

          Show
          blrunner Jaehwa Jung added a comment - Thanks Jihoon Son I've just committed the patch to the master branch.
          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user blrunner opened a pull request:

          https://github.com/apache/tajo/pull/350

          TAJO-1307: HBaseStorageManager need to support for users to use hbase-site.xml file.

          The patch ran successfully on my testing cluster.

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/blrunner/tajo TAJO-1307

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/tajo/pull/350.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #350


          commit c8f685db175ab2cdfde6d98cde535f085c11c41e
          Author: JaeHwa Jung <blrunner@apache.org>
          Date: 2015-01-14T09:26:46Z

          TAJO-1307: HBaseStorageManager need to support for users to use hbase-site.xml file.


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user blrunner opened a pull request: https://github.com/apache/tajo/pull/350 TAJO-1307 : HBaseStorageManager need to support for users to use hbase-site.xml file. The patch ran successfully on my testing cluster. You can merge this pull request into a Git repository by running: $ git pull https://github.com/blrunner/tajo TAJO-1307 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tajo/pull/350.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #350 commit c8f685db175ab2cdfde6d98cde535f085c11c41e Author: JaeHwa Jung <blrunner@apache.org> Date: 2015-01-14T09:26:46Z TAJO-1307 : HBaseStorageManager need to support for users to use hbase-site.xml file.

            People

            • Assignee:
              blrunner Jaehwa Jung
              Reporter:
              blrunner Jaehwa Jung
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development