Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.12.0, 0.11.1
    • Component/s: Documentation
    • Labels:
      None

      Description

      See the title.

        Activity

        Hide
        hyunsik Hyunsik Choi added a comment -
        Show
        hyunsik Hyunsik Choi added a comment - This page contains basic information. http://tajo.apache.org/docs/devel/table_management/tablespaces.html
        Hide
        jihoonson Jihoon Son added a comment -

        Yes, but I'm concerned with that users may be difficult to find if any description is not provided at the configuration page.

        Show
        jihoonson Jihoon Son added a comment - Yes, but I'm concerned with that users may be difficult to find if any description is not provided at the configuration page.
        Hide
        hyunsik Hyunsik Choi added a comment -

        The documentation work can be finish after release. So, I reschedule it to 0.11.1.

        Show
        hyunsik Hyunsik Choi added a comment - The documentation work can be finish after release. So, I reschedule it to 0.11.1.
        Hide
        githubbot ASF GitHub Bot added a comment -

        GitHub user eminency opened a pull request:

        https://github.com/apache/tajo/pull/873

        TAJO-1855: Add document for tablespace configuration to the Configuration chapter.

        @hyunsik , @jihoonson
        I added a document describing tablespace feature -exactly speaking, for storage-site.json.
        Please review that.

        Thanks.

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/eminency/tajo TAJO-1855

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/tajo/pull/873.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #873


        commit 7dde36edfa5f25bba14ea5694e7d84da51bcf564
        Author: Jongyoung Park <eminency@gmail.com>
        Date: 2015-11-24T05:41:34Z

        Don't use dash

        commit 559ab3e44ca6f5f71aef11c5128fbcbd33906ce8
        Author: Jongyoung Park <eminency@gmail.com>
        Date: 2015-11-24T06:01:03Z

        storage-site.json document is added

        commit 715f19fb9f5bf918107f662001fe66045539be6a
        Author: Jongyoung Park <eminency@gmail.com>
        Date: 2015-11-24T06:05:18Z

        Refined

        commit d50ec1e69b970ef00d71d1d0c77c73d4250f49ac
        Author: Jongyoung Park <eminency@gmail.com>
        Date: 2015-11-24T06:06:08Z

        refined more


        Show
        githubbot ASF GitHub Bot added a comment - GitHub user eminency opened a pull request: https://github.com/apache/tajo/pull/873 TAJO-1855 : Add document for tablespace configuration to the Configuration chapter. @hyunsik , @jihoonson I added a document describing tablespace feature -exactly speaking, for storage-site.json. Please review that. Thanks. You can merge this pull request into a Git repository by running: $ git pull https://github.com/eminency/tajo TAJO-1855 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tajo/pull/873.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #873 commit 7dde36edfa5f25bba14ea5694e7d84da51bcf564 Author: Jongyoung Park <eminency@gmail.com> Date: 2015-11-24T05:41:34Z Don't use dash commit 559ab3e44ca6f5f71aef11c5128fbcbd33906ce8 Author: Jongyoung Park <eminency@gmail.com> Date: 2015-11-24T06:01:03Z storage-site.json document is added commit 715f19fb9f5bf918107f662001fe66045539be6a Author: Jongyoung Park <eminency@gmail.com> Date: 2015-11-24T06:05:18Z Refined commit d50ec1e69b970ef00d71d1d0c77c73d4250f49ac Author: Jongyoung Park <eminency@gmail.com> Date: 2015-11-24T06:06:08Z refined more
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user hyunsik commented on a diff in the pull request:

        https://github.com/apache/tajo/pull/873#discussion_r45934286

        — Diff: tajo-docs/src/main/sphinx/configuration/storage-site-json.rst —
        @@ -0,0 +1,57 @@
        +**************************
        +The storage-site.json File
        +**************************
        +
        +This file is for configuring :doc:`table spaces</table_management/tablespaces>`.
        +The syntax of ``storage-site.json`` is like this basically:
        +
        +.. code:: json
        +
        + {
        + "spaces":

        { + <space config 1>, <space config 2>, ... + }

        ,
        + "storages":

        { + <storage config 1>, <storage config 2>, ... + }

        + }
        +
        +------
        +Spaces
        +------
        +
        +This is a section for registering table spaces. Some space config example is here:
        +
        +.. code:: json
        +
        + "spaces": {
        + "hbase_cluster1": {
        + "uri": "hbase://quorum1:port,quorum2:port/",
        + "config":

        { ... }

        + },
        + ...
        + }
        +
        +* *space name* : Your own table space name which indicates a specific table space. Alpha-numeric characters and underscore(_) are permitted.
        +* *uri* : An URI address of a table space
        +* *config* : It is optional. You can specify it as JSON object to pass to each table space handler.
        — End diff –

        It should be ``configs`` instead of ``config``.

        Show
        githubbot ASF GitHub Bot added a comment - Github user hyunsik commented on a diff in the pull request: https://github.com/apache/tajo/pull/873#discussion_r45934286 — Diff: tajo-docs/src/main/sphinx/configuration/storage-site-json.rst — @@ -0,0 +1,57 @@ +************************** +The storage-site.json File +************************** + +This file is for configuring :doc:`table spaces</table_management/tablespaces>`. +The syntax of ``storage-site.json`` is like this basically: + +.. code:: json + + { + "spaces": { + <space config 1>, <space config 2>, ... + } , + "storages": { + <storage config 1>, <storage config 2>, ... + } + } + +------ +Spaces +------ + +This is a section for registering table spaces. Some space config example is here: + +.. code:: json + + "spaces": { + "hbase_cluster1": { + "uri": "hbase://quorum1:port,quorum2:port/", + "config": { ... } + }, + ... + } + +* * space name * : Your own table space name which indicates a specific table space. Alpha-numeric characters and underscore(_) are permitted. +* * uri * : An URI address of a table space +* * config * : It is optional. You can specify it as JSON object to pass to each table space handler. — End diff – It should be ``configs`` instead of ``config``.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user hyunsik commented on a diff in the pull request:

        https://github.com/apache/tajo/pull/873#discussion_r45934293

        — Diff: tajo-docs/src/main/sphinx/configuration/storage-site-json.rst —
        @@ -0,0 +1,57 @@
        +**************************
        +The storage-site.json File
        +**************************
        +
        +This file is for configuring :doc:`table spaces</table_management/tablespaces>`.
        +The syntax of ``storage-site.json`` is like this basically:
        +
        +.. code:: json
        +
        + {
        + "spaces":

        { + <space config 1>, <space config 2>, ... + }

        ,
        + "storages":

        { + <storage config 1>, <storage config 2>, ... + }

        + }
        +
        +------
        +Spaces
        +------
        +
        +This is a section for registering table spaces. Some space config example is here:
        +
        +.. code:: json
        +
        + "spaces": {
        + "hbase_cluster1": {
        + "uri": "hbase://quorum1:port,quorum2:port/",
        + "config":

        { ... }

        — End diff –

        It should be ``configs`` instead of ``config``.

        Show
        githubbot ASF GitHub Bot added a comment - Github user hyunsik commented on a diff in the pull request: https://github.com/apache/tajo/pull/873#discussion_r45934293 — Diff: tajo-docs/src/main/sphinx/configuration/storage-site-json.rst — @@ -0,0 +1,57 @@ +************************** +The storage-site.json File +************************** + +This file is for configuring :doc:`table spaces</table_management/tablespaces>`. +The syntax of ``storage-site.json`` is like this basically: + +.. code:: json + + { + "spaces": { + <space config 1>, <space config 2>, ... + } , + "storages": { + <storage config 1>, <storage config 2>, ... + } + } + +------ +Spaces +------ + +This is a section for registering table spaces. Some space config example is here: + +.. code:: json + + "spaces": { + "hbase_cluster1": { + "uri": "hbase://quorum1:port,quorum2:port/", + "config": { ... } — End diff – It should be ``configs`` instead of ``config``.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user hyunsik commented on a diff in the pull request:

        https://github.com/apache/tajo/pull/873#discussion_r45934407

        — Diff: tajo-docs/src/main/sphinx/configuration/storage-site-json.rst —
        @@ -0,0 +1,57 @@
        +**************************
        +The storage-site.json File
        +**************************
        +
        +This file is for configuring :doc:`table spaces</table_management/tablespaces>`.
        +The syntax of ``storage-site.json`` is like this basically:
        +
        +.. code:: json
        +
        + {
        + "spaces":

        { + <space config 1>, <space config 2>, ... + }

        ,
        + "storages":

        { + <storage config 1>, <storage config 2>, ... + }

        + }
        +
        +------
        +Spaces
        +------
        +
        +This is a section for registering table spaces. Some space config example is here:
        +
        +.. code:: json
        +
        + "spaces": {
        + "hbase_cluster1": {
        + "uri": "hbase://quorum1:port,quorum2:port/",
        + "config":

        { ... }

        — End diff –

        It would be great if we give some examples to set multiple config key-value pairs.

        Show
        githubbot ASF GitHub Bot added a comment - Github user hyunsik commented on a diff in the pull request: https://github.com/apache/tajo/pull/873#discussion_r45934407 — Diff: tajo-docs/src/main/sphinx/configuration/storage-site-json.rst — @@ -0,0 +1,57 @@ +************************** +The storage-site.json File +************************** + +This file is for configuring :doc:`table spaces</table_management/tablespaces>`. +The syntax of ``storage-site.json`` is like this basically: + +.. code:: json + + { + "spaces": { + <space config 1>, <space config 2>, ... + } , + "storages": { + <storage config 1>, <storage config 2>, ... + } + } + +------ +Spaces +------ + +This is a section for registering table spaces. Some space config example is here: + +.. code:: json + + "spaces": { + "hbase_cluster1": { + "uri": "hbase://quorum1:port,quorum2:port/", + "config": { ... } — End diff – It would be great if we give some examples to set multiple config key-value pairs.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user hyunsik commented on the pull request:

        https://github.com/apache/tajo/pull/873#issuecomment-159766366

        Even though, we need more description for them, the current patch looks good to me. Later, we can improve it. I leaved some comments. Please correct them.

        Show
        githubbot ASF GitHub Bot added a comment - Github user hyunsik commented on the pull request: https://github.com/apache/tajo/pull/873#issuecomment-159766366 Even though, we need more description for them, the current patch looks good to me. Later, we can improve it. I leaved some comments. Please correct them.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user jihoonson commented on a diff in the pull request:

        https://github.com/apache/tajo/pull/873#discussion_r45935196

        — Diff: tajo-docs/src/main/sphinx/table_management/tablespaces.rst —
        @@ -39,6 +42,8 @@ The following is an example for two tablespaces for hbase and hdfs:
        }
        }

        +For more tails, see :doc:`conf/storage-site.json</configuration/storage-site-json>`.
        — End diff –

        ```tails``` -> ```details```

        Show
        githubbot ASF GitHub Bot added a comment - Github user jihoonson commented on a diff in the pull request: https://github.com/apache/tajo/pull/873#discussion_r45935196 — Diff: tajo-docs/src/main/sphinx/table_management/tablespaces.rst — @@ -39,6 +42,8 @@ The following is an example for two tablespaces for hbase and hdfs: } } +For more tails, see :doc:`conf/storage-site.json</configuration/storage-site-json>`. — End diff – ```tails``` -> ```details```
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user jihoonson commented on a diff in the pull request:

        https://github.com/apache/tajo/pull/873#discussion_r45935367

        — Diff: tajo-docs/src/main/sphinx/configuration/storage-site-json.rst —
        @@ -0,0 +1,57 @@
        +**************************
        +The storage-site.json File
        +**************************
        +
        +This file is for configuring :doc:`table spaces</table_management/tablespaces>`.
        +The syntax of ``storage-site.json`` is like this basically:
        +
        +.. code:: json
        +
        + {
        + "spaces":

        { + <space config 1>, <space config 2>, ... + }

        ,
        + "storages":

        { + <storage config 1>, <storage config 2>, ... + }

        + }
        +
        +------
        +Spaces
        +------
        +
        +This is a section for registering table spaces. Some space config example is here:
        — End diff –

        tablespace is a single word.

        Show
        githubbot ASF GitHub Bot added a comment - Github user jihoonson commented on a diff in the pull request: https://github.com/apache/tajo/pull/873#discussion_r45935367 — Diff: tajo-docs/src/main/sphinx/configuration/storage-site-json.rst — @@ -0,0 +1,57 @@ +************************** +The storage-site.json File +************************** + +This file is for configuring :doc:`table spaces</table_management/tablespaces>`. +The syntax of ``storage-site.json`` is like this basically: + +.. code:: json + + { + "spaces": { + <space config 1>, <space config 2>, ... + } , + "storages": { + <storage config 1>, <storage config 2>, ... + } + } + +------ +Spaces +------ + +This is a section for registering table spaces. Some space config example is here: — End diff – tablespace is a single word.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user eminency commented on the pull request:

        https://github.com/apache/tajo/pull/873#issuecomment-159792025

        Comments are applied.

        Show
        githubbot ASF GitHub Bot added a comment - Github user eminency commented on the pull request: https://github.com/apache/tajo/pull/873#issuecomment-159792025 Comments are applied.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user jihoonson commented on a diff in the pull request:

        https://github.com/apache/tajo/pull/873#discussion_r46116563

        — Diff: tajo-docs/src/main/sphinx/configuration/storage-site-json.rst —
        @@ -0,0 +1,63 @@
        +**************************
        +The storage-site.json File
        +**************************
        +
        +This file is for configuring :doc:`/table_management/tablespaces`.
        +The syntax of ``storage-site.json`` is like this basically:
        +
        +.. code:: json
        +
        + {
        + "spaces":

        { + <space config 1>, <space config 2>, ... + }

        ,
        + "storages":

        { + <storage config 1>, <storage config 2>, ... + }

        + }
        +
        +------
        +Spaces
        +------
        +
        +This is a section for registering tablespaces. Some space config example is here:
        +
        +.. code:: json
        +
        + "spaces": {
        + "jdbc_pgsql": {
        + "uri": "jdbc:postgresql://127.0.0.1:5740/origin",
        + "configs": {
        + "mapped_database":"tajo_pgsql_origin",
        + "connection_properties":

        { + "user":"tajouser", + "password":"123456" + }

        + }
        + },
        + ...
        + }
        +
        +* *space name* : Your own tablespace name which indicates a specific tablespace. Alpha-numeric characters and underscore(_) are permitted.
        +* *uri* : An URI address of a tablespace
        +* *configs* : It is optional. You can specify it as JSON object to pass to each tablespace handler.
        +
        +After you specify a tablespace, you can use it in `create table statement <../sql_language/ddl.html#create-table>`_.
        +
        +--------
        +Storages
        +--------
        +
        +This is for registering storage format and custom storage handler class.
        +Tajo already supports HDFS, HBase, PostgreSQL, Amazon S3, Openstack Swift, etc, thus in usual cases using mentioned storages, you don't have to use ``storages`` configuration.
        — End diff –

        I suggest ```you don't have to add any ``storages`` configuration.```

        Show
        githubbot ASF GitHub Bot added a comment - Github user jihoonson commented on a diff in the pull request: https://github.com/apache/tajo/pull/873#discussion_r46116563 — Diff: tajo-docs/src/main/sphinx/configuration/storage-site-json.rst — @@ -0,0 +1,63 @@ +************************** +The storage-site.json File +************************** + +This file is for configuring :doc:`/table_management/tablespaces`. +The syntax of ``storage-site.json`` is like this basically: + +.. code:: json + + { + "spaces": { + <space config 1>, <space config 2>, ... + } , + "storages": { + <storage config 1>, <storage config 2>, ... + } + } + +------ +Spaces +------ + +This is a section for registering tablespaces. Some space config example is here: + +.. code:: json + + "spaces": { + "jdbc_pgsql": { + "uri": "jdbc:postgresql://127.0.0.1:5740/origin", + "configs": { + "mapped_database":"tajo_pgsql_origin", + "connection_properties": { + "user":"tajouser", + "password":"123456" + } + } + }, + ... + } + +* * space name * : Your own tablespace name which indicates a specific tablespace. Alpha-numeric characters and underscore(_) are permitted. +* * uri * : An URI address of a tablespace +* * configs * : It is optional. You can specify it as JSON object to pass to each tablespace handler. + +After you specify a tablespace, you can use it in `create table statement <../sql_language/ddl.html#create-table>`_. + +-------- +Storages +-------- + +This is for registering storage format and custom storage handler class. +Tajo already supports HDFS, HBase, PostgreSQL, Amazon S3, Openstack Swift, etc, thus in usual cases using mentioned storages, you don't have to use ``storages`` configuration. — End diff – I suggest ```you don't have to add any ``storages`` configuration.```
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user jihoonson commented on a diff in the pull request:

        https://github.com/apache/tajo/pull/873#discussion_r46116760

        — Diff: tajo-docs/src/main/sphinx/configuration/storage-site-json.rst —
        @@ -0,0 +1,63 @@
        +**************************
        +The storage-site.json File
        +**************************
        +
        +This file is for configuring :doc:`/table_management/tablespaces`.
        +The syntax of ``storage-site.json`` is like this basically:
        +
        +.. code:: json
        +
        + {
        + "spaces":

        { + <space config 1>, <space config 2>, ... + }

        ,
        + "storages":

        { + <storage config 1>, <storage config 2>, ... + }

        + }
        +
        +------
        +Spaces
        +------
        +
        +This is a section for registering tablespaces. Some space config example is here:
        +
        +.. code:: json
        +
        + "spaces": {
        + "jdbc_pgsql": {
        + "uri": "jdbc:postgresql://127.0.0.1:5740/origin",
        + "configs": {
        + "mapped_database":"tajo_pgsql_origin",
        + "connection_properties":

        { + "user":"tajouser", + "password":"123456" + }

        + }
        + },
        + ...
        + }
        +
        +* *space name* : Your own tablespace name which indicates a specific tablespace. Alpha-numeric characters and underscore(_) are permitted.
        +* *uri* : An URI address of a tablespace
        +* *configs* : It is optional. You can specify it as JSON object to pass to each tablespace handler.
        +
        +After you specify a tablespace, you can use it in `create table statement <../sql_language/ddl.html#create-table>`_.
        +
        +--------
        +Storages
        +--------
        +
        +This is for registering storage format and custom storage handler class.
        +Tajo already supports HDFS, HBase, PostgreSQL, Amazon S3, Openstack Swift, etc, thus in usual cases using mentioned storages, you don't have to use ``storages`` configuration.
        +Anyway for your knowledge, here is one storage conf example(it's quoted from Tajo internal hdfs storage configuration which is already being used).
        — End diff –

        I suggest ```However, if you want to use your custom storage as one of Tajo's data source, you need to add a configuration for your storage. Here is an example of HDFS storage. Please see `:doc:storage_plugins/overview` for more information```

        Show
        githubbot ASF GitHub Bot added a comment - Github user jihoonson commented on a diff in the pull request: https://github.com/apache/tajo/pull/873#discussion_r46116760 — Diff: tajo-docs/src/main/sphinx/configuration/storage-site-json.rst — @@ -0,0 +1,63 @@ +************************** +The storage-site.json File +************************** + +This file is for configuring :doc:`/table_management/tablespaces`. +The syntax of ``storage-site.json`` is like this basically: + +.. code:: json + + { + "spaces": { + <space config 1>, <space config 2>, ... + } , + "storages": { + <storage config 1>, <storage config 2>, ... + } + } + +------ +Spaces +------ + +This is a section for registering tablespaces. Some space config example is here: + +.. code:: json + + "spaces": { + "jdbc_pgsql": { + "uri": "jdbc:postgresql://127.0.0.1:5740/origin", + "configs": { + "mapped_database":"tajo_pgsql_origin", + "connection_properties": { + "user":"tajouser", + "password":"123456" + } + } + }, + ... + } + +* * space name * : Your own tablespace name which indicates a specific tablespace. Alpha-numeric characters and underscore(_) are permitted. +* * uri * : An URI address of a tablespace +* * configs * : It is optional. You can specify it as JSON object to pass to each tablespace handler. + +After you specify a tablespace, you can use it in `create table statement <../sql_language/ddl.html#create-table>`_. + +-------- +Storages +-------- + +This is for registering storage format and custom storage handler class. +Tajo already supports HDFS, HBase, PostgreSQL, Amazon S3, Openstack Swift, etc, thus in usual cases using mentioned storages, you don't have to use ``storages`` configuration. +Anyway for your knowledge, here is one storage conf example(it's quoted from Tajo internal hdfs storage configuration which is already being used). — End diff – I suggest ```However, if you want to use your custom storage as one of Tajo's data source, you need to add a configuration for your storage. Here is an example of HDFS storage. Please see `:doc:storage_plugins/overview` for more information```
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user eminency commented on the pull request:

        https://github.com/apache/tajo/pull/873#issuecomment-160833947

        Good advices.
        Comments are applied, @jihoonson

        Show
        githubbot ASF GitHub Bot added a comment - Github user eminency commented on the pull request: https://github.com/apache/tajo/pull/873#issuecomment-160833947 Good advices. Comments are applied, @jihoonson
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user jihoonson commented on a diff in the pull request:

        https://github.com/apache/tajo/pull/873#discussion_r46236537

        — Diff: tajo-docs/src/main/sphinx/configuration/storage-site-json.rst —
        @@ -0,0 +1,64 @@
        +**************************
        +The storage-site.json File
        +**************************
        +
        +This file is for configuring :doc:`/table_management/tablespaces`.
        +The syntax of ``storage-site.json`` is like this basically:
        +
        +.. code:: json
        +
        + {
        + "spaces":

        { + <space config 1>, <space config 2>, ... + }

        ,
        + "storages":

        { + <storage config 1>, <storage config 2>, ... + }

        + }
        +
        +------
        +Spaces
        +------
        +
        +This is a section for registering tablespaces. Some space config example is here:
        +
        +.. code:: json
        +
        + "spaces": {
        + "jdbc_pgsql": {
        + "uri": "jdbc:postgresql://127.0.0.1:5740/origin",
        + "configs": {
        + "mapped_database":"tajo_pgsql_origin",
        + "connection_properties":

        { + "user":"tajouser", + "password":"123456" + }

        + }
        + },
        + ...
        + }
        +
        +* *space name* : Your own tablespace name which indicates a specific tablespace. Alpha-numeric characters and underscore(_) are permitted.
        +* *uri* : An URI address of a tablespace
        +* *configs* : It is optional. You can specify it as JSON object to pass to each tablespace handler.
        +
        +After you specify a tablespace, you can use it in `create table statement <../sql_language/ddl.html#create-table>`_.
        +
        +--------
        +Storages
        +--------
        +
        +This is for registering storage format and custom storage handler class.
        +Tajo already supports HDFS, HBase, PostgreSQL, Amazon S3, Openstack Swift, etc, thus in usual cases using mentioned storages, you don't have to add any ``storages`` configuration.
        +However, if you want to use your custom storage as one of Tajo's data source, you need to add a configuration for your storage. Here is an example of HDFS storage.
        +See `:doc:storage_plugins/overview` for more information.
        — End diff –

        This is my mistake. Please fix to ```:doc:`storage_plugins/overview` ```

        Show
        githubbot ASF GitHub Bot added a comment - Github user jihoonson commented on a diff in the pull request: https://github.com/apache/tajo/pull/873#discussion_r46236537 — Diff: tajo-docs/src/main/sphinx/configuration/storage-site-json.rst — @@ -0,0 +1,64 @@ +************************** +The storage-site.json File +************************** + +This file is for configuring :doc:`/table_management/tablespaces`. +The syntax of ``storage-site.json`` is like this basically: + +.. code:: json + + { + "spaces": { + <space config 1>, <space config 2>, ... + } , + "storages": { + <storage config 1>, <storage config 2>, ... + } + } + +------ +Spaces +------ + +This is a section for registering tablespaces. Some space config example is here: + +.. code:: json + + "spaces": { + "jdbc_pgsql": { + "uri": "jdbc:postgresql://127.0.0.1:5740/origin", + "configs": { + "mapped_database":"tajo_pgsql_origin", + "connection_properties": { + "user":"tajouser", + "password":"123456" + } + } + }, + ... + } + +* * space name * : Your own tablespace name which indicates a specific tablespace. Alpha-numeric characters and underscore(_) are permitted. +* * uri * : An URI address of a tablespace +* * configs * : It is optional. You can specify it as JSON object to pass to each tablespace handler. + +After you specify a tablespace, you can use it in `create table statement <../sql_language/ddl.html#create-table>`_. + +-------- +Storages +-------- + +This is for registering storage format and custom storage handler class. +Tajo already supports HDFS, HBase, PostgreSQL, Amazon S3, Openstack Swift, etc, thus in usual cases using mentioned storages, you don't have to add any ``storages`` configuration. +However, if you want to use your custom storage as one of Tajo's data source, you need to add a configuration for your storage. Here is an example of HDFS storage. +See `:doc:storage_plugins/overview` for more information. — End diff – This is my mistake. Please fix to ```:doc:`storage_plugins/overview` ```
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user jihoonson commented on the pull request:

        https://github.com/apache/tajo/pull/873#issuecomment-161279842

        +1 thanks for quick update.

        Show
        githubbot ASF GitHub Bot added a comment - Github user jihoonson commented on the pull request: https://github.com/apache/tajo/pull/873#issuecomment-161279842 +1 thanks for quick update.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user asfgit closed the pull request at:

        https://github.com/apache/tajo/pull/873

        Show
        githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/tajo/pull/873
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-master-CODEGEN-build #611 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/611/)
        TAJO-1855: Add document for tablespace configuration to the (jihoonson: rev f2552bfb9c0a3b57f66e89a9e635a0d1afbeebc8)

        • tajo-docs/src/main/sphinx/configuration/storage-site-json.rst
        • CHANGES
        • tajo-docs/src/main/sphinx/configuration.rst
        • tajo-docs/src/main/sphinx/conf.py
        • tajo-docs/src/main/sphinx/table_management/tablespaces.rst
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-master-CODEGEN-build #611 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/611/ ) TAJO-1855 : Add document for tablespace configuration to the (jihoonson: rev f2552bfb9c0a3b57f66e89a9e635a0d1afbeebc8) tajo-docs/src/main/sphinx/configuration/storage-site-json.rst CHANGES tajo-docs/src/main/sphinx/configuration.rst tajo-docs/src/main/sphinx/conf.py tajo-docs/src/main/sphinx/table_management/tablespaces.rst
        Hide
        jihoonson Jihoon Son added a comment -

        Committed to master and 0.11.1.

        Show
        jihoonson Jihoon Son added a comment - Committed to master and 0.11.1.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #1002 (See https://builds.apache.org/job/Tajo-master-build/1002/)
        TAJO-1855: Add document for tablespace configuration to the (jihoonson: rev f2552bfb9c0a3b57f66e89a9e635a0d1afbeebc8)

        • tajo-docs/src/main/sphinx/configuration.rst
        • tajo-docs/src/main/sphinx/table_management/tablespaces.rst
        • tajo-docs/src/main/sphinx/configuration/storage-site-json.rst
        • tajo-docs/src/main/sphinx/conf.py
        • CHANGES
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #1002 (See https://builds.apache.org/job/Tajo-master-build/1002/ ) TAJO-1855 : Add document for tablespace configuration to the (jihoonson: rev f2552bfb9c0a3b57f66e89a9e635a0d1afbeebc8) tajo-docs/src/main/sphinx/configuration.rst tajo-docs/src/main/sphinx/table_management/tablespaces.rst tajo-docs/src/main/sphinx/configuration/storage-site-json.rst tajo-docs/src/main/sphinx/conf.py CHANGES
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-0.11.1-build #122 (See https://builds.apache.org/job/Tajo-0.11.1-build/122/)
        TAJO-1855: Add document for tablespace configuration to the (jihoonson: rev 415e24831aaf25839c98ae4538182c985cc43e5c)

        • tajo-docs/src/main/sphinx/table_management/tablespaces.rst
        • tajo-docs/src/main/sphinx/configuration/storage-site-json.rst
        • tajo-docs/src/main/sphinx/configuration.rst
        • tajo-docs/src/main/sphinx/conf.py
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-0.11.1-build #122 (See https://builds.apache.org/job/Tajo-0.11.1-build/122/ ) TAJO-1855 : Add document for tablespace configuration to the (jihoonson: rev 415e24831aaf25839c98ae4538182c985cc43e5c) tajo-docs/src/main/sphinx/table_management/tablespaces.rst tajo-docs/src/main/sphinx/configuration/storage-site-json.rst tajo-docs/src/main/sphinx/configuration.rst tajo-docs/src/main/sphinx/conf.py

          People

          • Assignee:
            eminency Jongyoung Park
            Reporter:
            jihoonson Jihoon Son
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development