Uploaded image for project: 'Tajo (Retired)'
  1. Tajo (Retired)
  2. TAJO-337

Tajo Generic Storage Support

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Catalog, Storage
    • None

    Description

      Currently, Tajo uses HDFS as a primary storage. But, as a data warehouse system, Tajo should easily support various data sources.

      For this, I propose a generic storage handler interface that provides common storage methods as follows:

      • splitting input data
      • locality
      • accessing catalog (if providing)
      • creating a table
      • removing a table
      • adding default table properties and validating properties
      • committing, rollback, and clean up output tables
      • getting table physical information like table volumes and others
      • managing connection pool for connection-based storages
      • adding storage-specified rewrite rules
      • adding hooks for query phases
      • physical properties like instant random access, indexible, read throughput, and write throughput

      Attachments

        Issue Links

          incorporates

          Improvement - An improvement or enhancement to an existing feature or task. TAJO-1163 TableDesc should use URI instead of Path.

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue TAJO-1127 Implements HBaseStorageManager

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue TAJO-1123 Use Fragment instead of FileFragment.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. TAJO-1879 Add enabled and description fields to tablespace entry in storage-site.json

          • Major - Major loss of function.
          • Open
          is required by

          Improvement - An improvement or enhancement to an existing feature or task. TAJO-367 Separate the locality information from Fragment

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. TAJO-1595 Pluggable Storage Handler

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              hyunsik Hyunsik Choi
              hyunsik Hyunsik Choi
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: