Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-744

(Umbrella) ALTER TABLE ADD/DROP PARTITION statement

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: In Progress
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Catalog
    • Labels:
      None

      Description

      Currently, Tajo does not manage partitioned directly. In Tajo, each partition is just a directory. For each query, a logical planner traverses matched directories in HDFS according to partition predicates.

      This approach is not efficient especially in the environment where the number of partitions are very large. It also makes partition management hard.

      Tajo should manage partitions directly by using ALTER TABLE ADD/DROP PARTITION statements. A number of partition entries should be stored in the underlying database that catalog uses.

      Synopsis of ALTER TABLE ADD/DROP PARTITION
      ALTER TABLE table_name [IF NOT EXISTS] ADD COLUMN PARTITION (key1 = 'val2', key2 = 'val2', ...) WITH ('prop_key' = 'prop_val', ...) LOCATION '...';
      
      ALTER TABLE table_name [IF EXISTS] DROP COLUMN PARTITION  (key1 [=|<|<=|>|>=|!=] 'val1', key2 ...,);
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                blrunner JaeHwa Jung
                Reporter:
                hyunsik Hyunsik Choi
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: