Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.7.0
    • Component/s: Metastore, Query Processor
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      There should be a way to bring a table/partition offline.
      At that time, no read/write operations should be supported on that table.

      It would be very useful for housekeeping operations

      1. HIVE-1413.4.patch
        120 kB
        Siying Dong
      2. HIVE-1413.3.patch
        113 kB
        Siying Dong
      3. HIVE-1413.2.patch
        105 kB
        Siying Dong
      4. HIVE-1413.1.patch
        169 kB
        Siying Dong

        Issue Links

          Activity

          Hide
          Siying Dong added a comment -

          It's not a check-in-ready patch. It is tested locally but wasn't tested in cluster yet. Since it is involved in metastore change, want to do a preliminary first to make sure the metastore change is OK before testing on clusters.

          (1) modify thrift model and jdo to add extra columns "protectmode"
          (2) modify respective metastore codes to fetch and set the new columns
          (3) add command "alter table xxx set protectmode ..." and "alter table xxx alter partition (...) set protectmode ..."
          (4) When parsing and generating test, make sure we check protect mode of all tables/partitions read or written. Throw error if that is the case.
          (5) unit tests for it.

          Show
          Siying Dong added a comment - It's not a check-in-ready patch. It is tested locally but wasn't tested in cluster yet. Since it is involved in metastore change, want to do a preliminary first to make sure the metastore change is OK before testing on clusters. (1) modify thrift model and jdo to add extra columns "protectmode" (2) modify respective metastore codes to fetch and set the new columns (3) add command "alter table xxx set protectmode ..." and "alter table xxx alter partition (...) set protectmode ..." (4) When parsing and generating test, make sure we check protect mode of all tables/partitions read or written. Throw error if that is the case. (5) unit tests for it.
          Hide
          John Sichi added a comment -

          Siying, you named the patch file "HIVE-1414.1.patch", but this is HIVE-1413.

          Show
          John Sichi added a comment - Siying, you named the patch file " HIVE-1414 .1.patch", but this is HIVE-1413 .
          Hide
          John Sichi added a comment -

          Metastore upgrade scripts will need to be added in HIVE-1427.

          Show
          John Sichi added a comment - Metastore upgrade scripts will need to be added in HIVE-1427 .
          Hide
          John Sichi added a comment -

          For the upgrade script, we'll need to specify DEFAULT on ADD COLUMN so existing tables remain ONLINE by default.

          Show
          John Sichi added a comment - For the upgrade script, we'll need to specify DEFAULT on ADD COLUMN so existing tables remain ONLINE by default.
          Hide
          Siying Dong added a comment -

          Made some modifications: make column typed string and others...

          Show
          Siying Dong added a comment - Made some modifications: make column typed string and others...
          Hide
          Siying Dong added a comment -

          1. use parameters without making any change to metastore
          2. add support of no_drop mode. Make every mode like bitmap instead of levels
          3. cover the case of dropping tables

          Show
          Siying Dong added a comment - 1. use parameters without making any change to metastore 2. add support of no_drop mode. Make every mode like bitmap instead of levels 3. cover the case of dropping tables
          Hide
          Siying Dong added a comment -

          use more consolidated approach to try to check it in validate() instead of everywhere.
          change syntax a little bit.
          Add some more unit test cases.

          Show
          Siying Dong added a comment - use more consolidated approach to try to check it in validate() instead of everywhere. change syntax a little bit. Add some more unit test cases.
          Hide
          Namit Jain added a comment -

          +1

          will commit if the tests pass

          Show
          Namit Jain added a comment - +1 will commit if the tests pass
          Hide
          Siying Dong added a comment -

          The previous one missed two test output files...

          Show
          Siying Dong added a comment - The previous one missed two test output files...
          Hide
          Namit Jain added a comment -

          committed. Thanks Siying

          Show
          Namit Jain added a comment - committed. Thanks Siying

            People

            • Assignee:
              Siying Dong
              Reporter:
              Namit Jain
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development