Hive
  1. Hive
  2. HIVE-3649

Hive List Bucketing - enhance DDL to specify list bucketing table

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0
    • Fix Version/s: 0.10.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      We need to differ normal skewed table from list bucketing table. we use an optional parameter "store as DIRECTORIES"

      4 main cases:
      1. create table <name> skewed by .. on .. stored as directories;
      2. alter table <name> skewed by .. on .. stored as directories;
      3. alter table <name> not skewed;
      4. alter table <name> not stored as directories;

      details in https://cwiki.apache.org/confluence/display/Hive/ListBucketing

      1. HIVE-3649.patch.4
        79 kB
        Gang Tim Liu
      2. HIVE-3649.patch.6
        77 kB
        Gang Tim Liu
      3. HIVE-3649.patch.7
        75 kB
        Gang Tim Liu
      4. HIVE-3649.patch.8
        78 kB
        Gang Tim Liu
      5. HIVE-3649.patch.9
        112 kB
        Gang Tim Liu

        Issue Links

          Activity

          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Patch Available Patch Available Open Open
          14h 30m 3 Namit Jain 08/Nov/12 11:21
          Open Open Patch Available Patch Available
          6d 3h 11m 4 Gang Tim Liu 08/Nov/12 16:10
          Patch Available Patch Available Resolved Resolved
          12h 7m 1 Namit Jain 09/Nov/12 04:17
          Resolved Resolved Closed Closed
          62d 15h 35m 1 Ashutosh Chauhan 10/Jan/13 19:53
          Hide
          Lefty Leverenz added a comment -

          Doc note and question: I added the ALTER TABLE syntax to the DDL wikidoc (please review) but don't know what to document about CONCATENATE, which is mentioned in the design doc. The CREATE TABLE syntax was already documented.

          So does ALTER TABLE ... CONCATENATE need any doc?

          Show
          Lefty Leverenz added a comment - Doc note and question: I added the ALTER TABLE syntax to the DDL wikidoc (please review) but don't know what to document about CONCATENATE, which is mentioned in the design doc. The CREATE TABLE syntax was already documented. DDL – Alter Table Skewed or Stored as Directories List Bucketing – Design : "When such a table is being loaded, it would be good to create a sub-directory per skewed key. The infrastructure similar to dynamic partitions can be used." DDL – AlterTable/Partition Concatenate DDL – Create Table (syntax) DDL – Create Table – Skewed Tables So does ALTER TABLE ... CONCATENATE need any doc?
          Lefty Leverenz made changes -
          Link This issue is related to HIVE-3072 [ HIVE-3072 ]
          Ashutosh Chauhan made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Hide
          Ashutosh Chauhan added a comment -

          This issue is fixed and released as part of 0.10.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.

          Show
          Ashutosh Chauhan added a comment - This issue is fixed and released as part of 0.10.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.
          Hide
          Hudson added a comment -

          Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/)
          HIVE-3649 Hive List Bucketing - enhance DDL to specify list bucketing table
          (Gang Tim Liu via namit) (Revision 1407353)

          Result = ABORTED
          namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1407353
          Files :

          • /hive/trunk/metastore/if/hive_metastore.thrift
          • /hive/trunk/metastore/scripts/upgrade/derby/010-HIVE-3649.derby.sql
          • /hive/trunk/metastore/scripts/upgrade/derby/hive-schema-0.10.0.derby.sql
          • /hive/trunk/metastore/scripts/upgrade/derby/upgrade-0.9.0-to-0.10.0.derby.sql
          • /hive/trunk/metastore/scripts/upgrade/mysql/010-HIVE-3649.mysql.sql
          • /hive/trunk/metastore/scripts/upgrade/mysql/hive-schema-0.10.0.mysql.sql
          • /hive/trunk/metastore/scripts/upgrade/mysql/upgrade-0.9.0-to-0.10.0.mysql.sql
          • /hive/trunk/metastore/scripts/upgrade/oracle/010-HIVE-3649.oracle.sql
          • /hive/trunk/metastore/scripts/upgrade/oracle/hive-schema-0.10.0.oracle.sql
          • /hive/trunk/metastore/scripts/upgrade/postgres/010-HIVE-3649.postgres.sql
          • /hive/trunk/metastore/scripts/upgrade/postgres/hive-schema-0.10.0.postgres.sql
          • /hive/trunk/metastore/scripts/upgrade/postgres/upgrade-0.9.0-to-0.10.0.postgres.sql
          • /hive/trunk/metastore/src/gen/thrift/gen-cpp/hive_metastore_types.cpp
          • /hive/trunk/metastore/src/gen/thrift/gen-cpp/hive_metastore_types.h
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Database.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/EnvironmentContext.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Index.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Partition.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/PrincipalPrivilegeSet.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Schema.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/SerDeInfo.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/SkewedInfo.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/StorageDescriptor.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Table.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java
          • /hive/trunk/metastore/src/gen/thrift/gen-php/hive_metastore/hive_metastore_types.php
          • /hive/trunk/metastore/src/gen/thrift/gen-php/metastore/Types.php
          • /hive/trunk/metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py
          • /hive/trunk/metastore/src/gen/thrift/gen-rb/hive_metastore_types.rb
          • /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java
          • /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MStorageDescriptor.java
          • /hive/trunk/metastore/src/model/package.jdo
          • /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestHiveMetaStore.java
          • /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Operator.java
          • /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Query.java
          • /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Stage.java
          • /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Task.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatUtils.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/LoadSemanticAnalyzer.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AlterTableDesc.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java
          • /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java
          • /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHive.java
          • /hive/trunk/ql/src/test/queries/clientnegative/load_stored_as_dirs.q
          • /hive/trunk/ql/src/test/queries/clientpositive/create_alter_list_bucketing_table1.q
          • /hive/trunk/ql/src/test/results/clientnegative/load_stored_as_dirs.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/create_alter_list_bucketing_table1.q.out
          • /hive/trunk/serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde2/thrift/test/Complex.java
          • /hive/trunk/serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde2/thrift/test/MegaStruct.java
          Show
          Hudson added a comment - Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/ ) HIVE-3649 Hive List Bucketing - enhance DDL to specify list bucketing table (Gang Tim Liu via namit) (Revision 1407353) Result = ABORTED namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1407353 Files : /hive/trunk/metastore/if/hive_metastore.thrift /hive/trunk/metastore/scripts/upgrade/derby/010- HIVE-3649 .derby.sql /hive/trunk/metastore/scripts/upgrade/derby/hive-schema-0.10.0.derby.sql /hive/trunk/metastore/scripts/upgrade/derby/upgrade-0.9.0-to-0.10.0.derby.sql /hive/trunk/metastore/scripts/upgrade/mysql/010- HIVE-3649 .mysql.sql /hive/trunk/metastore/scripts/upgrade/mysql/hive-schema-0.10.0.mysql.sql /hive/trunk/metastore/scripts/upgrade/mysql/upgrade-0.9.0-to-0.10.0.mysql.sql /hive/trunk/metastore/scripts/upgrade/oracle/010- HIVE-3649 .oracle.sql /hive/trunk/metastore/scripts/upgrade/oracle/hive-schema-0.10.0.oracle.sql /hive/trunk/metastore/scripts/upgrade/postgres/010- HIVE-3649 .postgres.sql /hive/trunk/metastore/scripts/upgrade/postgres/hive-schema-0.10.0.postgres.sql /hive/trunk/metastore/scripts/upgrade/postgres/upgrade-0.9.0-to-0.10.0.postgres.sql /hive/trunk/metastore/src/gen/thrift/gen-cpp/hive_metastore_types.cpp /hive/trunk/metastore/src/gen/thrift/gen-cpp/hive_metastore_types.h /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Database.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/EnvironmentContext.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Index.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Partition.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/PrincipalPrivilegeSet.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Schema.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/SerDeInfo.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/SkewedInfo.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/StorageDescriptor.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Table.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java /hive/trunk/metastore/src/gen/thrift/gen-php/hive_metastore/hive_metastore_types.php /hive/trunk/metastore/src/gen/thrift/gen-php/metastore/Types.php /hive/trunk/metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py /hive/trunk/metastore/src/gen/thrift/gen-rb/hive_metastore_types.rb /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MStorageDescriptor.java /hive/trunk/metastore/src/model/package.jdo /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestHiveMetaStore.java /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Operator.java /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Query.java /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Stage.java /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Task.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatUtils.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/LoadSemanticAnalyzer.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AlterTableDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHive.java /hive/trunk/ql/src/test/queries/clientnegative/load_stored_as_dirs.q /hive/trunk/ql/src/test/queries/clientpositive/create_alter_list_bucketing_table1.q /hive/trunk/ql/src/test/results/clientnegative/load_stored_as_dirs.q.out /hive/trunk/ql/src/test/results/clientpositive/create_alter_list_bucketing_table1.q.out /hive/trunk/serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde2/thrift/test/Complex.java /hive/trunk/serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde2/thrift/test/MegaStruct.java
          Gang Tim Liu made changes -
          Assignee Gang Tim Liu [ gangtimliu ]
          Hide
          Hudson added a comment -

          Integrated in Hive-trunk-h0.21 #1785 (See https://builds.apache.org/job/Hive-trunk-h0.21/1785/)
          HIVE-3649 Hive List Bucketing - enhance DDL to specify list bucketing table
          (Gang Tim Liu via namit) (Revision 1407353)

          Result = FAILURE
          namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1407353
          Files :

          • /hive/trunk/metastore/if/hive_metastore.thrift
          • /hive/trunk/metastore/scripts/upgrade/derby/010-HIVE-3649.derby.sql
          • /hive/trunk/metastore/scripts/upgrade/derby/hive-schema-0.10.0.derby.sql
          • /hive/trunk/metastore/scripts/upgrade/derby/upgrade-0.9.0-to-0.10.0.derby.sql
          • /hive/trunk/metastore/scripts/upgrade/mysql/010-HIVE-3649.mysql.sql
          • /hive/trunk/metastore/scripts/upgrade/mysql/hive-schema-0.10.0.mysql.sql
          • /hive/trunk/metastore/scripts/upgrade/mysql/upgrade-0.9.0-to-0.10.0.mysql.sql
          • /hive/trunk/metastore/scripts/upgrade/oracle/010-HIVE-3649.oracle.sql
          • /hive/trunk/metastore/scripts/upgrade/oracle/hive-schema-0.10.0.oracle.sql
          • /hive/trunk/metastore/scripts/upgrade/postgres/010-HIVE-3649.postgres.sql
          • /hive/trunk/metastore/scripts/upgrade/postgres/hive-schema-0.10.0.postgres.sql
          • /hive/trunk/metastore/scripts/upgrade/postgres/upgrade-0.9.0-to-0.10.0.postgres.sql
          • /hive/trunk/metastore/src/gen/thrift/gen-cpp/hive_metastore_types.cpp
          • /hive/trunk/metastore/src/gen/thrift/gen-cpp/hive_metastore_types.h
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Database.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/EnvironmentContext.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Index.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Partition.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/PrincipalPrivilegeSet.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Schema.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/SerDeInfo.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/SkewedInfo.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/StorageDescriptor.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Table.java
          • /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java
          • /hive/trunk/metastore/src/gen/thrift/gen-php/hive_metastore/hive_metastore_types.php
          • /hive/trunk/metastore/src/gen/thrift/gen-php/metastore/Types.php
          • /hive/trunk/metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py
          • /hive/trunk/metastore/src/gen/thrift/gen-rb/hive_metastore_types.rb
          • /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java
          • /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MStorageDescriptor.java
          • /hive/trunk/metastore/src/model/package.jdo
          • /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestHiveMetaStore.java
          • /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Operator.java
          • /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Query.java
          • /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Stage.java
          • /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Task.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatUtils.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/LoadSemanticAnalyzer.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AlterTableDesc.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java
          • /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java
          • /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHive.java
          • /hive/trunk/ql/src/test/queries/clientnegative/load_stored_as_dirs.q
          • /hive/trunk/ql/src/test/queries/clientpositive/create_alter_list_bucketing_table1.q
          • /hive/trunk/ql/src/test/results/clientnegative/load_stored_as_dirs.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/create_alter_list_bucketing_table1.q.out
          • /hive/trunk/serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde2/thrift/test/Complex.java
          • /hive/trunk/serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde2/thrift/test/MegaStruct.java
          Show
          Hudson added a comment - Integrated in Hive-trunk-h0.21 #1785 (See https://builds.apache.org/job/Hive-trunk-h0.21/1785/ ) HIVE-3649 Hive List Bucketing - enhance DDL to specify list bucketing table (Gang Tim Liu via namit) (Revision 1407353) Result = FAILURE namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1407353 Files : /hive/trunk/metastore/if/hive_metastore.thrift /hive/trunk/metastore/scripts/upgrade/derby/010- HIVE-3649 .derby.sql /hive/trunk/metastore/scripts/upgrade/derby/hive-schema-0.10.0.derby.sql /hive/trunk/metastore/scripts/upgrade/derby/upgrade-0.9.0-to-0.10.0.derby.sql /hive/trunk/metastore/scripts/upgrade/mysql/010- HIVE-3649 .mysql.sql /hive/trunk/metastore/scripts/upgrade/mysql/hive-schema-0.10.0.mysql.sql /hive/trunk/metastore/scripts/upgrade/mysql/upgrade-0.9.0-to-0.10.0.mysql.sql /hive/trunk/metastore/scripts/upgrade/oracle/010- HIVE-3649 .oracle.sql /hive/trunk/metastore/scripts/upgrade/oracle/hive-schema-0.10.0.oracle.sql /hive/trunk/metastore/scripts/upgrade/postgres/010- HIVE-3649 .postgres.sql /hive/trunk/metastore/scripts/upgrade/postgres/hive-schema-0.10.0.postgres.sql /hive/trunk/metastore/scripts/upgrade/postgres/upgrade-0.9.0-to-0.10.0.postgres.sql /hive/trunk/metastore/src/gen/thrift/gen-cpp/hive_metastore_types.cpp /hive/trunk/metastore/src/gen/thrift/gen-cpp/hive_metastore_types.h /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Database.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/EnvironmentContext.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Index.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Partition.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/PrincipalPrivilegeSet.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Schema.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/SerDeInfo.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/SkewedInfo.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/StorageDescriptor.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Table.java /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java /hive/trunk/metastore/src/gen/thrift/gen-php/hive_metastore/hive_metastore_types.php /hive/trunk/metastore/src/gen/thrift/gen-php/metastore/Types.php /hive/trunk/metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py /hive/trunk/metastore/src/gen/thrift/gen-rb/hive_metastore_types.rb /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MStorageDescriptor.java /hive/trunk/metastore/src/model/package.jdo /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestHiveMetaStore.java /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Operator.java /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Query.java /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Stage.java /hive/trunk/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Task.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatUtils.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/LoadSemanticAnalyzer.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AlterTableDesc.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHive.java /hive/trunk/ql/src/test/queries/clientnegative/load_stored_as_dirs.q /hive/trunk/ql/src/test/queries/clientpositive/create_alter_list_bucketing_table1.q /hive/trunk/ql/src/test/results/clientnegative/load_stored_as_dirs.q.out /hive/trunk/ql/src/test/results/clientpositive/create_alter_list_bucketing_table1.q.out /hive/trunk/serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde2/thrift/test/Complex.java /hive/trunk/serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde2/thrift/test/MegaStruct.java
          Hide
          Gang Tim Liu added a comment -

          Namit thanks a lot

          Sent from my iPhone

          Show
          Gang Tim Liu added a comment - Namit thanks a lot Sent from my iPhone
          Namit Jain made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Resolution Fixed [ 1 ]
          Hide
          Namit Jain added a comment -

          Committed. Thanks Tim

          Show
          Namit Jain added a comment - Committed. Thanks Tim
          Hide
          Namit Jain added a comment -

          Running tests again.

          Show
          Namit Jain added a comment - Running tests again.
          Gang Tim Liu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Gang Tim Liu added a comment -

          patch available.

          Show
          Gang Tim Liu added a comment - patch available.
          Gang Tim Liu made changes -
          Attachment HIVE-3649.patch.9 [ 12552669 ]
          Hide
          Gang Tim Liu added a comment -

          Yes, doing it. thanks

          Show
          Gang Tim Liu added a comment - Yes, doing it. thanks
          Namit Jain made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Namit Jain added a comment -

          Gang Tim Liu, can you refresh ? This may conflict due to the thrift upgrade.

          Show
          Namit Jain added a comment - Gang Tim Liu , can you refresh ? This may conflict due to the thrift upgrade.
          Hide
          Namit Jain added a comment -

          +1

          Show
          Namit Jain added a comment - +1
          Gang Tim Liu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Gang Tim Liu added a comment -

          Yes, address comments. patch available. thanks

          Show
          Gang Tim Liu added a comment - Yes, address comments. patch available. thanks
          Gang Tim Liu made changes -
          Attachment HIVE-3649.patch.8 [ 12552625 ]
          Gang Tim Liu made changes -
          Link This issue relates to HIVE-3690 [ HIVE-3690 ]
          Namit Jain made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Namit Jain added a comment -

          minor comments

          Show
          Namit Jain added a comment - minor comments
          Gang Tim Liu made changes -
          Attachment HIVE-3649.patch.7 [ 12552553 ]
          Gang Tim Liu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Gang Tim Liu added a comment -

          Patch is available.

          Show
          Gang Tim Liu added a comment - Patch is available.
          Gang Tim Liu made changes -
          Attachment HIVE-3649.patch.6 [ 12552517 ]
          Namit Jain made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Namit Jain added a comment -

          comments

          Show
          Namit Jain added a comment - comments
          Gang Tim Liu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.10.0 [ 12320745 ]
          Hide
          Gang Tim Liu added a comment -
          Show
          Gang Tim Liu added a comment - patch is available. https://reviews.facebook.net/D6543
          Gang Tim Liu made changes -
          Attachment HIVE-3649.patch.4 [ 12552428 ]
          Gang Tim Liu made changes -
          Description We need to differ normal skewed table from list bucketing table. we use an optional parameter "store as DIRECTORIES"

          create table <T> (schema) skewed by (keys) on ('c1', 'c2') [store as DIRECTORIES];

          details in https://cwiki.apache.org/confluence/display/Hive/ListBucketing

          4 main cases:
          1. create table <name> skewed by .. on .. stored as directories;
          2. alter table <name> skewed by .. on .. stored as directories;
          3. alter table <name> not skewed;
          4. alter table <name> not stored as directories;


          We need to differ normal skewed table from list bucketing table. we use an optional parameter "store as DIRECTORIES"

          4 main cases:
          1. create table <name> skewed by .. on .. stored as directories;
          2. alter table <name> skewed by .. on .. stored as directories;
          3. alter table <name> not skewed;
          4. alter table <name> not stored as directories;


          details in https://cwiki.apache.org/confluence/display/Hive/ListBucketing
          Gang Tim Liu made changes -
          Description We need to differ normal skewed table from list bucketing table. we use an optional parameter "store as DIRECTORIES"

          create table <T> (schema) skewed by (keys) on ('c1', 'c2') [store as DIRECTORIES];

          details in

          https://cwiki.apache.org/confluence/display/Hive/ListBucketing



          We need to differ normal skewed table from list bucketing table. we use an optional parameter "store as DIRECTORIES"

          create table <T> (schema) skewed by (keys) on ('c1', 'c2') [store as DIRECTORIES];

          details in https://cwiki.apache.org/confluence/display/Hive/ListBucketing

          4 main cases:
          1. create table <name> skewed by .. on .. stored as directories;
          2. alter table <name> skewed by .. on .. stored as directories;
          3. alter table <name> not skewed;
          4. alter table <name> not stored as directories;


          Gang Tim Liu made changes -
          Description We need to differ normal skewed table from list bucketing table. we use an optional parameter "store as DIRECTORIES"

          create table <T> (schema) skewed by (keys) on ('c1', 'c2') [store as DIRECTORIES];

          details in

          https://cwiki.apache.org/confluence/display/Hive/ListBucketing

          *

          We need to differ normal skewed table from list bucketing table. we use an optional parameter "store as DIRECTORIES"

          create table <T> (schema) skewed by (keys) on ('c1', 'c2') [store as DIRECTORIES];

          details in

          https://cwiki.apache.org/confluence/display/Hive/ListBucketing



          Gang Tim Liu made changes -
          Description We need to differ normal skewed table from list bucketing table. we use an optional parameter "store as DIRECTORIES"

          create table <T> (schema) skewed by (keys) on ('c1', 'c2') [store as DIRECTORIES];

          details in

          https://cwiki.apache.org/confluence/display/Hive/ListBucketing

          We need to differ normal skewed table from list bucketing table. we use an optional parameter "store as DIRECTORIES"

          create table <T> (schema) skewed by (keys) on ('c1', 'c2') [store as DIRECTORIES];

          details in

          https://cwiki.apache.org/confluence/display/Hive/ListBucketing

          *

          Gang Tim Liu made changes -
          Link This issue relates to HIVE-3026 [ HIVE-3026 ]
          Gang Tim Liu made changes -
          Summary Hive List Bucketing - specify list bucketing table Hive List Bucketing - enhance DDL to specify list bucketing table
          Affects Version/s 0.10.0 [ 12320745 ]
          Gang Tim Liu made changes -
          Field Original Value New Value
          Link This issue relates to HIVE-3073 [ HIVE-3073 ]
          Gang Tim Liu created issue -

            People

            • Assignee:
              Gang Tim Liu
              Reporter:
              Gang Tim Liu
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development