Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-1428

ALTER TABLE ADD PARTITION fails with a remote Thrift metastore

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.5.0
    • 0.6.0
    • Metastore
    • None
    • Reviewed

    Description

      If the hive cli is configured to use a remote metastore, ALTER TABLE ... ADD PARTITION commands will fail with an error similar to the following:

      [pradeepk@chargesize:~/dev/howl]hive --auxpath ult-serde.jar -e "ALTER TABLE mytable add partition(datestamp = '20091101', srcid = '10',action) location '/user/pradeepk/mytable/20091101/10';"
      10/06/16 17:08:59 WARN conf.Configuration: DEPRECATED: hadoop-site.xml found in the classpath. Usage of hadoop-site.xml is deprecated. Instead use core-site.xml, mapred-site.xml and hdfs-site.xml to override properties of core-default.xml, mapred-default.xml and hdfs-default.xml respectively
      Hive history file=/tmp/pradeepk/hive_job_log_pradeepk_201006161709_1934304805.txt
      FAILED: Error in metadata: org.apache.thrift.TApplicationException: get_partition failed: unknown result
      FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask
      [pradeepk@chargesize:~/dev/howl]

      This is due to a check that tries to retrieve the partition to see if it exists. If it does not, an attempt is made to pass a null value from the metastore. Since thrift does not support null return values, an exception is thrown.

      Attachments

        1. HIVE-1428-0.6.0-patch.txt
          32 kB
          Carl Steinbach
        2. HIVE-1428-3.patch
          29 kB
          Pradeep Kamath
        3. HIVE-1428-2.patch
          37 kB
          Pradeep Kamath
        4. TestHiveMetaStoreRemote.java
          13 kB
          Pradeep Kamath
        5. HIVE-1428.patch
          23 kB
          Pradeep Kamath

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            pradeepkth Pradeep Kamath Assign to me
            pauly Paul Yang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment