Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-15157

Partition Table With timestamp type on S3 storage --> Error in getting fields from serde.Invalid Field null

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Critical
    • Resolution: Unresolved
    • 2.1.0
    • None
    • Clients
    • JDK 1.8 101

    Description

      Hello

      I get the error above when i try to perform :
      hive> DESCRIBE formatted table partition (tsbucket='2016-10-28 16%3A00%3A00');
      FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Error in getting fields from serde.Invalid Field null

      Here is the description of the issue.
      --External table Hive with dynamic partition enable on Aws S3 storage.
      --Partition Table with timestamp type .

      When i perform "show partition table;" everything is fine :
      hive> show partitions table;
      OK
      tsbucket=2016-10-01 11%3A00%3A00
      tsbucket=2016-10-28 16%3A00%3A00

      And when i perform "describe FORMATTED table;" everything is fine

      Is this a bug ?

      The stacktrace of hive.log :

      2016-11-08T10:30:20,868 ERROR [ac3e0d48-22c5-4d04-a788-aeb004ea94f3 main([])]: exec.DDLTask (DDLTask.java:failed(574)) - org.apache.hadoop.hive.ql.metadata.HiveException: Error in getting fields from serde.Invalid Field null
      at org.apache.hadoop.hive.ql.metadata.Hive.getFieldsFromDeserializer(Hive.java:3414)
      at org.apache.hadoop.hive.ql.exec.DDLTask.describeTable(DDLTask.java:3109)
      at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:408)
      at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:197)
      at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100)
      at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1858)
      at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1562)
      at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1313)
      at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1084)
      at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1072)
      at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:232)
      at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:183)
      at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:399)
      at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:776)
      at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:714)
      at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:641)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:498)
      at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
      at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
      Caused by: MetaException(message:Invalid Field null)
      at org.apache.hadoop.hive.metastore.MetaStoreUtils.getFieldsFromDeserializer(MetaStoreUtils.java:1336)
      at org.apache.hadoop.hive.ql.metadata.Hive.getFieldsFromDeserializer(Hive.java:3409)
      ... 21 more

      Attachments

        1. HIVE-15157.03.patch
          12 kB
          jcamachorodriguez
        2. HIVE-15157.02.patch
          22 kB
          jcamachorodriguez
        3. HIVE-15157.01.patch
          12 kB
          jcamachorodriguez

        Issue Links

          Activity

            People

              jcamacho Jesús Camacho Rodríguez
              damdr thauvin damien
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 10m
                  1h 10m