[HIVE-15157] Partition Table With timestamp type on S3 storage --> Error in getting fields from serde.Invalid Field null

• Type: Bug
• Status: Patch Available
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 2.1.0
• Component/s: Clients
• Labels: pull-request-available timestamp

Environment

JDK 1.8 101

• Target Version/s: 3.0.0
• Assignee: Jesús Camacho Rodríguez
• Reporter: thauvin damien
• Created: 08/Nov/16 16:53
• Updated: 27/Feb/24 22:23

Description

Hello

I get the error above when i try to perform :
hive> DESCRIBE formatted table partition (tsbucket='2016-10-28 16%3A00%3A00');
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Error in getting fields from serde.Invalid Field null

Here is the description of the issue.
--External table Hive with dynamic partition enable on Aws S3 storage.
--Partition Table with timestamp type .

When i perform "show partition table;" everything is fine :
hive> show partitions table;
OK
tsbucket=2016-10-01 11%3A00%3A00
tsbucket=2016-10-28 16%3A00%3A00

And when i perform "describe FORMATTED table;" everything is fine

Is this a bug ?

The stacktrace of hive.log :

2016-11-08T10:30:20,868 ERROR [ac3e0d48-22c5-4d04-a788-aeb004ea94f3 main([])]: exec.DDLTask (DDLTask.java:failed(574)) - org.apache.hadoop.hive.ql.metadata.HiveException: Error in getting fields from serde.Invalid Field null
at org.apache.hadoop.hive.ql.metadata.Hive.getFieldsFromDeserializer(Hive.java:3414)
at org.apache.hadoop.hive.ql.exec.DDLTask.describeTable(DDLTask.java:3109)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:408)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:197)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1858)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1562)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1313)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1084)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1072)
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:232)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:183)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:399)
at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:776)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:714)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:641)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: MetaException(message:Invalid Field null)
at org.apache.hadoop.hive.metastore.MetaStoreUtils.getFieldsFromDeserializer(MetaStoreUtils.java:1336)
at org.apache.hadoop.hive.ql.metadata.Hive.getFieldsFromDeserializer(Hive.java:3409)
... 21 more

Issue Links

• duplicates: HIVE-15158 Partition Table With timestamp type on S3 storage --> Error in getting fields from serde.Invalid Field null
• is related to: HIVE-17274 RowContainer spills for timestamp column throws exception
• links to: GitHub Pull Request #840