Details
-
Improvement
-
Status: Patch Available
-
Minor
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Hcatalog creates partitions in lower case, whereas getting partitions from hcatalog via webhcat client doesn't handle this. So the client starts throwing exceptions.
Ex:
CREATE EXTERNAL TABLE in_table (word STRING, cnt INT) PARTITIONED BY (Year STRING, Month STRING, Date STRING, Hour STRING, Minute STRING) STORED AS TEXTFILE LOCATION '/user/suhas/hcat-data/in/';
Then i try to get partitions by:
String inputTableName = "in_table"; String database = "default"; Map<String, String> partitionSpec = new HashMap<String, String>(); partitionSpec.put("Year", "2014"); partitionSpec.put("Month", "08"); partitionSpec.put("Date", "11"); partitionSpec.put("Hour", "00"); partitionSpec.put("Minute", "00"); HCatClient client = get(catalogUrl); HCatPartition hCatPartition = client.getPartition(database, inputTableName, partitionSpec);
This throws up saying:
Exception in thread "main" org.apache.hcatalog.common.HCatException : 9001 : Exception occurred while processing HCat request : Invalid partition-key specified: year at org.apache.hcatalog.api.HCatClientHMSImpl.getPartition(HCatClientHMSImpl.java:366) at com.inmobi.demo.HcatPartitions.main(HcatPartitions.java:34) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606)
The same code works if i do
partitionSpec.put("year", "2014"); partitionSpec.put("month", "08"); partitionSpec.put("date", "11"); partitionSpec.put("hour", "00"); partitionSpec.put("minute", "00");