-
Type:
Bug
-
Status: Patch Available
-
Priority:
Major
-
Resolution: Unresolved
-
Affects Version/s: 2.3.4
-
Fix Version/s: None
-
Labels:
Hive desc [formatted|extended] operation cost more than 100 seconds after upgrading from Hive 1.2.1 to 2.3.4. This is mainly caused by showing stats for partitioned tables which was introduced by HIVE-16098 when the partitioned tables have a large amount of partitions. In our case, the number of partition is 187221.
hive> desc bus.kafka_data; OK id string ... d map<string,string> stat_date string log_id string # Partition Information # col_name data_type comment stat_date string log_id string Time taken: 115.342 seconds, Fetched: 42 row(s)
same operation executed in hive-1.2.1 and only cost 2 seconds.
hive> desc bus.kafka_data; OK id string ... d map<string,string> stat_date string log_id string # Partition Information # col_name data_type comment stat_date string log_id string Time taken: 2.037 seconds, Fetched: 42 row(s)
- relates to
-
HIVE-22453 Describe table unnecessarily fetches partitions
-
- Resolved
-
- links to