[KYLIN-4883] Cannot sync Hive partitioned table - Ooops.. Cannot get Hive TableMeta

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: v3.1.0
• Environment: Ubuntu 20.4 ; hadoop 3.2.1 ; hbase 2.2.6 ; hive 3.1.2 ; kylin 3.1.0
• Assignee: Unassigned
• Reporter: Iosiv Popescu
• Created: 22/Jan/21 20:46
• Updated: 19/Jul/23 03:30

Description

Dear Kylini team,

I have started working with Kylin in October 2020. All good until I read to partition the fact table in Hive to match partition column in Kylin.

Tried to do that and I fail when I try to sync the new defined table containing any kind of partioned column type. I tried int, date, etc.

I think I've read anything available on internet about this and I probably tried all configurations possible.

I have a working environment in general except this sync in Kylin of a partioned table. To avoid this I created a view over the partitioned fact table but I understood this is not very helpful as Hive would be forced to full scan the underlying table.

I have a working HCatalog I think and it should be fine in my opinion.

I do not know what else to do. And the table started to get some volume as 400 milion rows and the time to load the data from Hive started to get large enough.

 

Please help.

 

Thank you,

Iosiv