Affects Version/s: v2.6.1
Fix Version/s: None
Component/s: Job Engine
Kylin org.apache.kylin.tool.StorageCleanupJob does not delete hive intermediate tables if they are view based.
After several weeks running Kylin 2.6.1 after a successful upgrade from 2.4.1, we have a lot of temporary tables that have not been deleted. All of them come from a VIEW.
However, those tables built directly from a table and not from a view, are properly deleted.
Tables from view not deleted: 263079
Tables not form view not deleted: 0
At log level, we can see:
So, it's properly detected and drop sentence properly created. But it's not executed and table is still there.
We have launched the 263079 drop sentences via script and all are being removed.