[IMPALA-2840] Avoid storing redundant information about partitions in the catalog

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Impala 2.2.4
• Component/s: Catalog
• Labels: catalog-server memory performance ramp-up
• Target Version: Product Backlog
• Assignee: Unassigned
• Reporter: Dimitris Tsirogiannis
• Created: 13/Jan/16 03:03
• Updated: 16/Apr/18 18:59

Description

For each partition we store the entire path in a string. For tables with large number of partitions, there is lots of redundancy that we should try to avoid in order to reduce the catalog's memory footprint.