[IMPALA-9848] Coordinator unnecessarily invalidating locally cached table metadata

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Catalog, Frontend
• Epic Color: ghx-label-5
• Assignee: Unassigned
• Reporter: Sahil Takiar
• Created: 11/Jun/20 16:58
• Updated: 23/Jul/20 02:13

Description

The following fails when run locally on master:

./bin/start-impala-cluster.py --catalogd_args='--catalog_topic_mode=minimal' --impalad_args='--use_local_catalog'
./bin/impala-shell.sh
[localhost:21000] default> select count(l_comment) from tpch.lineitem; <--- THIS WORKS
# kill the catalogd process
[localhost:21000] default> select count(l_comment) from tpch.lineitem; <--- THIS FAILS
ERROR: AnalysisException: Failed to load metadata for table: 'tpch.lineitem'
CAUSED BY: TableLoadingException: Could not load table tpch.lineitem from catalog
CAUSED BY: TException: org.apache.impala.common.InternalException: Couldn't open transport for localhost:26000 (connect() failed: Connection refused)CAUSED BY: InternalException: Couldn't open transport for localhost:26000 (connect() failed: Connection refused 

The above experiment works with catalog v1 - e.g. if you remove the startup flags in the ./bin/start-impala-cluster.py everything works.