[IMPALA-4871] Log entry like "loading block md for 'table-x' file 'file-1'" needs more file details logging

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: Impala 2.6.0
• Component/s: Catalog
• Labels: supportability
• Assignee: Unassigned
• Reporter: Mala Chikka Kempanna
• Created: 02/Feb/17 18:47
• Updated: 20/Jun/17 04:41
• Resolved: 20/Jun/17 04:41

Description

Catalog when fails(or passes) to load block metadata of specific table files, throws following messages in logs.

I0128 01:54:33.537742 22702 HdfsTable.java:345] load block md for table-x file 000066_0
I0128 01:54:59.373677 22702 BlockStorageLocationUtil.java:167] Cancelled while waiting for datanode x.y.z.215:50020: java.util.concurrent.CancellationException
I0128 01:54:59.373868 22702 BlockStorageLocationUtil.java:167] Cancelled while waiting for datanode x.y.z.148:50020: java.util.concurrent.CancellationException

These logs will be more useful if the entire hierarchy of file location is logged including all levels of partitions.
Since just file name like "000066_0" can be present for thousands of partitions under same table, it is difficult to isolate the problematic file with a just above log entry.