Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4871

Log entry like "loading block md for 'table-x' file 'file-1'" needs more file details logging

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • Impala 2.6.0
    • None
    • Catalog

    Description

      Catalog when fails(or passes) to load block metadata of specific table files, throws following messages in logs.

      I0128 01:54:33.537742 22702 HdfsTable.java:345] load block md for table-x file 000066_0
      I0128 01:54:59.373677 22702 BlockStorageLocationUtil.java:167] Cancelled while waiting for datanode x.y.z.215:50020: java.util.concurrent.CancellationException
      I0128 01:54:59.373868 22702 BlockStorageLocationUtil.java:167] Cancelled while waiting for datanode x.y.z.148:50020: java.util.concurrent.CancellationException

      These logs will be more useful if the entire hierarchy of file location is logged including all levels of partitions.
      Since just file name like "000066_0" can be present for thousands of partitions under same table, it is difficult to isolate the problematic file with a just above log entry.

      Attachments

        Activity

          People

            Unassigned Unassigned
            mala_ck Mala Chikka Kempanna
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: