Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-12891

HdfsTable.toMinimalTCatalogObject() not always collect the partitions

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Catalog
    • None
    • ghx-label-4

    Description

      This is a follow-up task of IMPALA-12831 where we try acquiring the table read lock in HdfsTable.toMinimalTCatalogObject() to protect the access. If acquiring the table read lock fails, we return the object without the partitions.

      There is a WIP patch for adding a fine-grained lock on the partition map to improve this: https://gerrit.cloudera.org/c/21115/

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-12831 HdfsTable.toMinimalTCatalogObject() should hold table read lock to generate incremental updates

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              stigahuang Quanlong Huang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: