Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7670

Drop table with a concurrent refresh throws ConcurrentModificationException

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Cannot Reproduce
    • Affects Version/s: Impala 3.1.0
    • Fix Version/s: Not Applicable
    • Component/s: Catalog
    • Labels:
      None

      Description

      • This bug was found on a V2 Catalog and probably also applies to V1.

      Saw this in the Catalog server.

      I1004 16:38:55.236702 85380 jni-util.cc:308] java.util.ConcurrentModificationException
              at java.util.HashMap$HashIterator.nextNode(HashMap.java:1442)
              at java.util.HashMap$ValueIterator.next(HashMap.java:1471)
              at org.apache.impala.catalog.FeFsTable$Utils.getPartitionFromThriftPartitionSpec(FeFsTable.java:407)
              at org.apache.impala.catalog.HdfsTable.getPartitionFromThriftPartitionSpec(HdfsTable.java:694)
              at org.apache.impala.catalog.Catalog.getHdfsPartition(Catalog.java:407)
              at org.apache.impala.catalog.Catalog.getHdfsPartition(Catalog.java:386)
              at org.apache.impala.service.CatalogOpExecutor.bulkAlterPartitions(CatalogOpExecutor.java:3193)
              at org.apache.impala.service.CatalogOpExecutor.dropTableStats(CatalogOpExecutor.java:1255)
              at org.apache.impala.service.CatalogOpExecutor.dropStats(CatalogOpExecutor.java:1148)
              at org.apache.impala.service.CatalogOpExecutor.execDdlRequest(CatalogOpExecutor.java:301)
              at org.apache.impala.service.JniCatalog.execDdl(JniCatalog.java:157)
      

      Still need to dig into it, but seems like something is off with locking somewhere.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              bharathv Bharath Vissapragada
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: