[IMPALA-1750] Validate Cache Params fails on Upgrade from old Meta Store

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 2.1
• Fix Version/s: Impala 2.2
• Assignee: Martin Grund
• Reporter: Martin Grund
• Created: 12/Feb/15 00:10
• Updated: 17/Feb/15 04:45
• Resolved: 17/Feb/15 04:45

Description

When Impala with the recent validate cache parameters patch tries to verify the existence of the cache replication property in the Hive metastore, it will fail with an NPE. As a consequence, the table load will fail for this table.

Caused by: com.cloudera.impala.catalog.TableLoadingException: Failed to load metadata for table: alltypestiny
CAUSED BY: NumberFormatException: null
        at com.cloudera.impala.catalog.IncompleteTable.loadFromThrift(IncompleteTable.java:114)
        at com.cloudera.impala.catalog.Table.fromThrift(Table.java:238)
        at com.cloudera.impala.catalog.ImpaladCatalog.addTable(ImpaladCatalog.java:357)
        at com.cloudera.impala.catalog.ImpaladCatalog.addCatalogObject(ImpaladCatalog.java:246)
        at com.cloudera.impala.catalog.ImpaladCatalog.updateCatalog(ImpaladCatalog.java:132)
        at com.cloudera.impala.service.Frontend.updateCatalogCache(Frontend.java:215)
        at com.cloudera.impala.service.JniFrontend.updateCatalogCache(JniFrontend.java:162)
        at ========.<Remote stack trace on catalogd>: com.cloudera.impala.catalog.TableLoadingException: Failed to load metadata for table: alltypestiny
        at com.cloudera.impala.catalog.HdfsTable.load(HdfsTable.java:1140)
        at com.cloudera.impala.catalog.TableLoader.load(TableLoader.java:84)
        at com.cloudera.impala.catalog.TableLoadingMgr$2.call(TableLoadingMgr.java:232)
        at com.cloudera.impala.catalog.TableLoadingMgr$2.call(TableLoadingMgr.java:1)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NumberFormatException: null
        at java.lang.Integer.parseInt(Integer.java:454)
        at java.lang.Short.parseShort(Short.java:117)
        at java.lang.Short.parseShort(Short.java:143)
        at com.cloudera.impala.util.HdfsCachingUtil.validateCacheParams(HdfsCachingUtil.java:465)
        at com.cloudera.impala.catalog.HdfsTable.loadPartitions(HdfsTable.java:628)
        at com.cloudera.impala.catalog.HdfsTable.load(HdfsTable.java:1121)
        ... 7 more
()