Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6275

Successful CTAS logs warning

    XMLWordPrintableJSON

Details

    Description

      I just noticed this on my development branch (branched off master at 63f17e9ceaed92a28ea12567a36b746e54fffdb3). I'm not sure if it's new behaviour, but it's potentially confusing. I ran a successful CTAS for a table that didn't exist and got a stack trace in the warning log.

      I1205 10:42:21.316118 14901 Frontend.java:909] Compiling query: create table new_table as select "foo"
      W1205 10:42:21.320310 14901 Table.java:187] Could not load column statistics for: default.new_table
      Java exception follows:
      NoSuchObjectException(message:Specified database/table does not exist : default.new_table)
              at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_table_statistics_req_result$get_table_statistics_req_resultStandardScheme.read(ThriftHiveMetastore.java)
              at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_table_statistics_req_result$get_table_statistics_req_resultStandardScheme.read(ThriftHiveMetastore.java)
              at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_table_statistics_req_result.read(ThriftHiveMetastore.java)
              at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:86)
              at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_table_statistics_req(ThriftHiveMetastore.java:3117)
              at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table_statistics_req(ThriftHiveMetastore.java:3104)
              at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTableColumnStatistics(HiveMetaStoreClient.java:1557)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:498)
              at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:101)
              at com.sun.proxy.$Proxy13.getTableColumnStatistics(Unknown Source)
              at org.apache.impala.catalog.Table.loadAllColumnStats(Table.java:185)
              at org.apache.impala.catalog.HdfsTable.loadSchema(HdfsTable.java:1527)
              at org.apache.impala.catalog.HdfsTable.load(HdfsTable.java:1182)
              at org.apache.impala.catalog.HdfsTable.load(HdfsTable.java:1146)
              at org.apache.impala.analysis.CreateTableAsSelectStmt.analyze(CreateTableAsSelectStmt.java:201)
              at org.apache.impala.analysis.AnalysisContext.analyze(AnalysisContext.java:388)
              at org.apache.impala.analysis.AnalysisContext.analyze(AnalysisContext.java:369)
              at org.apache.impala.service.Frontend.analyzeStmt(Frontend.java:920)
              at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1069)
              at org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:156)
      I1205 10:42:21.320755 14901 Frontend.java:948] Compiled query.
      

      Attachments

        Activity

          People

            fredyw Fredy Wijaya
            tarmstrong Tim Armstrong
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: