Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-2005

CTAS should not create table until insert succeeds

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Reopened
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: Impala 1.4, Impala 1.4.1, Impala 2.0, Impala 2.0.1, Impala 2.1, Impala 2.1.1, Impala 2.2
    • Fix Version/s: None
    • Component/s: Catalog

      Description

      I checked create table like the following fails.
      (parquet_file_size is sample to make create table fail)

      sudo -u impala impala-shell -q "set parquet_file_size=10g; create table 59915_test stored as parquet as select * from sample_08;"

      But table/folder is created as followings.
      I think failed DDL should clean up table and its directory.

      Terminal Log

      [root@nightly-2 ~]# sudo -u impala impala-shell -q "set parquet_file_size=10g; create table 59915_test stored as parquet as select * from sample_08;"
      Starting Impala Shell without Kerberos authentication
      Connected to nightly-2.ent.cloudera.com:21000
      Server version: impalad version 2.3.0-cdh5-INTERNAL RELEASE (build 03b1ea79d41c49617be46313ffe0f5f05b1b54f5)
      PARQUET_FILE_SIZE set to 10g
      Query: create table 59915_test stored as parquet as select * from sample_08
      WARNINGS: Failed to open HDFS file for writing: hdfs://nightly-1.ent.cloudera.com:8020/user/hive/warehouse/59915_test/_impala_insert_staging/d945ce65feede9a4_355731418cd694b9//.d945ce65feede9a4-355731418cd694ba_1653921013_dir/d945ce65feede9a4-355731418cd694ba_1805782816_data.0.parq
      Error(255): Unknown error 255
      :
      [nightly-2.ent.cloudera.com:21000] > select * from 59915_test;
      Query: select * from 59915_test

      Fetched 0 row(s) in 2.04s

      Workaround
      The workaround is to manually delete the extraneous table and the corresponding HDFS directory.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              tomo Tomoaki Yano
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated: