[IMPALA-2005] CTAS should not create table until insert succeeds

• Type: Bug
• Status: Reopened
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Impala 1.4, Impala 1.4.1, Impala 2.0, Impala 2.0.1, Impala 2.1, Impala 2.1.1, Impala 2.2
• Component/s: Catalog
• Labels: correctness downgraded ramp-up
• Epic Link: Impala 5
• Target Version: Product Backlog
• Assignee: Unassigned
• Reporter: Tomoaki Yano
• Created: 14/May/15 07:24
• Updated: 02/Feb/24 02:50

Description

I checked create table like the following fails.
(parquet_file_size is sample to make create table fail)

sudo -u impala impala-shell -q "set parquet_file_size=10g; create table 59915_test stored as parquet as select * from sample_08;"

But table/folder is created as followings.
I think failed DDL should clean up table and its directory.

Terminal Log
–
[root@nightly-2 ~]# sudo -u impala impala-shell -q "set parquet_file_size=10g; create table 59915_test stored as parquet as select * from sample_08;"
Starting Impala Shell without Kerberos authentication
Connected to nightly-2.ent.cloudera.com:21000
Server version: impalad version 2.3.0-cdh5-INTERNAL RELEASE (build 03b1ea79d41c49617be46313ffe0f5f05b1b54f5)
PARQUET_FILE_SIZE set to 10g
Query: create table 59915_test stored as parquet as select * from sample_08
WARNINGS: Failed to open HDFS file for writing: hdfs://nightly-1.ent.cloudera.com:8020/user/hive/warehouse/59915_test/_impala_insert_staging/d945ce65feede9a4_355731418cd694b9//.d945ce65feede9a4-355731418cd694ba_1653921013_dir/d945ce65feede9a4-355731418cd694ba_1805782816_data.0.parq
Error(255): Unknown error 255
:
[nightly-2.ent.cloudera.com:21000] > select * from 59915_test;
Query: select * from 59915_test

Fetched 0 row(s) in 2.04s
–

Workaround
The workaround is to manually delete the extraneous table and the corresponding HDFS directory.