[DRILL-2293] CTAS does not clean up when it fails

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.10.0
• Component/s: Storage - Parquet
• Assignee: Khurram Faraaz
• Reporter: Rahul Kumar Challapalli
• Created: 24/Feb/15 19:23
• Updated: 23/Mar/17 05:01
• Resolved: 08/Mar/17 13:44

Description

git.commit.id.abbrev=6676f2d

Data Set :

{
  "id" : 1,
  "map":{"rm": [
    {"mapid":"m1","mapvalue":{"col1":1,"col2":[0,1,2,3,4,5]},"rptd": [{ "a": "foo"},{"b":"boo"}]},
    {"mapid":"m2","mapvalue":{"col1":0,"col2":[]},"rptd": [{ "a": "bar"},{"c":1},{"d":4.5}]}
  ]}
}

The below query fails :

create table rep_map as select d.map from `temp.json` d;
Query failed: Query stopped., index: -4, length: 4 (expected: range(0, 16384)) [ d76e3f74-7e2c-406f-a7fd-5efc68227e75 on qa-node190.qa.lab:31010 ]

However drill created a folder 'rep_map' and the folder contained a broken parquet file.

create table rep_map as select d.map from `temp.json` d;
+------------+------------+
|     ok     |  summary   |
+------------+------------+
| false      | Table 'rep_map' already exists. |

Drill should clean up properly in case of a failure.

I raised a different issue for the actual failure.

Issue Links

• duplicates: DRILL-5040 Interrupted CTAS should not succeed & should not create physical file on disk
• duplicates: DRILL-4956 Temporary tables support
• is related to: DRILL-1627 Writer needs to be transactional