[DRILL-6695] Graceful shutdown removes spill directory before query finished

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.14.0
• Component/s: Execution - Flow
• Assignee: Venkata Jyothsna Donapati
• Reporter: Krystal
• Created: 16/Aug/18 22:43
• Updated: 04/Nov/19 12:51

Description

Ran the following query from sqlline:

select a.columns[0], b.columns[1], a.columns[2], b.columns[3], a.columns[4] from `test` a join `test` b on a.columns[0]=b.columns[0] and a.columns[4]=b.columns[4] order by a.columns[0] limit 1000;

While the query was running, initiated a graceful shutdown from command line on the foreman node. The query failed with the following error message:

Error: RESOURCE ERROR: Hash Join failed to open spill file: /tmp/drill/spill/248a054a-ee63-e795-a44e-d9205df8e9b8_HashJoin_3-2-0/spill7_outer
Fragment 3:0

Looks like somehow the spill directory gets deleted while query is still running when graceful_shutdown is initiated.

Issue Links

• is related to: DRILL-6023 Graceful shutdown improvements (umbrella jira)