Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6695

Graceful shutdown removes spill directory before query finished

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.14.0
    • Fix Version/s: 1.17.0
    • Component/s: Execution - Flow
    • Labels:
      None

      Description

      Ran the following query from sqlline:

      select a.columns[0], b.columns[1], a.columns[2], b.columns[3], a.columns[4] from `test` a join `test` b on a.columns[0]=b.columns[0] and a.columns[4]=b.columns[4] order by a.columns[0] limit 1000;

      While the query was running, initiated a graceful shutdown from command line on the foreman node. The query failed with the following error message:

      Error: RESOURCE ERROR: Hash Join failed to open spill file: /tmp/drill/spill/248a054a-ee63-e795-a44e-d9205df8e9b8_HashJoin_3-2-0/spill7_outer
      Fragment 3:0

      Looks like somehow the spill directory gets deleted while query is still running when graceful_shutdown is initiated.

        Attachments

        1. drillbit.log
          65 kB
          Krystal

          Issue Links

            Activity

              People

              • Assignee:
                vdonapati Venkata Jyothsna Donapati
                Reporter:
                knguyen Krystal
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: