Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6695

Graceful shutdown removes spill directory before query finished

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.14.0
    • None
    • Execution - Flow
    • None

    Description

      Ran the following query from sqlline:

      select a.columns[0], b.columns[1], a.columns[2], b.columns[3], a.columns[4] from `test` a join `test` b on a.columns[0]=b.columns[0] and a.columns[4]=b.columns[4] order by a.columns[0] limit 1000;

      While the query was running, initiated a graceful shutdown from command line on the foreman node. The query failed with the following error message:

      Error: RESOURCE ERROR: Hash Join failed to open spill file: /tmp/drill/spill/248a054a-ee63-e795-a44e-d9205df8e9b8_HashJoin_3-2-0/spill7_outer
      Fragment 3:0

      Looks like somehow the spill directory gets deleted while query is still running when graceful_shutdown is initiated.

      Attachments

        1. drillbit.log
          65 kB
          Krystal

        Issue Links

          Activity

            People

              vdonapati Venkata Jyothsna Donapati
              knguyen Krystal
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: