Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-2730

Use different paths for ExternalSort spill files

    XMLWordPrintableJSON

    Details

      Description

      Currently, all of the spill files for a drillbit end up in the same directory (or directories if multiple are configured). There is no separation based on query or fragment. This makes it very difficult to explore the spill files via the filesystem.

      We should create a directory structure that will organize the files more effectively, create a directory tree with query id, major fragment id, minor fragment id, and operator id.

        Attachments

        1. DRILL-2730.patch
          4 kB
          Steven Phillips

          Activity

            People

            • Assignee:
              sphillips Steven Phillips
              Reporter:
              sphillips Steven Phillips
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: