[DRILL-2730] Use different paths for ExternalSort spill files

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.0
• Component/s: Execution - Relational Operators
• Assignee: Steven Phillips
• Reporter: Steven Phillips
• Created: 09/Apr/15 01:26
• Updated: 15/Apr/15 08:55
• Resolved: 15/Apr/15 08:55

Description

Currently, all of the spill files for a drillbit end up in the same directory (or directories if multiple are configured). There is no separation based on query or fragment. This makes it very difficult to explore the spill files via the filesystem.

We should create a directory structure that will organize the files more effectively, create a directory tree with query id, major fragment id, minor fragment id, and operator id.