[DRILL-1414] Offload fragment profile data to DFS rather than storing in ZooKeeper

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.6.0
• Assignee: Aditya Kishore
• Reporter: Jacques Nadeau
• Created: 12/Sep/14 16:26
• Updated: 08/Oct/14 11:55
• Resolved: 01/Oct/14 07:09

Description

PStores were really built for trivial configuration data, not large query profiles. As such, we should move to using the DFS for storage of query profiles when distributed mode.

Release Notes:-
By default, the blob data (hence the fragment profiles) are stored on the local file system under $DRILL_LOG_DIR folder, however this can be moved to DFS by specifying the target folder URL using "drill.exec.sys.store.provider.zk.blobroot" setting in Drill configuration.