[DRILL-7437] Storage Plugin for Generic HTTP REST API

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.17.0
• Fix Version/s: 1.18.0
• Labels: ready-to-commit
• Assignee: Charles Givre
• Reporter: Charles Givre
• Reviewer: Paul Rogers
• Created: 05/Nov/19 12:45
• Updated: 14/Apr/20 02:34
• Resolved: 14/Apr/20 02:33

Description

In many data analytic situations there is a need to obtain reference data which is volatile or hosted on a service with a REST API.  

For instance, consider the case of a financial dataset which you want to run a currency conversion.  Or in the security arena, an organization might have a service that returns network information about an IT asset.  The goal being to enable Drill to quickly incorporate external data that is only accessible via REST API. 

This plugin is not intended to be a substitute for dedicated storage plugins with systems that use a REST API, such as Apache Solr or ElasticSearch.  

This plugin is based on several projects that were posted on github but never completed or submitted to Drill.  Posted here for attribution:

• https://github.com/kevinlynx/drill-storage-http
• https://github.com/mayunSaicmotor/drill-storage-http

 

Issue Links

• incorporates: DRILL-7599 Move Function to Access Drill Temp Directory to Utility Library
• links to: GitHub Pull Request #1892