[DRILL-8241] Remove Deprecated JSON Reader

• Type: Improvement
• Status: Accepted
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.20.1
• Component/s: Storage - JSON
• Assignee: Unassigned
• Reporter: Charles Givre
• Created: 29/May/22 15:10
• Updated: 15/Feb/23 06:39

Description

This is a master ticket to remove the deprecated v1 JSON reader from Drill.  This JSON reader is used in several places and removing it will ensure consistent behavior across all data sources. 

The V2, EVF based JSON reader has several advantages, including the possibility of schema provisioning, limit pushdowns and others.

Here are the tasks which need to be completed to fully remove the v1 JSON reader.

• Complete DRILL-5955 which adds support for the UNION vector to the EVF Json reader.
• Convert the convert_fromJSON functions to V2 (DRILL-8239)
• Convert the Druid Storage Plugin to V2 (DRILL-8316)
• Convert MongoDB Storage Plugin to V2.  (Note the MongoDB plugin uses an EVF-based BSON reader as well as the V1 JSON reader)
• Remove all V1-based unit tests
• Migrate the JsonOptions from the HTTP Storage Plugin to global location to allow other plugins and users of JSON to set JSON configuration at a more granular level. (DRILL-8243)
• Remove extraneous configuration options.
• Bug fix HTTP UDFs (DRILL-8242)

Issue Links

• contains: DRILL-8242 Fix output for HttpHelperFunctions
• contains: DRILL-8316 Convert Druid Storage Plugin to EVF & V2 JSON Reader
• contains: DRILL-8239 Convert JSON UDF to EVF
• contains: DRILL-5955 Revisit Union Vectors
• contains: DRILL-8243 Move JSON Config Options Out of HTTP Plugin