[SOLR-8593] Integrate Apache Calcite into the SQLHandler

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Resolved
• Fix Version/s: 6.5, 7.0
• Component/s: Parallel SQL
• Assignee: Joel Bernstein
• Reporter: Joel Bernstein
• Created: 25/Jan/16 14:09
• Updated: 23/Oct/21 02:26
• Resolved: 06/Mar/17 20:12

Description

The Presto SQL Parser was perfect for phase one of the SQLHandler. It was nicely split off from the larger Presto project and it did everything that was needed for the initial implementation.

Phase two of the SQL work though will require an optimizer. Here is where Apache Calcite comes into play. It has a battle tested cost based optimizer and has been integrated into Apache Drill and Hive.

This work can begin in trunk following the 6.0 release. The final query plans will continue to be translated to Streaming API objects (TupleStreams), so continued work on the JDBC driver should plug in nicely with the Calcite work.

Issue Links

• depends upon: SOLR-10094 /export handler (master only) loses the sort deep into the result set
• depends upon: CALCITE-1547 Release Calcite 1.11.0
• depends upon: SOLR-9066 Make CountMetric return long instead of double
• is depended upon by: SOLR-10016 SQL should support sorting by random_<SEED>
• is depended upon by: SOLR-10171 Add Constant Reduction Rules to Calcite Planner
• is depended upon by: SOLR-9963 Add Apache Calcite Avatica handler to Solr
• is related to: SOLR-8847 SolrJ JDBC - Implement "Select *"
• is related to: SOLR-9078 Let Parallel SQL support offset or start
• is related to: CALCITE-1667 Forbid calls to JDK APIs that use the default locale, time zone or character set
• is related to: SOLR-10353 TestSQLHandler reproducible failure: No match found for function signature min(<NUMERIC>)
• is related to: SOLR-10260 Collection not found with count(*) and uppercase name
• is related to: SOLR-8125 Umbrella ticket for Streaming and SQL issues
• is related to: SOLR-8659 Improve Solr JDBC Driver to support more SQL Clients
• is related to: SOLR-8502 Improve Solr JDBC Driver to support SQL Clients like DBVisualizer
• relates to: CALCITE-1222 DatabaseMetaData.getColumnLabel returns null when query has ORDER BY
• relates to: SOLR-8613 SolrJ JDBC - SQL queries with limit do not fail when a bad column is provided
• relates to: SOLR-8571 Wire the ConcatOperation into the SQLhandler
• relates to: CALCITE-1224 Provide non-shaded and shaded variants of Avatica artifacts
• supercedes: SOLR-8847 SolrJ JDBC - Implement "Select *"
• supercedes: SOLR-8815 SolrJ JDBC - DBVisualizer DB Capabilities
• supercedes: SOLR-8816 SolrJ JDBC - DbVisualizer Database Info Keywords and Functions
• supercedes: SOLR-8817 SolrJ JDBC - DbVisualizer info about data types
• supercedes: SOLR-8661 Upgrade guava version to 18.0 due to Presto dependency
• links to: GitHub Pull Request #104