Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6552

Drill Metadata management "Drill Metastore"

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: In Progress
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.13.0
    • Fix Version/s: 1.17.0
    • Component/s: Metadata
    • Labels:

      Description

      It would be useful for Drill to have some sort of metastore which would enable Drill to remember previously defined schemata so Drill doesn’t have to do the same work over and over again.

      It allows to store schema and statistics, which will allow to accelerate queries validation, planning and execution time. Also it increases stability of Drill and allows to avoid different kind if issues: "schema change Exceptions", "limit 0" optimization and so on. 

      One of the main candidates is Hive Metastore.
      Starting from 3.0 version Hive Metastore can be the separate service from Hive server:
      https://cwiki.apache.org/confluence/display/Hive/AdminManual+Metastore+3.0+Administration

      Optional enhancement is storing Drill's profiles, UDFs, plugins configs in some kind of metastore as well.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                volodymyr Vova Vysotskyi
                Reporter:
                vitalii Vitalii Diravka
              • Votes:
                1 Vote for this issue
                Watchers:
                16 Start watching this issue

                Dates

                • Created:
                  Updated: