Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6454

Native MapR DB plugin support for Hive MapR-DB json table

    Details

      Description

      Hive can create and query MapR-DB tables via maprdb-json-handler:
      https://maprdocs.mapr.com/home/Hive/ConnectingToMapR-DB.html

      The aim of this Jira to implement Drill native reader for Hive MapR-DB tables (similar to parquet).

      Design proposal is:

      • to use JsonTableGroupScan instead of HiveScan;
      • to add storage planning rule to convert HiveScan to MapRDBGroupScan;
      • to add system/session option to enable using of this native reader;
      • native reader can be used only for Drill build with mapr profile (there is no reason to leverage it for default profile);

       

      For documentation:
      two new options were added:
      store.hive.parquet.optimize_scan_with_native_reader: false,
      store.hive.maprdb_json.optimize_scan_with_native_reader: false,

      store.hive.parquet.optimize_scan_with_native_reader is new option used instead of store.hive.optimize_scan_with_native_readers. The latter is deprecated and will be removed in 1.15.
      (https://issues.apache.org/jira/browse/DRILL-6527).

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                vitalii Vitalii Diravka
                Reporter:
                vitalii Vitalii Diravka
                Reviewer:
                Gautam Parai
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: