Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6454

Native MapR DB plugin support for Hive MapR-DB json table

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      Hive can create and query MapR-DB tables via maprdb-json-handler:
      https://maprdocs.mapr.com/home/Hive/ConnectingToMapR-DB.html

      The aim of this Jira to implement Drill native reader for Hive MapR-DB tables (similar to parquet).

      Design proposal is:

      • to use JsonTableGroupScan instead of HiveScan;
      • to add storage planning rule to convert HiveScan to MapRDBGroupScan;
      • to add system/session option to enable using of this native reader;
      • native reader can be used only for Drill build with mapr profile (there is no reason to leverage it for default profile);

       

      For documentation:
      two new options were added:
      store.hive.parquet.optimize_scan_with_native_reader: false,
      store.hive.maprdb_json.optimize_scan_with_native_reader: false,

      store.hive.parquet.optimize_scan_with_native_reader is new option used instead of store.hive.optimize_scan_with_native_readers. The latter is deprecated and will be removed in 1.15.
      (https://issues.apache.org/jira/browse/DRILL-6527).

       

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              vitalii Vitalii Diravka
              Reporter:
              vitalii Vitalii Diravka
              Reviewer:
              Gautam Parai

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment