Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31241

Support Hive on DataSourceV2

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.1.0
    • Fix Version/s: None
    • Component/s: SQL
    • Labels:
      None

      Description

      There are 3 reasons why we need to support Hive on DataSourceV2.
      1. Hive itself is one of Spark data sources.
      2. HiveTable is essentially a FileTable with its own input and output
      formats, it works fine with FileTable.
      3. HiveTable should be stateless, and users can freely read or write Hive
      using batch or microbatch.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Jackey Lee Jackey Lee
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated: