[HIVE-27173] Add method for Spark to be able to trigger DML events

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-beta-1
• Labels: pull-request-available
• Assignee: Naveen Gangam
• Reporter: Naveen Gangam
• Created: 24/Mar/23 18:58
• Updated: 19/Jan/24 19:09
• Resolved: 10/Apr/23 14:36

Description

Spark currently uses Hive.java from Hive as a convenient way to hide from the having to deal with HMS Client and the thrift objects. Currently, Hive has support for DML events (being able to generate events on DML operations but does not expose a public method to do so). It has a private method that takes in Hive objects like Table etc. Would be nice if we can have something with more primitive datatypes.

Issue Links

• fixes: IMPALA-8518 Investigate support for insert events from SparkSQL
• links to: GitHub Pull Request #4201