Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28303

Support DELETE/UPDATE/MERGE Operations in DataSource V2

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 3.0.0
    • SQL
    • None

    Description

      Now many datasources (delta, jdbc, hive with transaction support, kudu, etc) supports deleting/updating data. It's necessary to add related APIs in the datasource V2 API sets.

      For example, we suggest add the below interface in V2 API,

      SupportsDelete.java
      public interface SupportsDelete {
        WriteBuilder delete(Filter[] filters); 
      }
      

      which can delete data by simple predicates (complicated cases like correlated subquery is not considered currently).

       

      Attachments

        Issue Links

        There are no Sub-Tasks for this issue.

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            xinxianyin Xianyin Xin
            xinxianyin Xianyin Xin
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment