Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25531 new write APIs for data source v2
  3. SPARK-26666

DataSourceV2: Add overwrite and dynamic overwrite.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.4.0
    • 3.0.0
    • SQL
    • None

    Description

      DataSourceV2 will support overwrite operations using the following two interfaces (from the write side design doc):

      public interface SupportsOverwrite extends WriteBuilder {
        WriteBuilder overwrite(Filter[] filters)
      }
      
      public interface SupportsDynamicOverwrite extends WriteBuilder {
        WriteBuilder overwriteDynamicPartitions()
      }
      

      Attachments

        Issue Links

          Activity

            People

              rdblue Ryan Blue
              rdblue Ryan Blue
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: