Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-40956

SQL Equivalent for Dataframe overwrite command

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.2.2
    • 3.4.0
    • SQL
    • None

    Description

      Proposing syntax

       INSERT INTO tbl REPLACE whereClause identifierList

      to the spark SQL, as the equivalent of dataframe.overwrite() command. 

       

      For Example

       INSERT INTO table1 REPLACE WHERE key = 3 SELECT * FROM table2

      will, in an atomic operation, 1) delete rows with key = 3 and 2) insert rows from table2 

       

       

      Attachments

        Issue Links

          Activity

            People

              carlfu-db chengyan fu
              carlfu-db chengyan fu
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: