Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22386 Data Source V2 improvements
  3. SPARK-23321

DataSourceV2 should apply some validation when writing.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • None
    • SQL
    • None

    Description

      DataSourceV2 writes are not validated. These writes should be validated using the standard preprocess rules that are used for Hive and DataSource tables.

      Attachments

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue SPARK-24251 DataSourceV2: Add AppendData logical operation

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #20488 [Github] Pull Request #20488 (rdblue)

          Web Link Background on using InsertIntoTable

          Activity

            People

              Unassigned Unassigned
              rdblue Ryan Blue
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: