Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23061

Support default write mode, settable via spark config

    XMLWordPrintableJSON

Details

    • Brainstorming
    • Status: Resolved
    • Minor
    • Resolution: Incomplete
    • 2.1.0
    • None
    • ML, MLlib, SQL

    Description

      Especially when using libraries which internally use sparkdataframe.write, but also in general it would be helpful to be able to overwrite the default writing mode from "error" to for instance "overwrite" via a new spark config value

      Attachments

        Activity

          People

            Unassigned Unassigned
            stephansahm Stephan Sahm
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: