Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-8386

DataFrame and JDBC regression

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 1.4.0
    • 1.4.2, 1.5.2, 1.6.0
    • SQL
    • None
    • RHEL 7.1

    Description

      I have an ETL app that appends to a JDBC table new results found at each run. In 1.3.1 I did this:

      testResultsDF.insertIntoJDBC(CONNECTION_URL, TABLE_NAME, false);

      When I do this now in 1.4 it complains that the "object" 'TABLE_NAME' already exists. I get this even if I switch the overwrite to true. I also tried this now:

      testResultsDF.write().mode(SaveMode.Append).jdbc(CONNECTION_URL, TABLE_NAME, connectionProperties);

      getting the same error. It works running the first time creating the new table and adding data successfully. But, running it a second time it (the jdbc driver) will tell me that the table already exists. Even SaveMode.Overwrite will give me the same error.

      Attachments

        Activity

          People

            huaxingao Huaxin Gao
            phaumer Peter Haumer
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: