Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-10101

Spark JDBC writer mapping String to TEXT or VARCHAR

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.4.1
    • 2.2.0
    • SQL
    • None

    Description

      Currently JDBC Writer maps String data type to TEXT on database but VARCHAR is ANSI SQL standard hence some of the old databases like Oracle, DB2, Teradata etc does not support TEXT as data type.

      Since VARCHAR needs max length to be specified and different databases support different max value, what will be the best way to implement.

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-10849 Allow user to specify database column type for data frame fields when writing data to jdbc data sources.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          New Feature - A new feature of the product, which has yet to be developed. SPARK-11300 Support for string length when writing to JDBC

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #8374 [Github] Pull Request #8374 (rama-mullapudi)

          Activity

            People

              Unassigned Unassigned
              rmullapudi Rama Mullapudi
              Votes:
              2 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: