Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-5753

add basic support to JDBCRDD for postgresql types: uuid, hstore, and array

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.3.0
    • None
    • SQL
    • None

    Description

      I recently saw the new JDBCRDD merged into master. Thanks for that, it works pretty well and is really convenient.

      It would be nice if it could have basic support for a few more types.

      • uuid (as StringType)
      • hstore (as MapType). keys and values are both strings.
      • array (as ArrayType)

      I have a patch that gets started in this direction. Not sure where or how to write/run tests, but I ran manual tests in spark-shell against my postgres db.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              rickdn Ricky Nguyen
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: