Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17967

Support for list or other types as an option for datasources

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • 2.0.0, 2.0.1
    • None
    • SQL
    • None

    Description

      This was discussed in SPARK-17878

      For other datasources, it seems okay with string/long/boolean/double value as an option but it seems it is not enough for the datasource such as CSV. As it is an interface for other external datasources, I guess it'd affect several ones out there.

      I took a look a first but it seems it'd be difficult to support this (need to change a lot).

      One suggestion is support this as a JSON array.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              gurwls223 Hyukjin Kwon
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: