Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-6591

Python data source load options should auto convert common types into strings

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Target Version/s:
    • Sprint:
      Spark 1.5 release

      Description

      See the discussion at : https://github.com/databricks/spark-csv/pull/39

      If the caller invokes

      sqlContext.load("com.databricks.spark.csv", path = "cars.csv", header = True)
      

      We should automatically turn header into "true" in string form.

      We should do this for booleans and numeric values.

      cc Yin Huai

        Attachments

          Activity

            People

            • Assignee:
              yijieshen Yijie Shen
              Reporter:
              rxin Reynold Xin
              Shepherd:
              Davies Liu

              Dates

              • Created:
                Updated:
                Resolved:

                Agile

                  Issue deployment