Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17694

convert DataFrame to DataSet should check columns match

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Incomplete
    • 1.6.1, 1.6.2
    • None
    • SQL

    Description

      The as method, which converts a DataFrame to DataSet requires the user to ensure the columns are match. And it success even the columns do not match, and cause error at later steps.

      It would be better, to let as match the columns, and fail/warn when the match fails.

      Attachments

        Activity

          People

            Unassigned Unassigned
            luckyrand@gmail.com Chenliang Xu
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: