Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-6820

Convert NAs to null type in SparkR DataFrames

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 1.4.1, 1.5.0
    • SparkR
    • None

    Description

      While converting RDD or local R DataFrame to a SparkR DataFrame we need to handle missing values or NAs.
      We should convert NAs to SparkSQL's null type to handle the conversion correctly

      Attachments

        Activity

          People

            qhuang Qian Huang
            shivaram Shivaram Venkataraman
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: