Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3683

PySpark Hive query generates "NULL" instead of None

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Not A Problem
    • Affects Version/s: 1.1.0
    • Fix Version/s: None
    • Component/s: PySpark, SQL
    • Labels:
      None
    • Target Version/s:

      Description

      When I run a Hive query in Spark SQL, I get the new Row object, where it does not convert Hive NULL into Python None instead it keeps it string 'NULL'.

      It's only an issue with String type, works with other types.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                davies Davies Liu
                Reporter:
                jamborta Tamas Jambor
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: