Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31936 Implement ScriptTransform in sql/core
  3. SPARK-32608

Script Transform DELIMIT value should be formatted

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.1, 3.1.0
    • SQL
    • None

    Description

      For SQL

       

      SELECT TRANSFORM(a, b, c)
        ROW FORMAT DELIMITED
        FIELDS TERMINATED BY ','
        LINES TERMINATED BY '\n'
        NULL DEFINED AS 'null'
        USING 'cat' AS (a, b, c)
        ROW FORMAT DELIMITED
        FIELDS TERMINATED BY ','
        LINES TERMINATED BY '\n'
        NULL DEFINED AS 'NULL'
      FROM testData
      

      The correct 

      TOK_TABLEROWFORMATFIELD should be , nut actually  ','

      TOK_TABLEROWFORMATLINES should be \n  but actually '\n'

      Attachments

        Activity

          People

            angerszhuuu angerszhu
            angerszhuuu angerszhu
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: