Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31936 Implement ScriptTransform in sql/core
  3. SPARK-32608

Script Transform DELIMIT value should be formatted

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.0.1, 3.1.0
    • Component/s: SQL
    • Labels:
      None

      Description

      For SQL

       

      SELECT TRANSFORM(a, b, c)
        ROW FORMAT DELIMITED
        FIELDS TERMINATED BY ','
        LINES TERMINATED BY '\n'
        NULL DEFINED AS 'null'
        USING 'cat' AS (a, b, c)
        ROW FORMAT DELIMITED
        FIELDS TERMINATED BY ','
        LINES TERMINATED BY '\n'
        NULL DEFINED AS 'NULL'
      FROM testData
      

      The correct 

      TOK_TABLEROWFORMATFIELD should be , nut actually  ','

      TOK_TABLEROWFORMATLINES should be \n  but actually '\n'

        Attachments

          Activity

            People

            • Assignee:
              angerszhuuu angerszhu
              Reporter:
              angerszhuuu angerszhu
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: