[SPARK-47371] XML: Ignore row tags in CDATA Tokenizer

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Yousof Hosny
• Reporter: Yousof Hosny
• Created: 13/Mar/24 00:28
• Updated: 19/Apr/24 00:11
• Resolved: 16/Apr/24 03:16

Description

The current parser does not recognize CDATA sections and thus will read row tags that are enclosed within a CDATA section. The expected behavior is for none of the following rows to be read, but they are all read. 

// BUG:  rowTag in CDATA section
val xmlString="""<?xml version="1.0" encoding="UTF-8" ?>
<test><![CDATA[
    <elem id="1" />
    <elem id="2" > </elem>
    <elem> <id>3</id> </elem>
]]>
</test>

 

Issue Links

• links to: GitHub Pull Request #45487
• links to: GitHub Pull Request #46121