[SPARK-47218] XML: Ignore commented Row Tags in XML tokenizer

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Spark Core
• Labels: pull-request-available
• Assignee: Yousof Hosny
• Reporter: Yousof Hosny
• Created: 28/Feb/24 23:43
• Updated: 26/Apr/24 20:08
• Resolved: 01/Mar/24 00:54

Description

The following returns rows that was within comments:

{{}}

// BUG: rowTag in comment -- incorrectly processed display(spark.read.xml(write("""<root> <ROW><a>1</a></ROW> <!--<ROW><a>2</a></ROW>--> </root>""")))

{{}}

This has been reported before:!https://github.com/fluidicon.png!How to Ignore XML comments like this · Issue #208 · databricks/spark-xml
{{}}

Issue Links

• is duplicated by: SPARK-47219 XML: Ignore commented row tags in XML tokenizer
• links to: GitHub Pull Request #45325
• links to: GitHub Pull Request #45379