[PARQUET-176] Parquet fails to parse schema contains '\r'

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.6.0
• Fix Version/s: 1.6.0
• Component/s: parquet-mr
• Assignee: Unassigned
• Reporter: Rekha Joshi
• Created: 02/Feb/15 23:44
• Updated: 23/Jun/24 03:27

Description

Parquet fails to parse schema contains '\r' for windows operating system.
at parquet.schema.MessageTypeParser.asRepetition(MessageTypeParser.java:203)
at parquet.schema.MessageTypeParser.addType(MessageTypeParser.java:101)
at parquet.schema.MessageTypeParser.addGroupTypeFields(MessageTypeParser.java:96)
at parquet.schema.MessageTypeParser.parse(MessageTypeParser.java:89)
at parquet.schema.MessageTypeParser.parseMessageType(MessageTypeParser.java:79)
at org.apache.spark.sql.parquet.ParquetTestData$.writeFile(ParquetTestData.scala:221)
at org.apache.spark.sql.parquet.ParquetQuerySuite.beforeAll(ParquetQuerySuite.scala:92)

Issue Links

• is required by: SPARK-5192 Parquet fails to parse schema contains '\r'