[SPARK-34768] Respect the default input buffer size in Univocity

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.2, 3.1.1
• Fix Version/s: 3.0.3, 3.1.2, 3.2.0
• Component/s: SQL
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 17/Mar/21 04:42
• Updated: 12/Dec/22 18:10
• Resolved: 17/Mar/21 10:58

Description

Currenty Univocity 2.9.1 faces a bug such as https://github.com/uniVocity/univocity-parsers/issues/449.

While this is a bug, another factor is that we don't respect Univocity's default value which makes Spark exposed to non-test coverage in Univocity.

We should resect Univocity's default input buffer value.

Issue Links

• links to: [Github] Pull Request #31858 (HyukjinKwon)