[HADOOP-17945] JsonSerialization raises EOFException reading JSON data stored on google GCS

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.1
• Fix Version/s: 3.3.2
• Component/s: fs
• Labels: pull-request-available
• Target Version/s: 3.3.2
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 29/Sep/21 10:39
• Updated: 02/Nov/21 10:11
• Resolved: 02/Nov/21 10:11

Description

The JsonSerialization<> load code doesn't work on gcs as it uses "stream.available()" to fail with a meaningful message if the stream is empty.

But that method is meant to say how much data is available without blocking, something we actually get wrong ourselves. Google GCS team didn't get it wrong, so on a read(), if there's no local buffer, an EOFException is raised

Issue Links

• links to: GitHub Pull Request #3501