[CAMEL-16307] azure-storage-datalake:...?operation=getFile appends newline to the file content

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.9.0
• Estimated Complexity: Unknown
• Assignee: Peter Palaga
• Reporter: Peter Palaga
• Created: 04/Mar/21 20:30
• Updated: 08/Mar/21 09:10
• Resolved: 08/Mar/21 09:10

Description

Originally found in Camel Quarkus https://github.com/apache/camel-quarkus/issues/2302

After asking about this on https://github.com/Azure/azure-sdk-for-java/issues/19612 it seems to be a feature rather than a bug. We are using DataLakeFileClient.openQueryInputStream() for something it was not designed for. Although there are other endpoints in the API that would allow to get the file without the newline appended, DataLakeFileClient.openQueryInputStream() seems to be the only one returning an InputStream. The others work with an OutputStream, etc. and so they'd require storing the whole file in memory or on disk, which would ineffective for us.

I am going to solve it via a custom InputStream that filters the last newline out.

Issue Links

• links to: GitHub Pull Request #5175