Minor Description
PhysicalFsWriter implementation works on the basis of a Path, but Flink's bulk writer based on stream.
In order to integrate with flink more elegantly, I think a constructor with stream parameter should be added to PhysicalFsWriter, as follows:
public PhysicalFsWriter(FSDataOutputStream stream, OrcFile.WriterOptions opts, WriterEncryptionVariant[] encryption){...}
Attachments
Issue Links
- links to