S3BufferedWriter(s) are to get over the inability of s3 to append, I do understand that. Considering sinks write to into storage those have inability to append.
Framework should introduce a semantic like this.
Channels only buffer, we should maintain that.
Channels may start supporting minimum batch size. Alternate to buffered writers in sinks.
Regards,
Nitin Verma
Nitin Verma
added a comment - Michael,
S3BufferedWriter(s) are to get over the inability of s3 to append, I do understand that. Considering sinks write to into storage those have inability to append.
Framework should introduce a semantic like this.
Channels only buffer, we should maintain that.
Channels may start supporting minimum batch size. Alternate to buffered writers in sinks.
Regards,
Nitin Verma
Assigning this to Michael K as he has already done some work in this regard.