Details
-
Improvement
-
Status: Open
-
P3
-
Resolution: Unresolved
-
2.16.0
-
None
-
None
Description
The default and max upload chunk size is 1M, in
This should be at least 8M to improve performance.
8m is the default python write chunk size
https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/gcp/gcsio.py#L86
Attachments
Issue Links
- links to