Details
-
Improvement
-
Status: Open
-
P3
-
Resolution: Unresolved
-
2.4.0
-
None
-
None
Description
The documentation that is part of the code of TextIO has some usage examples.
The description of how to achieve custom naming with the new FileIO in combination with the TextIO could be improved as the code in the "Advanced Features" is not really fully fleshed out and probably not in sync with how it should be done in Beam 2.4.0.
See SO Question:
https://stackoverflow.com/questions/50930409/how-to-replace-withfilenamepolicy-in-apache-beam-2-4
The second part that could be improved is in the gcp.BigQueryIO class:
The example is also not fully fleshed out, but most importantly the
BigQueryIO.write() should be replaced with BigQueryIO.<Quote>write() as otherwise it won't compile.