Details
-
Improvement
-
Status: Resolved
-
P2
-
Resolution: Duplicate
-
None
-
None
Description
The current TextIO supports:
- local file when using directly path like /path/to...
- Google Service file using path like gs:...
On the other hand, we have a contribution (from Tom) to support HDFS.
For an user perspective, it would be easier to use an unique IO supporting different protocol:
- file:
- gs:
- hdfs:
- mvn:
- ...
It would also be convenient to be able to combine protocols and eventually use a different coder (for instance xml:hdfs.
In that case, maybe I would make sense to rename TextIO as generic FileIO.
Thoughts ?
Attachments
Issue Links
- duplicates
-
BEAM-59 Switch from IOChannelFactory to FileSystems
- Resolved