Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-4172

Make public FileSystem registry

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: P2
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.5.0
    • Component/s: sdk-go
    • Labels:

      Description

      https://github.com/apache/beam/blob/5743a37/sdks/go/pkg/beam/io/textio/filesystem.go

      The current beam/io/textio package includes a useful FileSystem interface and corresponding RegisterFileSystem function.  The textio package uses this internally to expose a Read(beam.Scope, string) function that will work for any file path corresponding to a registered FileSystem.

      It would be extremely useful to expose the FileSystem interface outside of just the textio package and add global analogs for each of the FileSystem interface functions using the registry.  This would allow for easier implementation of other file reading sources.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                schroederc Cody Schroeder
                Reporter:
                schroederc Cody Schroeder
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m