Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-59 Switch from IOChannelFactory to FileSystems
  3. BEAM-1065

FileBasedSource: replace SeekableByteChannel with open(spec, startingPosition)

Details

    • Sub-task
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • sdk-java-core

    Description

      FileBasedReader should be able to open the file with the Source.getStartOffset(), and then read forward to find the first input element.

      The benefits are:
      1. It is easier to implement a ReadableByteChannel.
      2. Dynamically splitting won't require file systems to support seeking.
      3. Doesn't need to seek to position twice, which is what current API does.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              peihe0@gmail.com Pei He
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: