Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-11998

Portable runners should be able to issue checkpoints to Splittable DoFn

Details

    Description

      To execute unbounded Splittable DoFn over fnapi in streaming mode properly, portable runners should issue split(ProcessBundleSplitRequest with fraction_of_remainder > 0) or simply checkpoint(ProcessBundleSplitRequest with fraction_of_remainder == 0) to SDK regularly to make current bundle finished processing instead of running forever.

      Attachments

        1. read.png
          35 kB
          zhao

        Issue Links

          Activity

            People

              Unassigned Unassigned
              boyuanz Boyuan Zhang

              Dates

                Created:
                Updated:

                Slack

                  Issue deployment