Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-14469

TestCheckpointing produces too many zero-length restrictions

Details

    • Improvement
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.40.0
    • sdk-go
    • None

    Description

      The TestCheckpointing integration test produces a large number of zero-length restrictions on split, leading to extremely verbose logging and errors when run on dataflow/with multiple runners. 

       

      This is tied to the offsetrange tracker producing zero-length restrictions on TrySplit() calls in edge cases. The unintended usage of the tracker in this streaming context creates this issue but did reveal that TrySplit() calls were not allowing nil primary returns, which could cause issues moving forward. 

      Attachments

        Activity

          People

            jrmccluskey Jack McCluskey
            jrmccluskey Jack McCluskey
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 3h 50m
                3h 50m