Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-2220

Startpoints - Fully encapsulate resolution of starting offsets in OffsetManager

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.3
    • None
    • None

    Description

      Currently when a startpoint is set, the consumers are registered with the offset of the startpoints. However, the TaskInstance offset caught up logic also needs to incorporate startpoints or else the incoming messages are ignored up until the checkpointed offset instead of the startpoint offset. The disconnect is because the resolution of the starting offsets from the OffsetManager is handled externally which leads to inconsistency of what the starting offset should be.

      This ticket is to fully encapsulate that logic in the OffsetManager.

      Attachments

        Issue Links

          Activity

            People

              dnishimura Daniel Nishimura
              dnishimura Daniel Nishimura
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1.5h
                  1.5h