Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-2220

Startpoints - Fully encapsulate resolution of starting offsets in OffsetManager

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3
    • Component/s: None
    • Labels:
      None

      Description

      Currently when a startpoint is set, the consumers are registered with the offset of the startpoints. However, the TaskInstance offset caught up logic also needs to incorporate startpoints or else the incoming messages are ignored up until the checkpointed offset instead of the startpoint offset. The disconnect is because the resolution of the starting offsets from the OffsetManager is handled externally which leads to inconsistency of what the starting offset should be.

      This ticket is to fully encapsulate that logic in the OffsetManager.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                dnishimura Daniel Nishimura
                Reporter:
                dnishimura Daniel Nishimura
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1.5h
                  1.5h