XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.6.0
    • Fix Version/s: None
    • Component/s: container
    • Labels:
      None

      Description

      While investigating SAMZA-142, it became clear that the getLastOffsets and getPartitions APIs in SystemAdmin are insufficient.

      Samza currently wants to know four things:

      1. Partition count for each stream it's reading from.
      2. Offset of the oldest message in the stream. This is useful to fully read a changelog.
      3. Offset of the newest message in the stream. This is useful when checking of we've finished bootstrapping a stream in the DefaultChooser.
      4. Offset of the "future" message in the stream. This is useful when a job wishes to start reading from "realtime", and skip all older messages.

      In addition, (2) is useful in cases where a job wishes to start reading input topics from the oldest message in the stream (the opposite (4)).

        Attachments

        1. SAMZA-147.0.patch
          73 kB
          Chris Riccomini
        2. SAMZA-147.0.patch
          61 kB
          Chris Riccomini
        3. SAMZA-147.1.patch
          74 kB
          Chris Riccomini

          Activity

            People

            • Assignee:
              criccomini Chris Riccomini
              Reporter:
              criccomini Chris Riccomini
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: