Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2992

Add support for starting storm-kafka-client spout consumer at a specific timestamp

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Duplicate
    • 2.0.0
    • None
    • None
    • None

    Description

      The 0.10.1.0 KafkaConsumer has support for getting the offset corresponding to a given timestamp (the offsetsForTimes method). We could provide a new FirstPollOffsetStrategy to allow topologies to start consumption at a specific timestamp, instead of earliest or latest offset.

      Attachments

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. STORM-2720 Add timestamp based FirstPollOffsetStrategy in KafkaTridentSpoutOpaque

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. KAFKA-7187 offsetsForTimes in MockConsumer implementation

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Activity

            People

              jingc Jing Chen
              srdo Stig Rohde Døssing
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: