Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2590

KIP-28: Kafka Streams Checklist

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11.0.0
    • Component/s: streams
    • Labels:
      None

      Description

      This is an umbrella story for the processor client and Kafka Streams feature implementation.

        Attachments

        1.
        		 Remove Persistent Data before Restoringafter a Fault Sub-task Resolved Guozhang Wang
        2.
        		 Stop Writing the Change-log in store.put() / delete() for Non-transactional Store Sub-task Resolved Yasuhiro Matsuda
        3.
        		 KeyValueStores should not require use of the context's default serializers and deserializers Sub-task Resolved Randall Hauch
        4.
        		 Add a key-value store that is a fixed-capacity in-memory LRU cache Sub-task Resolved Randall Hauch
        5.
        		 Make KStream interfaces compatible with Java 8 java.util.function Sub-task Resolved Randall Hauch
        6.
        		 Add support for custom partitioner in sink nodes Sub-task Resolved Randall Hauch
        7.
        		 Incorporate the new consumer protocol with partition-group interface Sub-task Resolved Yasuhiro Matsuda
        8.
        		 Stateful operations in the KStream DSL layer Sub-task Resolved Guozhang Wang
        9.
        		 Avoid calling Consumer.poll(0) in each iteration Sub-task Resolved Yasuhiro Matsuda
        10.
        		 Make a task id be a composite id of a topic group id and a partition id Sub-task Resolved Yasuhiro Matsuda
        11.
        		 Make state stores first class citizens in the processor DAG Sub-task Resolved Yasuhiro Matsuda
        12.
        		 Make KStream processor names deterministic Sub-task Resolved Yasuhiro Matsuda
        13.
        		 initialize only the part of the topology relevant to the task Sub-task Resolved Yasuhiro Matsuda
        14.
        		 Distinguish metric names inside the sensor registry Sub-task Resolved Guozhang Wang
        15.
        		 Reduce stream task migrations and initialization costs Sub-task Resolved Yasuhiro Matsuda
        16.
        		 Add integration tests for Kafka Streams Sub-task Resolved Yasuhiro Matsuda
        17.
        		 Create / Update changelog topics upon state store initialization Sub-task Resolved Guozhang Wang
        18.
        		 Add standby tasks Sub-task Resolved Yasuhiro Matsuda
        19.
        		 add KTable Sub-task Resolved Yasuhiro Matsuda
        20.
        		 Add Simple Join API Sub-task Resolved Yasuhiro Matsuda
        21.
        		 KTable should send old values along with new values to downstreams Sub-task Resolved Yasuhiro Matsuda
        22.
        		 Add KStream-KStream window joins Sub-task Resolved Yasuhiro Matsuda
        23.
        		 Refactor MeteredXXStore Sub-task Resolved Guozhang Wang
        24.
        		 Add Demo Examples for Kafka Streams Sub-task Resolved Guozhang Wang
        25.
        		 KTable Aggregation Implementation Sub-task Resolved Guozhang Wang
        26.
        		 Windowed Stream Aggregation Implementation Sub-task Resolved Guozhang Wang
        27.
        		 KStream custom StreamPartitioner for windowed key Sub-task Resolved Yasuhiro Matsuda
        28.
        		 KStream DSL API Improvement Sub-task Resolved Guozhang Wang
        29.
        		 Exception Hierarchy for Streams Sub-task Resolved Guozhang Wang
        30.
        		 Add putIfAbsent function to KeyValueStore Sub-task Resolved Kim Christensen
        31.
        		 Rename KafkaStreaming to KafkaStreams Sub-task Resolved Guozhang Wang
        32.
        		 Improve error message in kstreams Sub-task Resolved Guozhang Wang
        33.
        		 Serializer/Deserializer Registration and Type inference Sub-task Resolved Yasuhiro Matsuda
        34.
        		 Add implicit unlimited windowed aggregation for KStream Sub-task Resolved Guozhang Wang
        35.
        		 Wait for producer message acks in StreamTask.commit() Sub-task Resolved Unassigned
        36.
        		 Race Condition for Repartition Topics Sub-task Resolved Unassigned
        37.
        		 need a way to specify the number of replicas for change log topics Sub-task Resolved Yasuhiro Matsuda
        38.
        		 Move co-partition checking to PartitionAssignor and auto-create internal topics Sub-task Resolved Guozhang Wang
        39.
        		 Unify ser/de pair classes into one serde class Sub-task Resolved Guozhang Wang
        40.
        		 Extract selector as a separate groupBy operator for KTable aggregations Sub-task Resolved Matthias J. Sax
        41.
        		 Add print and writeAsText functions to the Streams DSL Sub-task Resolved Bill Bejeck
        42.
        		 prefix job id to internal topic names Sub-task Resolved Yasuhiro Matsuda
        43.
        		 Add overloading functions for each operator not requiring serialization Sub-task Resolved Guozhang Wang
        44.
        		 Allow users to set key in KTable.toStream() and KStream Sub-task Resolved Bill Bejeck
        45.
        		 Document possible exception thrown in public APIs Sub-task Resolved Eno Thereska
        46.
        		 Add Javadoc for KTable (changelog stream) and KStream (record stream) Sub-task Resolved Matthias J. Sax
        47.
        		 Support regex topics in addSource() and stream() Sub-task Resolved Bill Bejeck
        48.
        		 Rename filterOut() to filterNot() to achieve better terminology Sub-task Resolved Andrea Cosentino
        49.
        		 Connect custom processors with the streams DSL Sub-task Resolved Unassigned
        50.
        		 Add customizable StreamPartition into #to functions of Streams DSL Sub-task Resolved Matthias J. Sax
        51.
        		 Finer Stream Flow Control Sub-task Resolved Unassigned
        52.
        		 Streams ProcessorContext should support forward() based on child name Sub-task Resolved Eno Thereska
        53.
        		 Changelog partition configured to enable log compaction Sub-task Resolved Eno Thereska
        54.
        		 Set curRecord in punctuate() functions Sub-task Resolved Guozhang Wang
        55.
        		 byte[] should not be used as Map key nor Set member Sub-task Resolved Guozhang Wang
        56.
        		 Add missing @returns tags for JavaDoc Sub-task Closed Matthias J. Sax
        57.
        		 Unify KStream and KTable API Sub-task Resolved Damian Guy
        58.
        		 Improve JavaDoc of public API Sub-task Resolved Matthias J. Sax
        59.
        		 Move WindowStoreUtils to package "internals" Sub-task Resolved Matthias J. Sax
        60.
        		 Add initial set of integration tests Sub-task Resolved Eno Thereska
        61.
        		 Allow for different "auto.offset.reset" strategies for different input streams Sub-task Resolved Bill Bejeck

          Activity

            People

            • Assignee:
              guozhang Guozhang Wang
              Reporter:
              guozhang Guozhang Wang
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: