Version 2.4.0

RELEASED

Start date not set

Released: 16/Dec/19

Release Notes

PTKeySummaryAssigneeStatus
BlockerImprovementKAFKA-8558KIP-479 - Add StreamJoined Overload to KStream#Join Bill BejeckResolved
BlockerSub-taskKAFKA-8603Document upgrade pathA. Sophie Blee-GoldmanResolved
BlockerBugKAFKA-8637WriteBatch objects leak off-heap memoryA. Sophie Blee-GoldmanResolved
BlockerBugKAFKA-8662Produce fails if a previous produce was to an unauthorized topicRajini SivaramResolved
BlockerBugKAFKA-8731InMemorySessionStore throws NullPointerException on startupA. Sophie Blee-GoldmanResolved
BlockerTaskKAFKA-8765Remove "unstable" annotationsMatthias J. SaxResolved
BlockerBugKAFKA-8943Move SecurityProviderCreator to a public packageManikumarResolved
BlockerNew FeatureKAFKA-8952Vulnerabilities found for jackson-databind-2.9.9Ismael JumaResolved
BlockerBugKAFKA-8972KafkaConsumer.unsubscribe could leave inconsistent user rebalance callback stateBoyang ChenResolved
BlockerBugKAFKA-8992Don't expose Errors in `RemoveMemberFromGroupResult`Boyang ChenResolved
BlockerTestKAFKA-9000Flaky Test KTableKTableForeignKeyJoinIntegrationTest.doLeftJoinFromRightThenDeleteRightEntityJohn RoeslerResolved
BlockerBugKAFKA-9029Flaky Test CooperativeStickyAssignorTest.testReassignmentWithRandomSubscriptionsAndChangesA. Sophie Blee-GoldmanResolved
BlockerBugKAFKA-9032Serializer is invoked with null when foreignValue=nullJohn RoeslerResolved
BlockerBugKAFKA-9046Connect worker configs require undocumented 'admin.' prefix to configure DLQ for connectorsChris EgertonResolved
BlockerBugKAFKA-9053AssignmentInfo#encode hardcodes the LATEST_SUPPORTED_VERSION A. Sophie Blee-GoldmanResolved
BlockerImprovementKAFKA-9058Foreign Key Join should not require a queriable storeJohn RoeslerResolved
BlockerBugKAFKA-9078System Test Failure: ConnectRestApiTestKonstantine KarantasisResolved
BlockerBugKAFKA-9080System Test Failure: MessageFormatChangeTest.testCompatibiltyTu TranResolved
BlockerBugKAFKA-9084AlterPartitionReassignments should not allow all replicas to be removedStanislav KozlovskiResolved
BlockerBugKAFKA-9133LogCleaner thread dies with: currentLog cannot be empty on an unexpected exceptionJason GustafsonResolved
BlockerBugKAFKA-9140Consumer gets stuck rejoining the group indefinitelyGuozhang WangResolved
BlockerBugKAFKA-9150DescribeGroup uses member assignment as metadataDavid JacotResolved
BlockerBugKAFKA-9156LazyTimeIndex & LazyOffsetIndex may cause niobufferoverflow in concurrent stateAlex MironovResolved
BlockerBugKAFKA-9175MirrorMaker 2 emits invalid topic partition metricsMickael MaisonResolved
BlockerBugKAFKA-9178restoredPartitions is not cleared until the last restoring task completesBoyang ChenResolved
BlockerBugKAFKA-9184Redundant task creation and periodic rebalances after zombie worker rejoins the groupKonstantine KarantasisResolved
BlockerBugKAFKA-9196Records exposed before advancement of high watermark after segment rollJason GustafsonResolved
BlockerBugKAFKA-9203kafka-client 2.3.1 fails to consume lz4 compressed topicIsmael JumaResolved
BlockerBugKAFKA-9212Keep receiving FENCED_LEADER_EPOCH while sending ListOffsetRequestJason GustafsonResolved
BlockerBugKAFKA-9231Streams Threads may die from recoverable errors with EOS enabledJohn RoeslerResolved
BlockerBugKAFKA-9258Connect ConnectorStatusMetricsGroup sometimes NPECyrus VafadariResolved
CriticalBugKAFKA-5998/.checkpoint.tmp Not found exceptionJohn RoeslerResolved
CriticalBugKAFKA-7921Instable KafkaStreamsTestUnassignedResolved
CriticalBugKAFKA-7937Flaky Test ResetConsumerGroupOffsetTest.testResetOffsetsNotExistingGroupBob BarrettResolved
CriticalBugKAFKA-8041Flaky Test LogDirFailureTest#testIOExceptionDuringLogRollBob BarrettResolved
CriticalBugKAFKA-8086Flaky Test GroupAuthorizerIntegrationTest#testPatternSubscriptionWithTopicAndGroupReadUnassignedResolved
CriticalBugKAFKA-8104Consumer cannot rejoin to the group after rebalancingNikolay IzhikovResolved
CriticalBugKAFKA-8602StreamThread Dies Because Restore Consumer is not Subscribed to Any TopicBruno CadonnaResolved
CriticalBugKAFKA-8649Error while rolling update from Kafka Streams 2.0.0 -> Kafka Streams 2.1.0A. Sophie Blee-GoldmanResolved
CriticalBugKAFKA-8671NullPointerException occurs if topic associated with GlobalKTable changesAlex LeungResolved
CriticalBugKAFKA-8736Performance: ThreadCache uses size() for empty cache checkMatthew JarvieResolved
CriticalBugKAFKA-8742Flaky Test RepartitionWithMergeOptimizingIntegrationTest#shouldSendCorrectResults_NO_OPTIMIZATIONA. Sophie Blee-GoldmanResolved
CriticalBugKAFKA-8743Flaky Test RepartitionWithMergeOptimizingIntegrationTest#shouldSendCorrectRecords_OPTIMIZEDA. Sophie Blee-GoldmanResolved
CriticalBugKAFKA-8748Flaky Test DescribeLogDirsRequestTest#testDescribeLogDirsRequestIsmael JumaResolved
CriticalBugKAFKA-8774Connect REST API exposes plaintext secrets in tasks endpoint if config value contains additional charactersArjun SatishResolved
CriticalBugKAFKA-8788Optimize client metadata handling with a large number of partitionsIsmael JumaResolved
MajorBugKAFKA-1714more better bootstrapping of the gradle-wrapper.jar Grant HenkeResolved
MajorImprovementKAFKA-2225Allow fetching from ISRParth BrahmbhattResolved
MajorNew FeatureKAFKA-3333Alternative Partitioner to Support "Always Round-Robin" partitioningM. MannaResolved
MajorNew FeatureKAFKA-3705Support non-key joining in KTableAdam BellemareResolved
MajorSub-taskKAFKA-4222Flaky Test QueryableStateIntegrationTest.queryOnRebalanceGuozhang WangResolved
MajorSub-taskKAFKA-4600Consumer proceeds on when ConsumerRebalanceListener failsGuozhang WangResolved
MajorBugKAFKA-5566Flaky Test QueryableStateIntegrationTest.shouldAllowToQueryAfterThreadDiedMatthias J. SaxResolved
MajorImprovementKAFKA-6263Expose metric for group metadata loading durationAnastasia VelaResolved
MajorBugKAFKA-6290Kafka Connect cast transformation should support logical typesNigel LiangResolved
MajorBugKAFKA-6605Flatten SMT does not properly handle fields that are nullMichal BorowieckiResolved
MajorImprovementKAFKA-6883KafkaShortnamer should allow to convert Kerberos principal name to upper case user nameManikumarResolved
MajorImprovementKAFKA-7018persist memberId for consumer restartBoyang ChenResolved
MajorImprovementKAFKA-7149Reduce assignment data size to improve kafka streams scalabilityVinoth ChandarResolved
MajorBugKAFKA-7157Connect TimestampConverter SMT doesn't handle null valuesValeria VasylievaResolved
MajorImprovementKAFKA-7190Under low traffic conditions purging repartition topics cause WARN statements about UNKNOWN_PRODUCER_ID Bob BarrettResolved
MajorImprovementKAFKA-7197Support Scala 2.13.0Dejan StojadinovićResolved
MajorBugKAFKA-7263Container exception java.lang.IllegalStateException: Coordinator selected invalid assignment protocol: nullUnassignedResolved
MajorImprovementKAFKA-7273Converters should have access to headers.Jeremy CustenborderResolved
MajorImprovementKAFKA-7335Store clusterId locally to ensure broker joins the right clusterDavid JacotResolved
MajorNew FeatureKAFKA-7471Multiple Consumer Group Management (Describe, Reset, Delete)Alex DunayevskyResolved
MajorNew FeatureKAFKA-7500MirrorMaker 2.0 (KIP-382)Ryanne DolanResolved
MajorImprovementKAFKA-7548KafkaConsumer should not throw away already fetched data for paused partitions.Sean GloverResolved
MajorNew FeatureKAFKA-7800Extend Admin API to support dynamic application log levelsStanislav KozlovskiResolved
MajorBugKAFKA-7912In-memory key-value store does not support concurrent access A. Sophie Blee-GoldmanResolved
MajorImprovementKAFKA-7981Add Replica Fetcher and Log Cleaner Count MetricsViktor Somogyi-VassResolved
MajorBugKAFKA-7990Flaky Test KafkaStreamsTest#shouldCleanupOldStateDirsGuozhang WangResolved
MajorBugKAFKA-7994Improve Partition-Time for rebalances and restartsRichard YuResolved
MajorBugKAFKA-8078Flaky Test TableTableJoinIntegrationTest#testInnerInnerBruno CadonnaResolved
MajorBugKAFKA-8106Reducing the allocation and copying of ByteBuffer when logValidator do validation.Flower.minResolved
MajorBugKAFKA-8122Flaky Test EosIntegrationTest#shouldNotViolateEosIfOneTaskFailsWithStateMatthias J. SaxResolved
MajorBugKAFKA-8146WARNING: An illegal reflective access operation has occurredUnassignedResolved
MajorImprovementKAFKA-8179Incremental Rebalance Protocol for Kafka ConsumerGuozhang WangResolved
MajorSub-taskKAFKA-8221Augment LeaveGroupRequest to batch operationBoyang ChenResolved
MajorBugKAFKA-8262Flaky Test MetricsIntegrationTest#testStreamMetricBruno CadonnaClosed
MajorBugKAFKA-8263Flaky Test MetricsIntegrationTest#testStreamMetricOfWindowStoreBruno CadonnaClosed
MajorNew FeatureKAFKA-8286KIP-460 Admin Leader Election RPCJose Armando Garcia SancioResolved
MajorImprovementKAFKA-8305AdminClient should support creating topics with default partitions and replication factorAlmog GavraResolved
MajorBugKAFKA-8319Flaky Test KafkaStreamsTest.statefulTopologyShouldCreateStateDirectoryGuozhang WangResolved
MajorSub-taskKAFKA-8331Add system test for enabling static membership on KStreamBoyang ChenResolved
MajorImprovementKAFKA-8333Load high watermark checkpoint only once when handling LeaderAndIsr requestsJason GustafsonResolved
MajorBugKAFKA-8340ServiceLoader fails when used from isolated plugin path directoryGreg HarrisResolved
MajorImprovementKAFKA-8345Create an Administrative API for Replica ReassignmentColin McCabeResolved
MajorSub-taskKAFKA-8355Add static membership to Range assignorBoyang ChenResolved
MajorSub-taskKAFKA-8390Replace CreateDelegationToken request/response with automated protocolMickael MaisonResolved
MajorBugKAFKA-8392Kafka broker leaks metric when partition leader moves to another node.Tu TranResolved
MajorImprovementKAFKA-8400Do not update follower replica state if the log read failedJason GustafsonResolved
MajorBugKAFKA-8427Error while cleanup under windows for EmbeddedKafkaClusterGuozhang WangResolved
MajorBugKAFKA-8442Inconsistent ISR output in topic command when using --bootstrap-serverhuxihxResolved
MajorNew FeatureKAFKA-8447New Metric to Measure Number of Tasks on a ConnectorUnassignedResolved
MajorBugKAFKA-8448Too many kafka.log.Log instances (Memory Leak)Justine OlshanResolved
MajorImprovementKAFKA-8452Possible Suppress buffer optimization: de-duplicate prior valueJohn RoeslerResolved
MajorBugKAFKA-8456Flaky Test StoreUpgradeIntegrationTest#shouldMigratePersistentWindowStoreToTimestampedWindowStoreUsingPapiMatthias J. SaxResolved
MajorBugKAFKA-8461Flakey test UncleanLeaderElectionTest#testUncleanLeaderElectionDisabledByTopicOverrideManikumarResolved
MajorSub-taskKAFKA-8471Replace control requests/responses with automated protocolIsmael JumaResolved
MajorBugKAFKA-8487Consumer should not resetGeneration upon REBALANCE_IN_PROGRESS in commit response handlerGuozhang WangResolved
MajorSub-taskKAFKA-8492Modify ConsumerCoordinator Algorithm with incremental protocol (part 2)Guozhang WangResolved
MajorSub-taskKAFKA-8493Add PartitionsLost API in RebalanceListener (part 3)Guozhang WangResolved
MajorSub-taskKAFKA-8496Add system test for compatibility and upgrade path (part 6)Bill BejeckResolved
MajorImprovementKAFKA-8501Remove key and value from exception messageCarlos Manuel Duclos VergaraResolved
MajorSub-taskKAFKA-8510Update StreamsPartitionAssignor to use the built-in owned partitions to achieve stickiness (part 7)A. Sophie Blee-GoldmanResolved
MajorBugKAFKA-8514Kafka clients should not include Scala's Java 8 compatibility libAlmog GavraResolved
MajorBugKAFKA-8523InsertField transformation fails when encountering tombstone eventUnassignedResolved
MajorBugKAFKA-8526Broker may select a failed dir for new replica even in the presence of other live dirsIgor SoarezResolved
MajorBugKAFKA-8530Consumer should handle authorization errors in OffsetFetchJason GustafsonResolved
MajorSub-taskKAFKA-8539Add `group.instance.id` to Subscription classBoyang ChenResolved
MajorImprovementKAFKA-8544Remove legacy kafka.admin.AdminClientIsmael JumaResolved
MajorImprovementKAFKA-8545Remove legacy ZkUtilsIsmael JumaResolved
MajorBugKAFKA-8550Connector validation fails with aliased convertersChris EgertonResolved
MajorImprovementKAFKA-8559PartitionStates.partitionStates cause array grow allocation. UnassignedClosed
MajorImprovementKAFKA-8560The Kafka protocol generator should support common structuresColin McCabeResolved
MajorSub-taskKAFKA-8578Add Functionality to Expose RocksDB MetricsBruno CadonnaClosed
MajorSub-taskKAFKA-8579Expose RocksDB Metrics to JMXBruno CadonnaClosed
MajorSub-taskKAFKA-8580Compute RocksDB MetricsBruno CadonnaResolved
MajorBugKAFKA-8586Source task producers silently fail to send recordsChris EgertonResolved
MajorImprovementKAFKA-8594Add Kafka Streams compatibility test for Kafka 2.3.0Matthias J. SaxResolved
MajorImprovementKAFKA-8595Support SerDe of Decimals in JSON that are not HEX encodedAlmog GavraResolved
MajorSub-taskKAFKA-8598Replace RenewDelegationToken request/response with automated protocolMickael MaisonResolved
MajorSub-taskKAFKA-8599Replace ExpireDelegationToken request/response with automated protocolMickael MaisonResolved
MajorSub-taskKAFKA-8600Replace DescribeDelegationToken request/response with automated protocolViktor Somogyi-VassResolved
MajorImprovementKAFKA-8601Producer Improvement: Sticky PartitionerJustine OlshanResolved
MajorSub-taskKAFKA-8609Add consumer metrics for rebalances (part 9)Guozhang WangResolved
MajorBugKAFKA-8615Change to track partition time breaks TimestampExtractorA. Sophie Blee-GoldmanResolved
MajorBugKAFKA-8620Race condition in StreamThread state changeBoyang ChenResolved
MajorImprovementKAFKA-8634Update ZooKeeper to 3.5.5Ismael JumaResolved
MajorBugKAFKA-8635Unnecessary wait when looking up coordinator before transactional requestBob BarrettResolved
MajorImprovementKAFKA-8644The Kafka protocol generator should allow null defaults for bytes and array fieldsColin McCabeResolved
MajorBugKAFKA-8670kafka-topics.sh shows IllegalArgumentException when describing all topics if no topics exist on the clusterTirtha ChatterjeeResolved
MajorImprovementKAFKA-8676Avoid Stopping Unnecessary Connectors and Tasks UnassignedResolved
MajorBugKAFKA-8688Upgrade system tests fail due to data loss with older message formatRajini SivaramResolved
MajorSub-taskKAFKA-8704Add PartitionAssignor adapter for backwards compatibilityA. Sophie Blee-GoldmanResolved
MajorImprovementKAFKA-8717Use cached hw/lso offset metadata when reading from logJason GustafsonResolved
MajorImprovementKAFKA-8725Improve LogCleaner error handling when failing to grab the filthiest logStanislav KozlovskiResolved
MajorImprovementKAFKA-8730Add API to delete consumer offsets (KIP-496)David JacotResolved
MajorImprovementKAFKA-8745DumpLogSegments doesn't show keys, when the message is nullJames ChengResolved
MajorBugKAFKA-8755Stand-by Task of an Optimized Source Table Does Not Write Anything to its State StoreChris PettittResolved
MajorSub-taskKAFKA-8760KIP-504: Add new Java Authorizer API Rajini SivaramResolved
MajorBugKAFKA-8782ReplicationQuotaManagerTest and ClientQuotaManagerTest should close Metrics objectIsmael JumaResolved
MajorBugKAFKA-8791RocksDBTimestampedStore should open in regular mode for new storesMatthias J. SaxResolved
MajorImprovementKAFKA-8792Default ZK configuration to disable AdminServerGwen ShapiraResolved
MajorBugKAFKA-8801electLeaderForPartitions redundancy for some success elect partitionsUnassignedResolved
MajorBugKAFKA-8802ConcurrentSkipListMap shows performance regression in cache and in-memory storeA. Sophie Blee-GoldmanResolved
MajorBugKAFKA-8804Internal Connect REST endpoints are insecureChris EgertonResolved
MajorBugKAFKA-8813Race condition when creating topics and changing their configurationVikas SinghResolved
MajorBugKAFKA-8816RecordCollector offsets updated indirectly by StreamTaskChris PettittResolved
MajorBugKAFKA-8817Flaky Test KafkaProducerTest.testCloseIsForcedOnPendingAddOffsetRequestGuozhang WangResolved
MajorBugKAFKA-8819Plugin path for converters not working as intendedGreg HarrisResolved
MajorBugKAFKA-8824InMemoryTimeOrderedKeyValueBuffer propagates nulls when supress is configured John RoeslerResolved
MajorBugKAFKA-8837Several integration tests incorrectly use verifyNonDaemonThreadsStatusAnastasia VelaResolved
MajorImprovementKAFKA-8839Improve logging in Kafka Streams around debugging task lifecycle Vinoth ChandarResolved
MajorSub-taskKAFKA-8848Update system test to use new authorizerRajini SivaramResolved
MajorImprovementKAFKA-8853Create sustained connections test for TrogdorScott HendricksResolved
MajorImprovementKAFKA-8855Collect and Expose Client's Name and Version in the BrokersDavid JacotResolved
MajorImprovementKAFKA-8856Add Streams Config for Backward-compatible MetricsBruno CadonnaResolved
MajorBugKAFKA-8857Config describe should not return isReadOnly=false based on synonymsRajini SivaramResolved
MajorImprovementKAFKA-8859Refactor Cache-level Streams MetricsBruno CadonnaResolved
MajorBugKAFKA-8860SslPrincipalMapper should handle distinguished names with spacesUnassignedResolved
MajorNew FeatureKAFKA-8865KIP-504: New Java Authorizer APIRajini SivaramResolved
MajorSub-taskKAFKA-8866Make Authorizer create/delete exceptions OptionalRajini SivaramResolved
MajorBugKAFKA-8875CreateTopic API should check topic existence before replication factorhuxihxResolved
MajorBugKAFKA-8878Flaky Test AssignedStreamsTasksTest#shouldCloseCleanlyWithSuspendedTaskAndEOSChris PettittResolved
MajorImprovementKAFKA-8880Augment Consumer.committed(partition) to allow multiple partitionsGuozhang WangResolved
MajorNew FeatureKAFKA-8885The Kafka Protocol should Support Optional Tagged FieldsColin McCabeResolved
MajorSub-taskKAFKA-8886Make Authorizer create/delete methods asynchronousRajini SivaramResolved
MajorSub-taskKAFKA-8887Use purgatory for CreateAcls and DeleteAcls if implementation is asyncRajini SivaramResolved
MajorBugKAFKA-8891invalid assignment protocol java.lang.IllegalStateException: Coordinator selected invalid assignment protocol: nullUnassignedResolved
MajorSub-taskKAFKA-8902Benchmark cooperative vs eager rebalancingJohn RoeslerResolved
MajorNew FeatureKAFKA-8907Return topic configs in CreateTopics response Rajini SivaramResolved
MajorBugKAFKA-8911Implicit TimeWindowedSerde creates Serde with null inner serializerMichałResolved
MajorSub-taskKAFKA-8932Add tag for TopicConfigErrorCode in CreateTopics response when KIP-482 is mergedRajini SivaramResolved
MajorImprovementKAFKA-8934Introduce Instance-level MetricsBruno CadonnaResolved
MajorSub-taskKAFKA-8942Document RocksDB metricsBruno CadonnaResolved
MajorBugKAFKA-8945Incorrect null check in the constructor for ConnectorHealth and AbstractStateChris EgertonResolved
MajorBugKAFKA-8947Connect framework incorrectly instantiates TaskStates for REST extensionsChris EgertonResolved
MajorBugKAFKA-8950KafkaConsumer stops fetchingUnassignedResolved
MajorImprovementKAFKA-8954Topic existence check is wrongly implemented in the DeleteOffset APIDavid JacotResolved
MajorBugKAFKA-8962KafkaAdminClient#describeTopics always goes through the controllerUnassignedResolved
MajorBugKAFKA-8983AdminClient deleteRecords should not fail all partitions unnecessarilyJason GustafsonResolved
MajorImprovementKAFKA-8985Use flexibleVersions with LeaderAndIsr, UMR, etc., and improve RequestResponseTest coverageJason GustafsonResolved
MajorBugKAFKA-9003Flaky Test RepartitionOptimizingIntegrationTest#shouldSendCorrectRecords_OPTIMIZEDA. Sophie Blee-GoldmanResolved
MajorBugKAFKA-9014AssertionError thrown by SourceRecordWriteCounter when SourceTask.poll returns an empty listKonstantine KarantasisResolved
MajorImprovementKAFKA-9020Streams sub-topologies should be sorted by sink -> source relationshipA. Sophie Blee-GoldmanResolved
MajorBugKAFKA-9030Document Instance-level MetricsBruno CadonnaResolved
MajorImprovementKAFKA-9033Change default client-id in consumer / producer to be more meaningfulJason GustafsonResolved
MajorImprovementKAFKA-9038Allow creating partitions while partition reassignment is in progressUnassignedResolved
MajorBugKAFKA-9069Flaky Test AdminClientIntegrationTest.testCreatePartitionshuxihxResolved
MajorTaskKAFKA-9072Add Section to Streams Developer Guide for Topology Naming (KIP-307)Bill BejeckResolved
MajorBugKAFKA-9073Kafka Streams State stuck in rebalancing after one of the StreamThread encounters java.lang.IllegalStateException: No current assignment for partitionGuozhang WangResolved
MajorBugKAFKA-9079System Test Failure: TransactionsTestJason GustafsonResolved
MajorBugKAFKA-9089Reassignment should be resilient to unexpected errorsJason GustafsonResolved
MajorTestKAFKA-9123Add system test with large number of partitionsDavid ArthurResolved
MajorBugKAFKA-9171DelayedFetch completion may throw exception, causing successful produce to be failedRajini SivaramResolved
MajorTestKAFKA-9187kafka.api.SaslGssapiSslEndToEndAuthorizationTest.testNoDescribeProduceOrConsumeWithoutTopicDescribeAclUnassignedReopened
MajorBugKAFKA-9190Server leaves connections with expired authentication sessions open Ron DagostinoResolved
MajorBugKAFKA-9198StopReplica handler should complete pending purgatory operationsJason GustafsonResolved
1200 of 242