Step 1 of 4: Choose Issues

Cancel

T Patch Info Key Summary Assignee Reporter P Status Resolution Created Updated Due Development
Sub-task KAFKA-15442

KAFKA-7739 add document to introduce tiered storage feature and the usage

Luke Chen Luke Chen Major Resolved Fixed  
Sub-task KAFKA-15427

KAFKA-7739 Integration tests in TS test harness detect resource leaks

Christo Lolov Christo Lolov Blocker Resolved Fixed  
Sub-task KAFKA-15410

KAFKA-7739 Add functional integration tests with tiered storage

Kamal Chandraprakash Kamal Chandraprakash Blocker Resolved Fixed  
Sub-task KAFKA-15399

KAFKA-7739 Enable OffloadAndConsumeFromLeader test

Kamal Chandraprakash Kamal Chandraprakash Blocker Resolved Fixed  
Sub-task KAFKA-15352

KAFKA-7739 Ensure consistency while deleting the remote log segments

Christo Lolov Kamal Chandraprakash Blocker Resolved Fixed  
Sub-task KAFKA-15351

KAFKA-7739 Update log-start-offset after leader election for topics enabled with remote storage

Kamal Chandraprakash Kamal Chandraprakash Blocker Resolved Fixed  
Sub-task KAFKA-15329

KAFKA-7739 Make default `remote.log.metadata.manager.class.name` as topic based RLMM

Unassigned Luke Chen Blocker Resolved Fixed  
Sub-task KAFKA-15298

KAFKA-7739 Disable DeleteRecords on Tiered Storage topics

Christo Lolov Christo Lolov Major Resolved Won't Fix  
Sub-task KAFKA-15295

KAFKA-7739 Add config validation when remote storage is enabled on a topic

Kamal Chandraprakash Kamal Chandraprakash Major Resolved Fixed  
Sub-task KAFKA-15294

KAFKA-7739 Make remote storage related configs as public (i.e. non-internal)

Gantigmaa Selenge Luke Chen Blocker Resolved Fixed  
Sub-task KAFKA-15293

KAFKA-7739 Update metrics doc to add tiered storage metrics

Abhijeet Kumar Abhijeet Kumar Critical Resolved Fixed  
Sub-task KAFKA-15290

KAFKA-7739 Add support to onboard existing topics to tiered storage

Kamal Chandraprakash Kamal Chandraprakash Major Resolved Fixed  
Sub-task KAFKA-15267

KAFKA-7739 Cluster-wide disablement of Tiered Storage

Christo Lolov Christo Lolov Major Resolved Fixed  
Sub-task KAFKA-15261

KAFKA-7739 ReplicaFetcher thread should not block if RLMM is not initialized

Abhijeet Kumar Abhijeet Kumar Blocker Resolved Fixed  
Sub-task KAFKA-15260

KAFKA-7739 RLM Task should wait until RLMM is initialized before copying segments to remote

Abhijeet Kumar Abhijeet Kumar Blocker Resolved Fixed  
Sub-task KAFKA-15236

KAFKA-7739 Rename Remote Storage metrics to remove ambiguity

Abhijeet Kumar Abhijeet Kumar Minor Resolved Fixed  
Sub-task KAFKA-15181

KAFKA-7739 Race condition on partition assigned to TopicBasedRemoteLogMetadataManager

Abhijeet Kumar Jorge Esteban Quilcate Otoya Major Resolved Fixed  
Sub-task KAFKA-15176

KAFKA-7739 Add missing tests for remote storage metrics

Luke Chen Luke Chen Major Resolved Fixed  
Sub-task KAFKA-15168

KAFKA-7739 Handle overlapping remote log segments in RemoteLogMetadata cache

Kamal Chandraprakash Kamal Chandraprakash Major Resolved Fixed  
Sub-task KAFKA-15167

KAFKA-7739 Tiered Storage Test Harness Framework

Kamal Chandraprakash Kamal Chandraprakash Major Resolved Fixed  
Sub-task KAFKA-15157

KAFKA-7739 Print startup time for RemoteIndexCache

Lan Ding Divij Vaidya Major Resolved Fixed  
Sub-task KAFKA-15084

KAFKA-7739 Remove lock contention in RemoteIndexCache

Divij Vaidya Divij Vaidya Major Resolved Fixed  
Sub-task KAFKA-15083

KAFKA-7739 Passing "remote.log.metadata.*" configs into RLMM

Luke Chen Luke Chen Major Resolved Fixed  
Sub-task KAFKA-15066

KAFKA-7739 passing listener name config into TopicBasedRemoteLogMetadataManagerConfig

Luke Chen Luke Chen Major Resolved Fixed  
Sub-task KAFKA-15040

KAFKA-7739 segment copy to remote storage won't work in KRaft mode

Luke Chen Luke Chen Major Resolved Fixed  
Sub-task KAFKA-15037

KAFKA-7739 initialize unifiedLog with remoteStorageSystemEnable correctly

Luke Chen Luke Chen Major Resolved Fixed  
Sub-task KAFKA-14953

KAFKA-7739 Add metrics for tiered storage

Abhijeet Kumar Divij Vaidya Minor Resolved Fixed  
Sub-task KAFKA-14889

KAFKA-7739 RemoteLogManager - allow consumer fetch records from remote storage implementation

Satish Duggana Luke Chen Major Resolved Duplicate  
Sub-task KAFKA-14888

KAFKA-7739 RemoteLogManager - deleting expired/size breached log segments to remote storage implementation

Satish Duggana Luke Chen Major Resolved Fixed  
Sub-task KAFKA-14850

KAFKA-7739 Introduce InMemoryLeaderEpochCheckpoint to allow quick write/read

Luke Chen Luke Chen Major Resolved Fixed  
Sub-task KAFKA-14685

KAFKA-7739 TierStateMachine interface for building remote aux log

Matthew Wong Matthew Wong Major Resolved Fixed  
Sub-task KAFKA-14495

KAFKA-7739 Improve the RemoteIndexCacheTest

Luke Chen Luke Chen Major Resolved Fixed  
Sub-task KAFKA-14469

KAFKA-7739 Fix inconsistency in config name between code and KIP-405

Divij Vaidya Divij Vaidya Major Resolved Won't Fix  
Sub-task KAFKA-14466

KAFKA-7739 Refactor ClassLoaderAwareRemoteStorageManager.scala to ClassLoaderAwareRemoteStorageManager.java and move it to storage module.

Satish Duggana Satish Duggana Major Resolved Fixed  
Sub-task KAFKA-13369

KAFKA-7739 Follower fetch protocol enhancements for tiered storage.

Satish Duggana Satish Duggana Major Resolved Fixed  
Sub-task KAFKA-13097

KAFKA-7739 Handle the requests gracefully to publish the events in TopicBasedRemoteLogMetadataManager when it is not yet initialized.

Abhijeet Kumar Satish Duggana Major Resolved Invalid  
Sub-task KAFKA-12988

KAFKA-7739 Change RLMM add/updateRemoteLogSegmentMetadata and putRemotePartitionDeleteMetadata APIS asynchronous.

Satish Duggana Satish Duggana Major Resolved Fixed  
Sub-task KAFKA-12970

KAFKA-7739 Make tiered storage related schemas adopt flexible versions feature.

Satish Duggana Satish Duggana Major Resolved Fixed  
Sub-task KAFKA-12969

KAFKA-7739 Add cluster or broker level config for topic level tiered storage confgs.

Kamal Chandraprakash Satish Duggana Major Resolved Fixed  
Sub-task KAFKA-12816

KAFKA-7739 Add tier storage configs.

Satish Duggana Satish Duggana Major Resolved Fixed  
Sub-task KAFKA-12802

KAFKA-7739 Add a file based cache for consumed remote log metadata for each partition to avoid consuming again incase of broker restarts.

Satish Duggana Satish Duggana Major Resolved Fixed  
Sub-task KAFKA-12458

KAFKA-7739 Implementation of Tiered Storage Integration with Azure Storage (ADLS + Blob Storage)

Israel Ekpo Israel Ekpo Major Resolved Won't Do  
Sub-task KAFKA-12429

KAFKA-7739 Serdes for all message types in internal topic which is used in default implementation for RLMM.

Satish Duggana Satish Duggana Major Resolved Fixed  
Sub-task KAFKA-12368

KAFKA-7739 Inmemory implementation of RSM and RLMM.

Satish Duggana Satish Duggana Major Resolved Fixed  
Sub-task KAFKA-9990

KAFKA-7739 Supporting transactions in tiered storage

Satish Duggana Satish Duggana Major Resolved Fixed  
Sub-task KAFKA-9579

KAFKA-7739 Remote consumer fetch implementation by adding respective purgatory

Satish Duggana Satish Duggana Major Resolved Fixed  
Sub-task KAFKA-9569

KAFKA-7739 RemoteStorageManager implementation for HDFS storage.

Ying Zheng Satish Duggana Major Resolved Fixed  
Sub-task KAFKA-9565

KAFKA-7739 Implementation of Tiered Storage SPI to integrate with S3

Ivan Yurchenko Alexandre Dupriez Major Resolved Won't Fix  
Sub-task KAFKA-9564

KAFKA-7739 Integration Test framework for Tiered Storage

Alexandre Dupriez Alexandre Dupriez Major Resolved Fixed  
Sub-task KAFKA-9555

KAFKA-7739 Topic-based implementation for the RemoteLogMetadataManager

Satish Duggana Alexandre Dupriez Major Resolved Fixed 19/Feb/20
Sub-task KAFKA-9554

KAFKA-7739 Define the SPI for Tiered Storage framework

Satish Duggana Alexandre Dupriez Major Resolved Duplicate 02/Mar/20
Sub-task KAFKA-9550

KAFKA-7739 RemoteLogManager - copying eligible log segments to remote storage implementation

Satish Duggana Satish Duggana Major Resolved Fixed  
Sub-task KAFKA-9549

KAFKA-7739 Local storage implementations for RSM which can be used in tests

Alexandre Dupriez Satish Duggana Major Resolved Fixed 19/Feb/20
Sub-task KAFKA-9548

KAFKA-7739 SPI - RemoteStorageManager and RemoteLogMetadataManager interfaces and related classes.

Satish Duggana Satish Duggana Major Resolved Fixed  

Cancel