KAFKA: 0.8.0 - ASF JIRA

1–200 of 340View in Issue Navigator

Key	Summary	Assignee	Status
KAFKA-42	Support rebalancing the partitions with replication	Neha Narkhede	Closed
KAFKA-43	Rebalance to preferred broke with intra-cluster replication support	Neha Narkhede	Closed
KAFKA-325	revisit broker config in 0.8	Swapnil Ghike	Closed
KAFKA-344	migration tool from 0.7 to 0.8	Yang Ye	Closed
KAFKA-391	Producer request and response classes should use maps	Joel Jacob Koshy	Closed
KAFKA-408	ProducerPerformance does not work with all producer config options	Unassigned	Closed
KAFKA-463	log.truncateTo needs to handle targetOffset smaller than the lowest offset in the log	Swapnil Ghike	Closed
KAFKA-473	Use getMetadata Api in ZookeeperConsumerConnector	Yang Ye	Closed
KAFKA-490	Check max message size on server instead of producer	Swapnil Ghike	Closed
KAFKA-497	recover consumer during unclean leadership change	Unassigned	Closed
KAFKA-499	Refactor controller state machine	Neha Narkhede	Closed
KAFKA-500	javaapi support for getTopoicMetaData	Swapnil Ghike	Closed
KAFKA-501	getOfffset Api needs to return different latest offset to regular and follower consumers	Joel Jacob Koshy	Closed
KAFKA-508	split out partiondata from fetchresponse and producerrequest	Joe Stein	Closed
KAFKA-509	server should shut down on encountering invalid highwatermark file	Yang Ye	Closed
KAFKA-510	broker needs to know the replication factor per partition	Yang Ye	Closed
KAFKA-511	offset returned in Producer response may not be correct	Jun Rao	Closed
KAFKA-512	Remove checksum from ByteBufferMessageSet.iterator	Jay Kreps	Closed
KAFKA-513	Add state change log to Kafka brokers	Swapnil Ghike	Closed
KAFKA-514	Replication with Leader Failure Test: Log segment files checksum mismatch	Unassigned	Closed
KAFKA-525	newly created partitions are not added to ReplicaStateMachine	Unassigned	Closed
KAFKA-528	IndexOutOfBoundsException thrown by kafka.consumer.ConsumerFetcherThread	Jun Rao	Closed
KAFKA-539	Replica.hw should be initialized to the smaller of checkedpointed HW and log end offset	Unassigned	Closed
KAFKA-540	log.append() should halt on IOException	Jun Rao	Closed
KAFKA-545	Add a Performance Suite for the Log subsystem	Jay Kreps	Closed
KAFKA-557	Replica fetch thread doesn't need to recompute message id	Jay Kreps	Closed
KAFKA-567	Replication Data Loss in Mirror Maker Bouncing testcase	Jun Rao	Closed
KAFKA-575	Partition.makeFollower() reads broker info from ZK	Swapnil Ghike	Closed
KAFKA-578	Leader finder thread in ConsumerFetcherManager needs to handle exceptions	Unassigned	Closed
KAFKA-579	remove connection timeout in SyncProducer	Swapnil Ghike	Closed
KAFKA-580	system test testcase_0122 under replication fails due to large # of data loss	Jun Rao	Closed
KAFKA-592	Register metrics beans at kafka server startup	Swapnil Ghike	Closed
KAFKA-604	Add missing metrics in 0.8	Swapnil Ghike	Closed
KAFKA-608	getTopicMetadata does not respect producer config settings	Neha Narkhede	Closed
KAFKA-618	Deadlock between leader-finder-thread and consumer-fetcher-thread during broker failure	Unassigned	Closed
KAFKA-622	Create mbeans per client	Swapnil Ghike	Closed
KAFKA-646	Provide aggregate stats at the high level Producer and ZookeeperConsumerConnector level	Swapnil Ghike	Closed
KAFKA-648	Use uniform convention for naming properties keys	Sriram	Closed
KAFKA-664	Kafka server threads die due to OOME during long running test	Jay Kreps	Closed
KAFKA-669	Irrecoverable error on leader while rolling to a new segment	Neha Narkhede	Closed
KAFKA-681	Unclean shutdown testing - truncateAndStartWithNewOffset is not invoked when it is expected to	Jun Rao	Closed
KAFKA-695	Broker shuts down due to attempt to read a closed index file	Jun Rao	Closed
KAFKA-698	broker may expose uncommitted data to a consumer	Jay Kreps	Closed
KAFKA-699	Disallow clients to set replicaId in FetchRequest	Jun Rao	Closed
KAFKA-702	Deadlock between request handler/processor threads	Jay Kreps	Closed
KAFKA-708	ISR becomes empty while marking a partition offline	Neha Narkhede	Closed
KAFKA-726	Add ReplicaFetcherThread name to mbean names	Swapnil Ghike	Closed
KAFKA-732	MirrorMaker with shallow.iterator.enable=true produces unreadble messages	Jun Rao	Closed
KAFKA-738	correlationId is not set in FetchRequest in AbstractFetcherThread	Jun Rao	Closed
KAFKA-743	PreferredReplicaLeaderElectionCommand has command line error	Jun Rao	Closed
KAFKA-748	Append to index fails due to invalid offset	Jay Kreps	Closed
KAFKA-750	inconsistent index offset during broker startup	Jay Kreps	Closed
KAFKA-753	Kafka broker shuts down while loading segments	Sriram	Closed
KAFKA-755	standardizing json values stored in ZK	Swapnil Ghike	Closed
KAFKA-756	Processor thread blocks due to infinite loop during fetch response send	Sriram	Closed
KAFKA-757	System Test Hard Failure cases : "Fatal error during KafkaServerStable startup" when hard-failed broker is re-started	Swapnil Ghike	Closed
KAFKA-758	startHighWaterMarksCheckPointThread is never called	Sriram	Closed
KAFKA-762	Improve second replica assignment	Jun Rao	Closed
KAFKA-763	Add an option to replica from the largest offset during unclean leader election	Swapnil Ghike	Closed
KAFKA-767	Message Size check should be done after assigning the offsets	Sriram	Closed
KAFKA-768	broker should exit if hitting exceptions durin startup	Jun Rao	Closed
KAFKA-769	On startup, a brokers highwatermark for every topic partition gets reset to zero	Sriram	Closed
KAFKA-776	Changing ZK format breaks some tools	Swapnil Ghike	Closed
KAFKA-779	Standardize Zk data structures for Re-assign partitions and Preferred replication election	Swapnil Ghike	Closed
KAFKA-780	Reassign partitions tool produces NPE in shutdown handler	Sriram	Closed
KAFKA-785	Resolve bugs in PreferredReplicaLeaderElection admin tool	Sriram	Closed
KAFKA-786	Use "withRequiredArg" while parsing jopt options in all tools	Swapnil Ghike	Closed
KAFKA-793	Include controllerId in all requests sent by controller	Swapnil Ghike	Closed
KAFKA-798	Use biased histograms instead of uniform histograms in KafkaMetricsGroup	Swapnil Ghike	Closed
KAFKA-800	inSyncReplica in Partition needs some tweaks	Sriram	Closed
KAFKA-801	Fix MessagesInPerSec mbean to count uncompressed message rate	Jun Rao	Closed
KAFKA-804	Incorrect index in the log of a follower	Jun Rao	Closed
KAFKA-811	Fix clientId in migration tool	Swapnil Ghike	Closed
KAFKA-812	Support deep iteration in DumpLogSegments tool	Jun Rao	Closed
KAFKA-813	Minor cleanup in Controller	Swapnil Ghike	Closed
KAFKA-814	Controller should not throw exception when a preferred replica is already the leader for a partition	Sriram	Closed
KAFKA-825	KafkaController.isActive() needs to be synchronized	Jun Rao	Closed
KAFKA-826	Make Kafka 0.8 depend on metrics 2.2.0 instead of 3.x	Dragos Manolescu	Resolved
KAFKA-827	improve list topic output format	Jun Rao	Resolved
KAFKA-828	Preferred Replica Election does not delete the admin path on controller failover	Swapnil Ghike	Closed
KAFKA-830	partition replica assignment map in the controller should be a Set	Neha Narkhede	Closed
KAFKA-832	0.8 Consumer prevents rebalance if consumer thread is blocked or slow	Jun Rao	Closed
KAFKA-840	Controller tries to perform preferred replica election on failover before state machines have started up	Swapnil Ghike	Closed
KAFKA-846	AbstractFetcherThread should do shallow instead of deep iteration	Jun Rao	Closed
KAFKA-850	add an option to show under replicated partitions in list topic command	Jun Rao	Resolved
KAFKA-866	Recover segment does shallow iteration to fix index causing inconsistencies	Sriram	Resolved
KAFKA-871	Rename ZkConfig properties	Swapnil Ghike	Resolved
KAFKA-876	Produce request: Leader not local for partition [test,0] on broker 0	Neha Narkhede	Resolved
KAFKA-903	[0.8.0 - windows] FATAL - [highwatermark-checkpoint-thread1] (Logging.scala:109) - Attempt to swap the new high watermark file with the old one failed	Jun Rao	Resolved
KAFKA-920	zkclient jar 0.2.0 is not compatible with 0.1.0	Jun Rao	Resolved
KAFKA-941	Add Apache 2.0 license to missing code source files	Joe Stein	Resolved
KAFKA-942	the version of the jar should be 0.8.0-beta1 not 0.8.0-SNAPSHOT	Joe Stein	Resolved
KAFKA-953	Remove release-zip from README we are not releasing with it	Unassigned	Resolved
KAFKA-954	tidy up README file for better general availability	Jun Rao	Closed
KAFKA-956	High-level consumer fails to check topic metadata response for errors	Neha Narkhede	Closed
KAFKA-964	Default hadoop-producer configs to request.required.acks = 1	Swapnil Ghike	Resolved
KAFKA-1010	Concurrency issue in getCluster() causes rebalance failure and dead consumer	Sam Meder	Resolved
KAFKA-1029	Zookeeper leader election stuck in ephemeral node retry loop	Sam Meder	Resolved
KAFKA-1030	Addition of partitions requires bouncing all the consumers of that topic	Guozhang Wang	Resolved
KAFKA-215	Improve system tests for the mirroring code	Unassigned	Closed
KAFKA-305	SyncProducer does not correctly timeout	Prashanth Menon	Resolved
KAFKA-348	rebase 0.8 branch from trunk	Joe Stein	Resolved
KAFKA-586	system test configs are broken	John Fung	Closed
KAFKA-625	Improve MessageAndMetadata to expose the partition	Unassigned	Closed
KAFKA-673	Broker recovery check logic is reversed	Jay Kreps	Resolved
KAFKA-923	Improve controller failover latency	Neha Narkhede	Closed
KAFKA-938	High CPU usage when more or less idle	Unassigned	Resolved
KAFKA-944	the pom output from publish and publish-local is not accurate	Joe Stein	Resolved
KAFKA-946	Kafka Hadoop Consumer fails when verifying message checksum	Sam Meder	Closed
KAFKA-15	SBT release-zip target doesn't include bin and config directories anymore	Jun Rao	Closed
KAFKA-46	Commit thread, ReplicaFetcherThread for intra-cluster replication	Neha Narkhede	Resolved
KAFKA-49	Add acknowledgement to the produce request.	Prashanth Menon	Resolved
KAFKA-50	kafka intra-cluster replication support	Jun Rao	Resolved
KAFKA-77	Implement "group commit" for kafka logs	Jay Kreps	Resolved
KAFKA-81	wrong path in bin/kafka-run-class.sh	Unassigned	Resolved
KAFKA-100	ProducerShell should use high-level producer instead of SyncProducer	Unassigned	Closed
KAFKA-133	Publish kafka jar to a public maven repository	Unassigned	Resolved
KAFKA-134	Upgrade Kafka to sbt 0.11.3	Unassigned	Resolved
KAFKA-139	cross-compile multiple Scala versions and upgrade to SBT 0.12.1	Unassigned	Resolved
KAFKA-155	Support graceful Decommissioning of Broker	Unassigned	Resolved
KAFKA-171	Kafka producer should do a single write to send message sets	Jay Kreps	Resolved
KAFKA-176	Fix existing perf tools	Neha Narkhede	Resolved
KAFKA-181	Log errors for unrecognized config options	Jun Rao	Closed
KAFKA-187	Add Snappy Compression as a Codec and refactor CompressionUtil and option on startup to select what the default codec	Joe Stein	Resolved
KAFKA-188	Support multiple data directories	Jay Kreps	Closed
KAFKA-192	CompressionUtilTest does not run and fails when it does	Joe Stein	Resolved
KAFKA-193	use by name parameter helper for logging and trait to include lazy logging and refactor code to use the new LogHelper	Jay Kreps	Resolved
KAFKA-202	Make the request processing in kafka asynchonous	Neha Narkhede	Resolved
KAFKA-203	Improve Kafka internal metrics	Jun Rao	Closed
KAFKA-229	SimpleConsumer is not logging exceptions correctly so detailed stack trace is not coming in the logs	Jay Kreps	Resolved
KAFKA-233	The producer's load balancing logic can send requests to dead brokers, when using the async producer option	Unassigned	Closed
KAFKA-235	Add a 'log.file.age' configuration parameter to force rotation of log files after they've reached a certain age	Swapnil Ghike	Closed
KAFKA-237	create/delete ZK path for a topic in an admin tool	Jun Rao	Resolved
KAFKA-239	Wire existing producer and consumer to use the new ZK data structure	Neha Narkhede	Resolved
KAFKA-240	implement new producer and consumer request format	Unassigned	Resolved
KAFKA-246	log configuration values used	Unassigned	Closed
KAFKA-253	Refactor the async producer to have only one queue instead of one queue per broker in a Kafka cluster	Jun Rao	Resolved
KAFKA-258	Remove broker.id from the broker.list config in the Producer	Yang Ye	Resolved
KAFKA-267	Enhance ProducerPerformance to generate unique random Long value for payload	Yang Ye	Resolved
KAFKA-271	Modify new FetchResponse object to remove the initial offset field	Jay Kreps	Resolved
KAFKA-281	support multiple root log directories	Unassigned	Closed
KAFKA-285	Increase maximum value of log.retention.size	Unassigned	Closed
KAFKA-295	Bug in async producer DefaultEventHandler retry logic	Prashanth Menon	Resolved
KAFKA-296	Update Go Client to new version of Go	Unassigned	Resolved
KAFKA-306	broker failure system test broken on replication branch	John Fung	Resolved
KAFKA-317	Add support for new wire protocol to Go client	Unassigned	Closed
KAFKA-323	Add the ability to use the async producer in the Log4j appender	Jay Kreps	Resolved
KAFKA-324	enforce broker.id to be a non-negative integer	Swapnil Ghike	Closed
KAFKA-329	Remove the watches/broker for new topics and partitions and change create topic admin API to send start replica state change to all brokers	Prashanth Menon	Resolved
KAFKA-335	Implement an embedded controller	Yang Ye	Resolved
KAFKA-336	add an admin RPC to communicate state changes between the controller and the broker	Yang Ye	Resolved
KAFKA-337	upgrade ZKClient to allow conditional updates in ZK	Jun Rao	Resolved
KAFKA-338	controller failover	Yang Ye	Resolved
KAFKA-339	using MultiFetch in the follower	Jun Rao	Resolved
KAFKA-341	Create a new single host system test to validate all replicas on 0.8 branch	John Fung	Resolved
KAFKA-342	revisit the broker startup procedure according to V3 design	Yang Ye	Resolved
KAFKA-343	revisit the become leader and become follower state change operations using V3 design	Yang Ye	Resolved
KAFKA-349	Create individual "Response" types for each kind of request and wrap them with "BoundedByteBufferSend", remove "xxResponseSend" types for all requests except "FetchRequest"	Yang Ye	Resolved
KAFKA-351	Refactor some new components introduced for replication	Jun Rao	Resolved
KAFKA-352	Throw exception to client if it makes a produce/consume request to a Kafka broker for a topic that hasn't been created	Neha Narkhede	Resolved
KAFKA-356	Create a generic Kafka thread class that includes basic boiler plate code of instantiating and shutting down threads cleanly	Yang Ye	Closed
KAFKA-362	ZookeeperConsumerConnector needs to connect to new leader after leadership change	Jun Rao	Resolved
KAFKA-365	change copyright in NOTICE to 2012	Joe Stein	Resolved
KAFKA-366	add jmx beans in broker to track # bytes in consumer	Jun Rao	Resolved
KAFKA-367	StringEncoder/StringDecoder use platform default character set	Eli Reisman	Closed
KAFKA-368	use the pig core jar from maven instead of distributing it	Joe Stein	Resolved
KAFKA-369	remove ZK dependency on producer	Yang Ye	Resolved
KAFKA-370	Exception "java.util.NoSuchElementException: None.get" appears inconsistently in Mirror Maker log.	Jun Rao	Closed
KAFKA-371	Creating topic of empty string puts broker in a bad state	Jay Kreps	Resolved
KAFKA-376	expose different data to fetch requests from the follower replicas and consumer clients	Prashanth Menon	Closed
KAFKA-379	TopicCount.constructTopicCount isn't thread-safe	Jun Rao	Closed
KAFKA-380	Enhance single_host_multi_brokers test with failure to trigger leader re-election in replication	John Fung	Resolved
KAFKA-382	Write ordering guarantee violated	Jay Kreps	Resolved
KAFKA-385	RequestPurgatory enhancements - expire/checkSatisfy issue; add jmx beans	Joel Jacob Koshy	Closed
KAFKA-386	Race condition in accessing ISR	Unassigned	Closed
KAFKA-393	Add constructor for message which takes both byte array offset and length	Unassigned	Closed
KAFKA-396	Mirroring system test fails on 0.8	Joel Jacob Koshy	Resolved
KAFKA-412	deal with empty TopicData list in producer and fetch request	Jun Rao	Resolved
KAFKA-413	single_host_multi_brokers system test fails on laptop	John Fung	Resolved
KAFKA-415	Controller throws NoSuchElementException while marking a broker failed	Yang Ye	Closed
KAFKA-416	Controller tests throw several zookeeper errors	Yang Ye	Closed
KAFKA-417	NullPointerException in ZookeeperConsumerConnector	Jun Rao	Resolved
KAFKA-418	NullPointerException in ConsumerFetcherManager	Jun Rao	Closed
KAFKA-420	maintain HW correctly with only 1 replica in ISR	Jun Rao	Closed
KAFKA-422	LazyInitProducerTest has transient test failure	Unassigned	Closed
KAFKA-425	Wrong class name in performance test scripts	Jay Kreps	Resolved
KAFKA-427	LogRecoverTest.testHWCheckpointWithFailuresSingleLogSegment has transient failure	Yang Ye	Closed
KAFKA-428	need to update leaderAndISR path in ZK conditionally in ReplicaManager	Yang Ye	Closed
KAFKA-429	Expose JMX operation to set logger level dynamically	Unassigned	Closed
KAFKA-431	LogCorruptionTest.testMessageSizeTooLarge fails occasionally	Unassigned	Closed
KAFKA-433	ensurePartitionLeaderOnThisBroker should not access ZK	Jun Rao	Closed
KAFKA-434	IllegalMonitorStateException in ReplicaManager.makerFollower	Jun Rao	Closed
KAFKA-440	Create a regression test framework for distributed environment testing	John Fung	Resolved
KAFKA-452	follower replica may need to backoff the fetching if leader is not ready yet	Unassigned	Resolved
KAFKA-453	follower replica may need to backoff the fetching if leader is not ready yet	Unassigned	Closed
KAFKA-458	remove errorcode from ByteBufferMessageSet	Swapnil Ghike	Closed
KAFKA-459	KafkaController.RequestSendThread can throw exception on broker socket	Yang Ye	Closed
KAFKA-460	ControllerChannelManager needs synchronization btw shutdown and add/remove broker	Yang Ye	Closed
KAFKA-461	remove support for format for magic byte 0 in 0.8	Swapnil Ghike	Closed
KAFKA-464	KafkaController NPE in SessionExpireListener	Yang Ye	Closed

1–200 of 340