Adding an instance variable _respIterator , so that response.iterator() isn't called multiple times
Fix for the infinite loop bug in KafkaETLContext.java
Just one thing's missing.
On line 201 (of original file):
_offset += msgAndOffset.offset();
That's incorrect. The msgAndOffset returns the offset, not the offset increment. So it should be:
_offset = msgAndOffset.offset();
Adding the fix for offsets (Line 201)
Great. I'm good with this patch.
Thanks Sam and Richard. I just committed this.
I just wanted to point out that this bug seems to happen whether kafka.request.limit is set to -1 or not.
The current 0.6 release that is available on the site is not very usable because of this bug...
The current trunk does fix this problem though, which is great. Thanks !
We have run into this as well Felix. I'd like to backport whatever change fixed this in trunk into our 0.6.1 branch. Any idea where I should look?
You could apply the attached patch (https://issues.apache.org/jira/secure/attachment/12493181/KAFKA-131.patch) to the file KafkaETLContext.java
Sorry I should have been more clear. We actually run into this issue not using the KafkaETL. We occasionally see regular consumers go into a loop (continue to fetch the same offset), I thought the comment from Felix was referring to that specifically.