Details
-
Wish
-
Status: Resolved
-
Minor
-
Resolution: Invalid
-
1.0.0
-
None
-
None
Description
At present only transformations can discard records returning null. But I think sometimes it would be nice to discard processing chain after converting message. For example I have some tags shipped with a message key and I want to stop processing the message after converting its key (there are a lot of messages and I don't want to deserialize message values that I don't need).
At the moment to do that I should disable converters and move message deserializing to the transformation chain:
key.converter=org.apache.kafka.connect.converters.ByteArrayConverter value.converter=org.apache.kafka.connect.converters.ByteArrayConverter transforms=proto,catalog transforms.proto.type=company.evo.kafka.ProtobufTransformation transforms.proto.key.protobuf.class=company.evo.uaprom.indexator.KeyProto$KeyMessage transforms.proto.value.protobuf.class=company.evo.uaprom.indexator.catalog.CompanyProto$UniversalCompanyMessage transforms.proto.tag=catalog
If WorkerSinkTask checked converted values on null it would solved my problem more gracefully