[KAFKA-12652] connector doesnt accept transformation configuration

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 2.7.0
• Component/s: connect
• Environment: ubuntu 20.04, strimzi
• Assignee: Unassigned
• Reporter: amit cahanovich
• Created: 11/Apr/21 08:43
• Updated: 11/Apr/21 08:43

Description

connector configuration:

spec:
class: io.confluent.connect.jdbc.JdbcSourceConnector
tasksMax: 2
config:
connection.url: ${file:/opt/kafka/external-configuration/connector-config/kafka_secrets.properties:stg2_CONNECTION_URL}
schema.pattern: ${file:/opt/kafka/external-configuration/connector-config/kafka_secrets.properties:stg2_SCHEMA_PATERN}
connection.user: ${file:/opt/kafka/external-configuration/connector-config/kafka_secrets.properties:stg2_CONNECTION_USER}
connection.password: ${file:/opt/kafka/external-configuration/connector-config/kafka_secrets.properties:stg2_CONNECTION_PASSWORD}
mode: bulk
validate.non.null: false
table.types: TABLE
table.whitelist: jms_lib_source_of_lighting
topic.creation.default.replication.factor: 1
topic.creation.default.partitions: 1
transforms: MakeMap, InsertSource
transforms.MakeMap.type: org.apache.kafka.connect.transforms.HoistField$Value
transforms.MakeMap.field: line
transforms.InsertSource.type: org.apache.kafka.connect.transforms.InsertField$Value
transforms.InsertSource.static.field: data_source
transforms.InsertSource.static.value: test-file-source

 

error:

value.converter = null
(org.apache.kafka.connect.runtime.SourceConnectorConfig$EnrichedSourceConnectorConfig) [StartAndStopExecutor-connect-1-2]
2021-04-11 08:37:40,735 ERROR Failed to start task jdbc-mssql-connectora-0 (org.apache.kafka.connect.runtime.Worker) [StartAndStopExecutor-connect-1-2]
org.apache.kafka.connect.errors.ConnectException: org.apache.kafka.common.config.ConfigException: Unknown configuration 'transforms.MakeMap.type'
at org.apache.kafka.connect.runtime.ConnectorConfig.transformations(ConnectorConfig.java:296)
at org.apache.kafka.connect.runtime.Worker.buildWorkerTask(Worker.java:605)
at org.apache.kafka.connect.runtime.Worker.startTask(Worker.java:555)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startTask(DistributedHerder.java:1251)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1700(DistributedHerder.java:127)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1266)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1262)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: org.apache.kafka.common.config.ConfigException: Unknown configuration 'transforms.MakeMap.type'
at org.apache.kafka.common.config.AbstractConfig.get(AbstractConfig.java:159)
at org.apache.kafka.connect.runtime.SourceConnectorConfig$EnrichedSourceConnectorConfig.get(SourceConnectorConfig.java:57)
at org.apache.kafka.connect.runtime.SourceConnectorConfig.get(SourceConnectorConfig.java:141)
at org.apache.kafka.common.config.AbstractConfig.getClass(AbstractConfig.java:216)
at org.apache.kafka.connect.runtime.ConnectorConfig.transformations(ConnectorConfig.java:281)
... 10 more