Hi,
I am trying to sink the data from kafka topic to Redis using redis self managed connector. GitHub - redis-field-engineering/redis-kafka-connect: Redis Kafka Connector (Source and Sink) by Redis. We are using ca certificate for authentication. how to pass ca certificate?
Below are the properties used.
apiVersion: platform.confluent.io/v1beta1
kind: Connector
metadata:
name: redis.connector.name
spec:
name: redis.connector.name
taskMax: 1
class: com.redis.kafka.connect.RedisSinkConnector
configs:
input.data.format: STRING
input.key.format: STRING
kafka.auth.mode: SERVICE_ACCOUNT
kafka.endpoint: SASL_SSL://bootstap_server
kafka.region: centralus
kafka.service.account.id: account-id
name: redis.connector.name
redis.host: “ip address”
redis.port: “host”
redis.password: null
redis.key.password: “”
redis.tls: “true”
redis.insecure: “true”
redis.key.file: “redis-certificate”
tasks.max: “1”
topics: topic-name
key.converter: org.apache.kafka.connect.storage.StringConverter
value.converter: org.apache.kafka.connect.storage.StringConverter
confluent.topic.replication.factor: “3”
confluent.topic.bootstrap.servers: bootstrap-server
confluent.topic.sasl.jaas.config: org.apache.kafka.common.security.plain.PlainLoginModule
required username=“{destination-ccloud-key}” password=“{destination-ccloud-pass}”;
confluent.topic.security.protocol: SASL_SSL
confluent.topic.sasl.mechanism: PLAIN
https.ssl.protocol: TLSv1.2
We are getting below error:
java.lang.IllegalArgumentException: Key certificate file does not exist
at com.redis.kafka.connect.shaded.io.lettuce.core.internal.LettuceAssert.isTrue(LettuceAssert.java:222)
at com.redis.kafka.connect.shaded.io.lettuce.core.SslOptions$Builder.keyManager(SslOptions.java:336)
at com.redis.kafka.connect.shaded.com.redis.lettucemod.util.AbstractClientBuilder.lambda$sslOptions$0(AbstractClientBuilder.java:214)
at java.base/java.util.Optional.ifPresent(Optional.java:183)
at com.redis.kafka.connect.shaded.com.redis.lettucemod.util.AbstractClientBuilder.sslOptions(AbstractClientBuilder.java:214)
at com.redis.kafka.connect.shaded.com.redis.lettucemod.util.AbstractClientBuilder.configure(AbstractClientBuilder.java:205)
at com.redis.kafka.connect.shaded.com.redis.lettucemod.util.AbstractClientBuilder.client(AbstractClientBuilder.java:223)
at com.redis.kafka.connect.shaded.com.redis.lettucemod.util.ClientBuilder.build(ClientBuilder.java:24)
at com.redis.kafka.connect.common.RedisConfig.client(RedisConfig.java:84)
at com.redis.kafka.connect.common.RedisConfig.client(RedisConfig.java:88)
at com.redis.kafka.connect.sink.RedisSinkTask.start(RedisSinkTask.java:104)
at org.apache.kafka.connect.runtime.WorkerSinkTask.initializeAndStart(WorkerSinkTask.java:313)
at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:199)
at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:256)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)