partition and offset

[darthmiguel]

I was able to capture the LPUSH command and obtain the value to put it on my kafka topic. The problem that I have now is: I stop the connector and when it resumes, it doesn't read from it left off.
So I can't read whatever data that was entered to redis while the connector was down.
Any ideas???

[Aegeaner]

In standalone mode, the offset is stored as a file in local filesystem. In distributed mode, the offset is stored in kafka topic. When the connector is up again, it will try to recover from last offset first.

[darthmiguel]

it doesn't work, I show you my worker.properties file
bootstrap.servers=localhost:9092
key.converter=org.apache.kafka.connect.json.JsonConverter
value.converter=org.apache.kafka.connect.json.JsonConverter
key.converter.schemas.enable=true
value.converter.schemas.enable=true
internal.key.converter=org.apache.kafka.connect.json.JsonConverter
internal.value.converter=org.apache.kafka.connect.json.JsonConverter
internal.key.converter.schemas.enable=false
internal.value.converter.schemas.enable=false
offset.storage.file.filename=/tmp/connect.offsets
offset.flush.interval.ms=10000

and the connector properties file
name=redis-source-connector
connector.class=org.apache.kafka.connect.redis.RedisSourceConnector
task.max=1
topic=redis

Am I doing something wrong?

[Aegeaner]

@darthmiguel check /tmp/connect.offsets to see if the offset is correctly written into file.

[darthmiguel]

��

[ghost]

Do you fix your probem？ I have the same one as you do @darthmiguel

[sirajjunior]

@sd1700092 @darthmiguel Did you find a solution to this?