Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Console strips unknown properties on /validate connectors call #1485

Open
tomasz-sadura opened this issue Oct 25, 2024 · 1 comment
Open

Comments

@tomasz-sadura
Copy link
Contributor

Use the following config for a connector (PostgreSQL Debezium):

{
    "connector.class": "io.debezium.connector.postgresql.PostgresConnector",
    "topic.prefix": "p1",
    "database.hostname": "xxx.eu-west-1.rds.amazonaws.com",
    "database.user": "postgres",
    "database.password": "xxx",
    "database.dbname": "postgres",
    "database.sslmode": "disable",
    "plugin.name": "pgoutput",
    "key.converter": "org.apache.kafka.connect.json.JsonConverter",
    "value.converter": "org.apache.kafka.connect.json.JsonConverter",
    "header.converter": "org.apache.kafka.connect.storage.SimpleHeaderConverter",
    "name": "debezium-postgresql-connector-1",
    "converters": "someConverter",
    "someConverter.type": "com.some.converter.debezium.SomeConverter",
    "someConverter.tables": "public.test_table",
    "someConverter.tables.public.test_table.columns": "tags,schedule"
}

The properties someConverter.* are dynamic based on the converters value. These properties are not send to Kafka Connect with the /validate call, causing the connector to be unable to valiidate the config, as the required converter properties (someConverter.type) are not given. The UI hangs and user cannot create the connector.

Expected behaviour:
All of the defined properties are sent with the /valdiate call.

@tomasz-sadura
Copy link
Contributor Author

Screenshot 2024-10-25 at 10 15 32 Screenshot 2024-10-25 at 10 15 57

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant