Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: The persistKafkaKey parameter is not honoured when using JSON format #2088

Open
jayakumarc opened this issue Dec 30, 2024 · 0 comments · May be fixed by #2089
Open

[Bug]: The persistKafkaKey parameter is not honoured when using JSON format #2088

jayakumarc opened this issue Dec 30, 2024 · 0 comments · May be fixed by #2089
Labels
bug Something isn't working needs triage p2

Comments

@jayakumarc
Copy link

Related Template(s)

kafka-to-bigquery

Template Version

latest

What happened?

When executing the Kafka_to_BigQuery_Flex template with the parameters persistKafkaKey=true and messageFormat=JSON, the persistKafkaKey option is not honoured. As a result, the Kafka message key is not being persisted in BigQuery table as expected.

Relevant log output

No response
@jayakumarc jayakumarc added bug Something isn't working needs triage p2 labels Dec 30, 2024
jayakumarc added a commit to jayakumarc/DataflowTemplates that referenced this issue Dec 30, 2024
@jayakumarc
KafkaToBigQueryFlex template: Add support to persist Kafka keys for j…
9c480fe 
…son format

Fixes GoogleCloudPlatform#2088
@jayakumarc jayakumarc linked a pull request Dec 30, 2024 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working needs triage p2
Projects
None yet
Milestone
No milestone
1 participant
@jayakumarc