You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@jklukas I think this issue is more akin to what you mentioned in #316. Long-term it would be lovely if we could do some integration tests on schema updates:
Validate some landfill data + validation data against the JSON schema
Generate Avro data using the ingestion Beam job
Check the schema update (as above)
Load the avro data into the updated BQ table
This is a long-term goal though and will eventually probably be it's own proposal. For now let's keep this as checking for BQ compatible schema updates only.
This is a bit of a difficult task, but the request is basically the following:
bq mk
)bq update
)None of these steps should fail, and the validation data should be fully accessible.
The text was updated successfully, but these errors were encountered: