Skip to content

Commit

Permalink
Goldsky handling bug: Fixes handling cleaned working tables (#1346)
Browse files Browse the repository at this point in the history
Goldsky: handle clean up properly
  • Loading branch information
ravenac95 authored May 1, 2024
1 parent 1ad53d9 commit de40d65
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions warehouse/oso_dagster/goldsky.py
Original file line number Diff line number Diff line change
Expand Up @@ -378,12 +378,12 @@ def blocking_update_pointer_table(
dest_table_ref = client.get_dataset(
config.working_destination_dataset_name
).table(f"{config.destination_table_name}_{worker}")
new = latest_checkpoint is None
new = False
try:
client.get_table(dest_table_ref)
except NotFound as exc:
if latest_checkpoint is not None:
raise exc
# If the table doesn't exist just create it. An existing table will
# be there if a previous run happened to fail midway.
new = True

if not new:
Expand Down

0 comments on commit de40d65

Please sign in to comment.