dbt-bigquery 1.3.0rc2

dbt-bigquery 1.3.0-rc2 - October 03, 2022

Features

• Migrate dbt-utils current_timestamp macros into core + adapters (#324, #323)

Contributors

• @colin-rogers-dbt (#323)

dbt-bigquery 1.3.0rc1

dbt-bigquery 1.3.0-rc1 - September 28, 2022

Features

• Add support for Dataproc Serverless (#248, #303)
• Array macros (#307, #308)
• add type_boolean as a data type macro (#315, #313)

Under the Hood

• Convert df to pyspark DataFrame if it is pandas before writing (#301, #301)
• Update BQ job and call retry settings (#311, #310)
• Enable pandas-on-Spark DataFrames for dbt python models (#316, #317)
• Convert df to pyspark DataFrame if it is koalas before writing (#320, #321)

Dependency

• Bump black from 22.6.0 to 22.8.0 (#254, #294)
• Bump mypy from 0.942 to 0.971 (#254, #296)

Contributors

• @chamini2 (#301)
• @colin-rogers-dbt (#310)
• @dbeatty10 (#308, #317, #321)
• @graciegoheen (#308)
• @jpmmcneill (#313)
• @ueshin (#321)

dbt-bigquery 1.3.0b2

dbt-bigquery 1.3.0-b2 - August 30, 2022

Under the Hood

• Add changie to dbt-bigquery (#254, #253)
• Add location/job_id/project_id to adapter response to enable easy job linking (#92, #250)
• Adding slot_ms go BigQueryAdapterResponse (#194, #195)
• specify supported_languages for materialization that support python models (#288, #290)

Contributors

• @Kayrnt (#250)
• @yu-iskw (#195)

dbt-bigquery 1.3.0b1

dbt-bigquery 1.3.0b1 (July 29, 2020)

Features

• Implement create_schema via SQL, instead of Python method, allowing users to override if desired. drop_schema remains a Python method for the time being. (#182, #183)
• Added table and incrementail materializations for python models via DataProc. (#209, #226)

Under the hood

• Implement minimal changes to support dbt Core incremental materialization refactor. (#232, #223)

dbt-bigquery 1.2.0

dbt-bigquery 1.2.0 (July 26, 2022)

Features

• Add grants to materializations (#198, #212)

Fixes

• Incorrect parameter is passed to the bq_insert_overwrite macro call (#172)
• Fix validate connection failing (#168)

Under the hood

• Modify BigQueryColumn.numeric_type to always exclude precision + scale, since the functionality of "parametrized data types on BigQuery is highly constrained (#214)
• Adding Python 3.10 testing and enabling mypy (#177)
• Lift and shift cross-database macros from dbt-utils (#192
• Implement TestDocsGenerateBigQuery test (#190)
• Init push for pytest conversion of override_database for bigquery (#165, #188)
• Add oauth test target as default (#166)

Contributors

• @robomill (#172)
• @dbeatty10 (#192

dbt-bigquery 1.2.0rc1

dbt-bigquery 1.2.0rc1 (June 12, 2022)

Features

• Add grants to materializations (#198, #212)

Under the hood

• Modify BigQueryColumn.numeric_type to always exclude precision + scale, since the functionality of "parametrized data types on BigQuery is highly constrained (#214)

dbt-bigquery 1.1.1

dbt-bigquery 1.1.1 (July 5, 2022)

Fixes

• Fixes regression in get_columns_in_relation when database is missing (#180, #165)

dbt-bigquery 1.2.0b1

dbt-bigquery 1.2.0b1 (June 24, 2022)

Fixes

• Incorrect parameter is passed to the bq_insert_overwrite macro call (#172)
• Fix validate connection failing (#168)

Under the hood

• Adding Python 3.10 testing and enabling mypy (#177)
• Lift and shift cross-database macros from dbt-utils (#192
• Implement TestDocsGenerateBigQuery test (#190)
• Init push for pytest conversion of override_database for bigquery (#165, #188)
• Add oauth test target as default (#166)

Contributors

• @robomill (#172)
• @dbeatty10 (#192)

dbt-bigquery 1.1.1rc1

dbt-bigquery 1.1.1rc1 (June 23, 2022)

Fixes

• Fixes regression in get_columns_in_relation when database is missing (#180, #165)

dbt-bigquery v1.1.0

dbt-bigquery 1.1.0 (April 28, 2022)

Features

• Provide a fine-grained control of the timeout and retry of BigQuery query with four new dbt profile configs: job_creation_timeout_seconds, job_execution_timeout_seconds, job_retry_deadline_seconds, and job_retries (#45, #50)
• Adds new integration test to check against new ability to allow unique_key to be a list. #112
• Added upload_file macro to upload a local file to a table. #102
• Add logic to BigQueryConnectionManager to add fuctionality for UPDATE and SELECT statements. #79

Fixes

• Restore default behavior for query timeout. Set default job_execution_timeout to None by default. Keep 300 seconds as query timeout where previously used.
• Fix test related to preventing coercion of boolean values (True, False) to numeric values (0, 1) in query results (#93)
• Add a check in get_table_options to check that the table has a partition_by in the config.
  This will prevent BigQuery from throwing an error since non-partitioned tables cannot have require_partition_filter (#107)
• Ignore errors of the lack of permissions in list_relations_without_caching (#104)

Under the hood

• Use dbt.tests.adapter.basic in tests (new test framework) (#135, #142)
• Adding pre-commit and black formatter hooks (#147)
• Adding pre-commit code changes (#148)
• Address BigQuery API deprecation warning and simplify usage of TableReference and DatasetReference objects (#97),(#98)
• Add contributing.md file for adapter repo #73
• Add stale messaging workflow to Github Actions #103
• Add unique_key to go in parity with unique_key as a list chagnes made in core #119
• Adding new Enviornment variable for integration testing puproses #116

Contributors

• @hui-zheng(#50)
• @oliverrmaa(#109)
• @yu-iskw(#108)
• @pgoslatara (#66)
• @drewmcdonald(#98)
• @rjh336(#79)