v1.7.14

Note: user configurable OAuth scopes currently only work for AWS, as the Databricks SDK does not let us override them for Azure. I'm working with the owning team to get that addressed.

What's Changed

• FIX #582: User Configurable OAuth Scopes in profiles.yml by @stevenayers in #641
• Fixing idle issue and improving debug logging by @benc-db in #648

New Contributors

• @stevenayers made their first contribution in #641

Full Changelog: v1.7.13...v1.7.14

v1.7.13

What's Changed

• Up default socket timeout to 600 by @benc-db in #625
• Expose oauth redirect url for user config by @benc-db (thanks to the users that pushed me to get this done) in #635
• Support tblproperties (weakly) in python models by @benc-db in #633

Notes

• v1.7.12 had to be yanked after I found another piece of oauth code that needed to be updated
• oauth_redirect_url in your profile can now be used to override the redirect url (to solve the issue where we assume port 8020 vs 8050)
• tblproperties can now be applied to python models, but they are applied as an ALTER. This means they can be used to annotate your table, but are unlikely to work if you're trying to enable some sophisticated Databricks use case with them. I tried a number of ways to get them applied at table creation, none of which worked; hopefully at some point in the future we can get this fully working.

Full Changelog: v1.7.11...v1.7.13

v1.7.11

What's Changed

• When making catalog, don't populate column comments from Databricks (too slow) by @benc-db in #618

Full Changelog: v1.7.10...v1.7.11

v1.7.10

What's Changed

• Prefer DEFAULT to NULL when inserting into, actually validate append by @benc-db in #607
• Fix tests that were leaving schemas behind by @benc-db in #613
• Revert persist doc behavior to 1.6.x to improve performance (thanks @mikealfare) in #616

Full Changelog: v1.7.9...v1.7.10

v1.8.0b2

This release exists for dbt Labs to test compatibility with 1.8.0 changes. Of note, with this release you will need to pip install dbt-core==1.8.0b1 alongside this library in order to run dbt. This is consistent with the expected behavior for 1.8.0.

What's Changed

• Merged in changes from 1.7.x branch
• Prep for 1.8.0b2 by @benc-db in #611

Full Changelog: v1.8.0b1...v1.8.0b2

v1.6.9

What's Changed

• Backport: Pin Databricks SDK, Pandas by @benc-db in #612

Full Changelog: v1.6.8...v1.6.9

v1.7.9

What's Changed

• Fix for U2M flow on windows (sharding long passwords) (thanks @thijs-nijhuis-shell!) (597)
• Fix regression in incremental behavior, and align more with dbt-core expectations (604)
• Don't fail for unknown types when listing schema (600)

Full Changelog: v1.7.8...v1.7.9

v1.8.0b1

This beta brings expanded support for materialized views and streaming tables. See this discussion for full details.

What's Changed

• Materialized View Config Level Up by @benc-db in #536
• Streaming Table Support by @benc-db in #569
• Upgrade databricks-sql-connector to 3.1.0 by @benc-db in #593

v1.7.8

What's Changed

Fixes

• Fixed the behavior of the incremental schema change ignore option to properly handle the scenario when columns are dropped (thanks @case-k-git!) (580)
• Fixed export of saved queries (thanks @peterallenwebb!) (588)
• Properly match against null for merging matching rows (590)

Full Changelog: v1.7.4...v1.7.8

v1.7.7

1.7.6 was accidentally pushed with beta Materialized View code, hence the skip to 1.7.7. This release rolls back databricks-sql-connector to version 2.9.3, but otherwise includes dbt-databricks 1.7.4 fixes, as version 3.0.x has retry behavior that was insufficient for connecting to cold SQL Warehouses. I will work on addressing that separately so that we can go back to using the 3.x branch of the sql connector.