apache-airflow-providers-common-sql

Changelog

1.9.0

Note

This release of provider is only available for Airflow 2.6+ as explained in the Apache Airflow providers support policy.

Misc

  • Bump minimum Airflow version in providers to Airflow 2.6.0 (#36017)

  • Add Architecture Decision Record for common.sql introduction (#36015)

1.8.1

Misc

  • Add '_make_serializable' method which other SQL operators can overrides when result from cursor is not JSON-serializable (#32319)

  • Remove backcompat inheritance for DbApiHook (#35754)

1.8.0

Note

This release of provider is only available for Airflow 2.5+ as explained in the Apache Airflow providers support policy.

Bug Fixes

  • fix(providers/sql): respect soft_fail argument when exception is raised (#34199)

Misc

  • Bump min airflow version of providers (#34728)

  • Use 'airflow.exceptions.AirflowException' in providers (#34511)

1.7.2

Bug Fixes

  • Fix BigQueryValueCheckOperator deferrable mode optimisation (#34018)

Misc

  • Refactor regex in providers (#33898)

1.7.1

Misc

  • Refactor: Better percentage formatting (#33595)

  • Refactor: Simplify code in smaller providers (#33234)

1.7.0

Features

  • Add a new parameter to SQL operators to specify conn id field (#30784)

1.6.2

Misc

  • Make SQLExecute Query signature consistent with other SQL operators (#32974)

  • Get rid of Python2 numeric relics (#33050)

1.6.1

Bug Fixes

  • Fix local OpenLineage import in 'SQLExecuteQueryOperator'. (#32400)

Misc

  • Add default port to Openlineage authority method. (#32828)

  • Add more accurate typing for DbApiHook.run method (#31846)

1.6.0

Features

  • openlineage, common.sql:  provide OL SQL parser as internal OpenLineage provider API (#31398)

Misc

  • Pass SQLAlchemy engine to construct information schema query. (#32371)

1.5.2

Misc

  • Remove Python 3.7 support (#30963)

1.5.1

Misc

  • Bring back min-airflow-version for preinstalled providers (#31469)

1.5.0

Note

This release of provider is only available for Airflow 2.4+ as explained in the Apache Airflow providers support policy.

Features

  • Add conditional output processing in SQL operators (#31136)

Misc

  • Remove noisy log from SQL table check (#31037)

1.4.0

Features

  • Add option to show output of 'SQLExecuteQueryOperator' in the log (#29954)

Misc

  • Fix Python API docs formatting for Common SQL provider (#29863)

1.3.4

Bug Fixes

  • Do not process output when do_xcom_push=False  (#29599)

1.3.3

Bug Fixes

  • Handle non-compliant behaviour of Exasol cursor (#28744)

1.3.2

Bug Fixes

  • fIx isort problems introduced by recent isort release (#28434)

  • Fix template rendering for Common SQL operators (#28202)

  • Defer to hook setting for split_statements in SQLExecuteQueryOperator (#28635)

Misc

  • Clarify docstrings for updated DbApiHook (#27966)

1.3.1

This release fixes a few errors that were introduced in common.sql operator while refactoring common parts:

  • _process_output method in SQLExecuteQueryOperator has now consistent semantics and typing, it can also modify the returned (and stored in XCom) values in the operators that derive from the SQLExecuteQueryOperator).

  • descriptions of all returned results are stored as descriptions property in the DBApiHook

  • last description of the cursor whether to return single query results values are now exposed in DBApiHook via last_description property.

Lack of consistency in the operator caused 1.3.0 to be yanked - the 1.3.0 should not be used - if you have 1.3.0 installed, upgrade to 1.3.1.

Bug Fixes

  • Restore removed (but used) methods in common.sql (#27843)

  • Fix errors in Databricks SQL operator introduced when refactoring (#27854)

  • Bump common.sql provider to 1.3.1 (#27888)

  • Fixing the behaviours of SQL Hooks and Operators finally (#27912)

1.3.0

Note

This release of provider is only available for Airflow 2.3+ as explained in the Apache Airflow providers support policy.

Misc

  • Move min airflow version to 2.3.0 for all providers (#27196)

Features

  • Add SQLExecuteQueryOperator (#25717)

  • Use DbApiHook.run for DbApiHook.get_records and DbApiHook.get_first (#26944)

  • DbApiHook consistent insert_rows logging (#26758)

Bug Fixes

  • Common sql bugfixes and improvements (#26761)

  • Use unused SQLCheckOperator.parameters in SQLCheckOperator.execute. (#27599)

1.2.0

Features

  • Make placeholder style configurable (#25939)

  • Better error message for pre-common-sql providers (#26051)

Bug Fixes

  • Fix (and test) SQLTableCheckOperator on postgresql (#25821)

  • Don't use Pandas for SQLTableCheckOperator (#25822)

  • Discard semicolon stripping in SQL hook (#25855)

1.1.0

Features

  • Improve taskflow type hints with ParamSpec (#25173)

  • Move all "old" SQL operators to common.sql providers (#25350)

  • Deprecate hql parameters and synchronize DBApiHook method APIs (#25299)

  • Unify DbApiHook.run() method with the methods which override it (#23971)

  • Common SQLCheckOperators Various Functionality Update (#25164)

Bug Fixes

  • Allow Legacy SqlSensor to use the common.sql providers (#25293)

  • Fix fetch_all_handler & db-api tests for it (#25430)

  • Align Common SQL provider logo location (#25538)

  • Fix SQL split string to include ';-less' statements (#25713)

1.0.0

Initial version of the provider. Adds SQLColumnCheckOperator and SQLTableCheckOperator. Moves DBApiHook, SQLSensor and ConnectorProtocol to the provider.

Was this entry helpful?