Google services including:
- Google Ads
- Google Cloud (GCP)
- Google Firebase
- Google LevelDB
- Google Marketing Platform
- Google Workspace (formerly Google Suite)
This is detailed commit list of changes for versions provider package: google.
For high-level changelog, see :doc:`package information including changelog <index>`.
Latest change: 2022-07-12
| Commit | Committed | Subject |
|---|---|---|
| 93992f2361 | 2022-07-12 | PubSub assets & system tests migration (AIP-47) (#24867) |
| a13c51e224 | 2022-07-12 | Migrate Google sheets example to new design AIP-47 (#24975) |
| a038b52b5a | 2022-07-12 | Migrate Google ads example to new design AIP-47 (#24941) |
| c618da444e | 2022-07-12 | Modify BigQueryCreateExternalTableOperator to use updated hook function (#24363) |
| 626d9db290 | 2022-07-12 | Migrate Google example gcs_to_gdrive to new design AIP-47 (#24949) |
| fb51e04cfd | 2022-07-12 | Migrate Google firestore example to new design AIP-47 (#24830) |
| b777514253 | 2022-07-12 | Add handling state of existing Dataproc batch (#24924) |
| acaa0635c8 | 2022-07-08 | Automatically detect if non-lazy logging interpolation is used (#24910) |
| fb7162418e | 2022-07-07 | Add links for Google Kubernetes Engine operators (#24786) |
| 46bbfdade0 | 2022-07-07 | Move all SQL classes to common-sql provider (#24836) |
| 80b6754746 | 2022-07-06 | Migrate Google example sql_to_sheets to new design AIP-47 (#24814) |
| 3b35325840 | 2022-07-06 | Add test_connection method to 'GoogleBaseHook' (#24682) |
| 96b01a8012 | 2022-07-05 | Remove "bad characters" from our codebase (#24841) |
| 9227d56e68 | 2022-07-04 | Datacatalog assets & system tests migration (AIP-47) (#24600) |
| fe13eae3bf | 2022-07-04 | perf(BigQuery): pass table_id as str type (#23141) |
| 37ea530cb7 | 2022-07-04 | Migrate Google example DAG mssql_to_gcs to new design AIP-47 (#24541) |
| 46ac083f7e | 2022-07-01 | Align Black and blacken-docs configs (#24785) |
| 0de31bd73a | 2022-06-29 | Move provider dependencies to inside provider folders (#24672) |
| 45b11d4ed1 | 2022-06-29 | Use our yaml util in all providers (#24720) |
| 510a6bab45 | 2022-06-28 | Remove 'hook-class-names' from provider.yaml (#24702) |
| 7a7ca50160 | 2022-06-28 | Migrate Google example DAG s3_to_gcs to new design AIP-47 (#24641) |
| abb304c92f | 2022-06-25 | Migrate Google example DAG bigquery_transfer to new design AIP-47 (#24543) |
| ded22eb5b6 | 2022-06-24 | Add gcp_conn_id argument to GoogleDriveToLocalOperator (#24622) |
| e2f19505bf | 2022-06-22 | Upgrade FAB to 4.1.1 (#24399) |
| 9c59831ee7 | 2022-06-21 | Update providers to use functools compat for ''cached_property'' (#24582) |
| 88ddf65708 | 2022-06-20 | Migrate Google example DAG oracle_to_gcs to new design AIP-47 (#24542) |
| 32fc4be502 | 2022-06-20 | Migrate Google example DAG mysql_to_gcs to new design AIP-47 (#24540) |
| a35f342833 | 2022-06-20 | Migrate Google search_ads DAG to new design AIP-47 (#24298) |
| e7a1c50d62 | 2022-06-20 | GCSDeleteObjectsOperator empty prefix bug fix (#24353) |
| dd35fdaf35 | 2022-06-20 | Migrate Google gcs_to_sheets DAG to new design AIP-47 (#24501) |
| 0561c1aac4 | 2022-06-19 | Add DeprecationWarning for column_transformations parameter in AutoML (#24467) |
Latest change: 2022-06-15
| Commit | Committed | Subject |
|---|---|---|
| 952a5ea8d8 | 2022-06-15 | Update release docs for Google and Oracle providers (#24461) |
| ce50d3731a | 2022-06-15 | Use insert_job in the BigQueryToGCPOpertor and adjust links (#24416) |
| 2a084ee8d7 | 2022-06-14 | Update Oracle library to latest version (#24311) |
| 69c46252dd | 2022-06-14 | fix typo in google provider additional extras (#24431) |
| 08b675cf66 | 2022-06-13 | Fix links to sources for examples (#24386) |
| 94257f48f4 | 2022-06-13 | Expose SQL to GCS Metadata (#24382) |
| 8e0bddaea6 | 2022-06-12 | Deprecate remaining occurrences of 'bigquery_conn_id' in favor of 'gcp_conn_id' (#24376) |
| 6eb60f816c | 2022-06-12 | Migrate Google calendar example DAG to new design AIP-47 (#24333) |
| bc3fc8c9fc | 2022-06-12 | Migrate Google azure_fileshare example DAG to new design AIP-47 (#24349) |
| 6ab02b69a0 | 2022-06-12 | Remove bigquery example already migrated to AIP-47 (#24379) |
| cb90ca7afb | 2022-06-12 | Migrate Google sheets example DAG to new design AIP-47 (#24351) |
Latest change: 2022-06-09
| Commit | Committed | Subject |
|---|---|---|
| dcdcf3a2b8 | 2022-06-09 | Update release notes for RC2 release of Providers for May 2022 (#24307) |
| 047a6162b0 | 2022-06-08 | Workaround job race bug on biguery to gcs transfer (#24330) |
| 717a7588bc | 2022-06-07 | Update package description to remove double min-airflow specification (#24292) |
| b1ad017cee | 2022-06-07 | pydocstyle D202 added (#24221) |
| aeabe994b3 | 2022-06-07 | Prepare docs for May 2022 provider's release (#24231) |
| c3a9ef1ada | 2022-06-07 | AIP-47 - Migrate google leveldb DAGs to new design ##22447 (#24233) |
| c23826915d | 2022-06-07 | Apply per-run log templates to log handlers (#24153) |
| 80c1ce76e1 | 2022-06-06 | Cloud Storage assets & StorageLink update (#23865) |
| ec84ffe71c | 2022-06-06 | Fix GCSToGCSOperator cannot copy a single file/folder without copying other files/folders with that prefix (#24039) |
| 027b707d21 | 2022-06-05 | Add explanatory note for contributors about updating Changelog (#24229) |
| 55fd02a389 | 2022-06-04 | Add key_secret_project_id parameter which specifies a project with KeyFile (#23930) |
| 90233bc7cb | 2022-06-04 | Added impersonation_chain for DataflowStartFlexTemplateOperator and DataflowStartSqlJobOperator (#24046) |
| c01a5a50b4 | 2022-06-04 | Fix BigQuery system tests (#24013) |
| a597a76e8f | 2022-06-03 | fix BigQueryInsertJobOperator (#24165) |
| e13b15946e | 2022-06-03 | Workflows assets & system tests migration (AIP-47) (#24105) |
| 368f292ca1 | 2022-06-03 | Update credentials when using ADC in Compute Engine (#23773) |
| 96e8fb4a07 | 2022-06-01 | Fix the link to google workplace (#24080) |
| 3dd7b1ddba | 2022-06-01 | set color to operators in cloud_sql.py (#24000) |
| 841ed27101 | 2022-06-01 | Spanner assets & system tests migration (AIP-47) (#23957) |
| fedab9d64a | 2022-06-01 | Remove hack from BigQuery DTS hook (#23887) |
| e58985598f | 2022-05-30 | Ensure @contextmanager decorates generator func (#23103) |
| 92ddcf4ac6 | 2022-05-27 | Introduce 'flake8-implicit-str-concat' plugin to static checks (#23873) |
| ec6761a5c0 | 2022-05-23 | Clean up f-strings in logging calls (#23597) |
| 65f3b18fc1 | 2022-05-22 | Sql to gcs with exclude columns (#23695) |
| a43e98d050 | 2022-05-22 | Fix DataprocJobBaseOperator not being compatible with dotted names (#23439). (#23791) |
| 5bfacf81c6 | 2022-05-20 | [Issue#22846] allow option to encode or not encode UUID when uploading from Cassandra to GCS (#23766) |
| f60fa98a2e | 2022-05-19 | Cloud SQL assets & system tests migration (AIP-47) (#23583) |
| d3b0880286 | 2022-05-17 | Speech To Text assets & system tests migration (AIP-47) (#23643) |
| 3bf9a1df38 | 2022-05-16 | Add fields to CLOUD_SQL_EXPORT_VALIDATION. (#23724) |
| bc0dcddfb5 | 2022-05-12 | Migrate Dataproc to new system tests design (#22777) |
Latest change: 2022-05-12
| Commit | Committed | Subject |
|---|---|---|
| 75c60923e0 | 2022-05-12 | Prepare provider documentation 2022.05.11 (#23631) |
| cd49a8b9f6 | 2022-05-11 | [FEATURE] google provider - BigQueryInsertJobOperator log query (#23648) |
| 60a1d9d191 | 2022-05-10 | [FEATURE] google provider - split GkeStartPodOperator execute (#23518) |
| 74557e41e3 | 2022-05-10 | Add exportContext.offload flag to CLOUD_SQL_EXPORT_VALIDATION. (#23614) |
| 428a439953 | 2022-05-09 | Clean up in-line f-string concatenation (#23591) |
| 766726f2e3 | 2022-05-09 | Fix 'PostgresToGCSOperator' does not allow nested JSON (#23063) |
| 82c244f9c7 | 2022-05-08 | Fix GCSToGCSOperator ignores replace parameter when there is no wildcard (#23340) |
| 627b5698ec | 2022-05-04 | Add Stackdriver assets and migrate system tests to AIP-47 (#23320) |
| 3977e1798d | 2022-05-04 | CloudTasks assets & system tests migration (AIP-47) (#23282) |
| dfe0f75938 | 2022-05-04 | TextToSpeech assets & system tests migration (AIP-47) (#23247) |
| 2d109401b3 | 2022-05-04 | Bump pre-commit hook versions (#22887) |
| 427e14b763 | 2022-05-03 | Fix code-snippets in google provider (#23438) |
| fa0cc7cec7 | 2022-05-02 | Cleanup Google provider CHANGELOG.rst (#23390) |
| 3f6d5eef42 | 2022-05-01 | 'DataprocHook': Remove deprecated function 'submit' (#23389) |
| 511d0ee256 | 2022-04-30 | Bigquery assets (#23165) |
| 3f9845095e | 2022-04-29 | Remove redundant docstring in 'BigQueryUpdateTableSchemaOperator' (#23349) |
| 0fcdc5e1fb | 2022-04-29 | 'S3ToGCSOperator': Remove 'dest_gcs_conn_id' (#23348) |
| 05ccfd42f2 | 2022-04-29 | Dataproc: Remove default value of 'region' (#23350) |
| 359dc58207 | 2022-04-29 | Google provider: Remove 'bigquery_conn_id', 'google_cloud_storage_conn_id' (#23326) |
| c82b3b9466 | 2022-04-28 | 'GCSFileTransformOperator': New templated fields 'source_object', 'destination_object' (#23328) |
| 9449a107f0 | 2022-04-28 | 'DatastoreHook': Remove 'datastore_conn_id' (#23323) |
| 1f32603549 | 2022-04-28 | update processor to fix broken download URLs (#23299) |
| 8a7b61a8e4 | 2022-04-28 | Migrate gcs to new system tests design (#22778) |
| 72e2ea68a1 | 2022-04-27 | 'CloudBuildCreateBuildOperator': Remove deprecated 'body' parameter (#23263) |
| 6cf0176f2a | 2022-04-27 | Remove deprecated parameters from PubSub operators: (#23261) |
| 4d9c55c9d9 | 2022-04-27 | Remove deprecated parameters from BigQueryHook: (#23269) |
| 915b0c689e | 2022-04-27 | add missing docstring in 'BigQueryHook.create_empty_table' (#23270) |
| 710eb6f3e6 | 2022-04-26 | * 'CloudDatastoreImportEntitiesOperator' : Remove 'xcom_push'. Please use 'BaseOperator.do_xcom_push' (#23252) |
| 2d569fdaf0 | 2022-04-26 | Create links for Biqtable operators (#23164) |
| 434ab5a03c | 2022-04-26 | 'BigtableCreateInstanceOperator' & 'BigtableHook.create_instance' Remove 'replica_cluster_id', 'replica_cluster_zone'. (#23251) |
| 5ca1f3bf70 | 2022-04-26 | Dataproc : remove 'location' in favor of 'region' (#23250) |
| 1416ac4195 | 2022-04-26 | 'PubSubPullSensor': Remove 'project' and 'return_immediately' (#23231) |
| 06dfc2536c | 2022-04-26 | Remove deprecated 'params' from google operators (#23230) |
| 37a7b27242 | 2022-04-26 | 'LookerStartPdtBuildOperator', 'LookerCheckPdtBuildSensor' : fix empty materialization id handling (#23025) |
| 967140e6c3 | 2022-04-25 | Add location support to BigQueryDataTransferServiceTransferRunSensor. |
| d6094e58ba | 2022-04-25 | Fix static checks |
| 22ea28f23e | 2022-04-25 | Remove run_in_gke_cluster flag |
| c46d04eb2d | 2022-04-25 | Create system test for K8s and dataproc operators |
| 35cbc89c3a | 2022-04-25 | Create Dataproc operators for GKE |
| 27ad3b7827 | 2022-04-25 | Remove 'GCSObjectsWtihPrefixExistenceSensor' |
| 544d658921 | 2022-04-25 | Change CloudDatastoreExportEntitiesLink to StorageLink |
| b3cc2f5d10 | 2022-04-25 | Fix pre-commit check |
| 43ded6c877 | 2022-04-25 | Add links for Cloud Datastore operators |
| de65a5cc5a | 2022-04-25 | Support serviceAccount attr for dataflow in the Apache beam |
| 76dc7375b2 | 2022-04-25 | Migrate Datastore system tests to new design (AIP-47) |
| 0373fb0247 | 2022-04-25 | 'GoogleDriveToGCSOperator': Remove 'destination_bucket' and 'destination_object' |
| 6b459995b2 | 2022-04-25 | Add the format of Vertex Endpoint ID to the docstrings |
| 27af0b7ebe | 2022-04-25 | Add the new parameter to the docstring |
| 48abf571be | 2022-04-25 | Add 'endpoint_id' arg to 'google.cloud.operators.vertex_ai.CreateEndpointOperator' |
| 8b6b0848a3 | 2022-04-23 | Use new Breese for building, pulling and verifying the images. (#23104) |
| 07a13bb708 | 2022-04-21 | Change ComputeSSH to throw provider import error instead paramiko (#23035) |
| c36bcc4c06 | 2022-04-15 | Upgrade to support Google Ads v10 (#22965) |
| ea1ae1963e | 2022-04-14 | Fix cancel_on_kill after execution timeout for DataprocSubmitJobOperator (#22955) |
| 9a623e94cb | 2022-04-13 | migrate system test gcs_to_bigquery into new design (#22753) |
| aa317d92ea | 2022-04-13 | Fix select * query xcom push for BigQueryGetDataOperator (#22936) |
| 27b3e31178 | 2022-04-11 | implements #22859 - Add .sql as templatable extension (#22920) |
| 03e1c9b152 | 2022-04-11 | MSSQLToGCSOperator fails: datetime is not JSON Serializable (#22882) |
| 6933022e94 | 2022-04-10 | Fix new MyPy errors in main (#22884) |
| 6aa65a38e0 | 2022-04-08 | Add example DAG for demonstrating usage of GCS sensors (#22808) |
Latest change: 2022-04-07
| Commit | Committed | Subject |
|---|---|---|
| 56ab82ed7a | 2022-04-07 | Prepare mid-April provider documentation. (#22819) |
| 838cf401b9 | 2022-04-06 | Fail ''LocalFilesystemToGCSOperator'' if src does not exist (#22772) |
| 99b0211d50 | 2022-04-04 | Modify transfer operators to handle more data (#22495) |
| f9e18472c0 | 2022-04-04 | Add autodetect arg in BQCreateExternalTable Operator (#22710) |
| 327eab3e26 | 2022-03-31 | Add links for BigQuery Data Transfer (#22280) |
| 02976bef88 | 2022-03-27 | Refactor: BigQuery to GCS Operator (#22506) |
| 719135ade0 | 2022-03-27 | Remove references to deprecated operators/params in PubSub operators (#22519) |
| ca4b8d1744 | 2022-03-27 | Create Endpoint and Model Service, Batch Prediction and Hyperparameter Tuning Jobs operators for Vertex AI service (#22088) |
| 388723950d | 2022-03-27 | PostgresToGoogleCloudStorageOperator - BigQuery schema type for time zone naive fields (#22536) |
| c063fc688c | 2022-03-25 | Update black precommit (#22521) |
| 3c7cd47319 | 2022-03-25 | New design of system tests (#22311) |
| 7ab45d41d6 | 2022-03-24 | Update secrets backends to use get_conn_value instead of get_conn_uri (#22348) |
| d231e9b448 | 2022-03-24 | Remove coerce_datetime usage from GCSTimeSpanFileTransformOperator (#22501) |
| 82a26c0591 | 2022-03-24 | Fix the docstrings (#22497) |
| 38fde2ea79 | 2022-03-23 | Fix 'download_media' url in 'GoogleDisplayVideo360SDFtoGCSOperator' (#22479) |
| 0f0a1a7d22 | 2022-03-23 | Fix to 'CloudBuildRunBuildTriggerOperator' fails to find build id. (#22419) |
Latest change: 2022-03-22
| Commit | Committed | Subject |
|---|---|---|
| d7dbfb7e26 | 2022-03-22 | Add documentation for bugfix release of Providers (#22383) |
| 7b851edc91 | 2022-03-21 | Add 'LocalFilesystemToGoogleDriveOperator' (#22219) |
| 14e6b657c2 | 2022-03-21 | Add timeout and retry to the BigQueryInsertJobOperator (#22395) |
| a3ffbee7c9 | 2022-03-20 | Fix skipping non-GCS located jars (#22302) |
| 88402038ca | 2022-03-19 | Add dataflow_default_options to templated_fields (#22367) |
| 6448b2458c | 2022-03-15 | [FIX] typo doc of gcs operator (#22290) |
Latest change: 2022-03-14
| Commit | Committed | Subject |
|---|---|---|
| 16adc035b1 | 2022-03-14 | Add documentation for Classifier release for March 2022 (#22226) |
| 87c1246b79 | 2022-03-14 | Add Dataplex operators (#20377) |
| c1ab8e2d7b | 2022-03-14 | Protect against accidental misuse of XCom.get_value() (#22244) |
| c108f264ab | 2022-03-13 | Change the default 'chunk_size' to a clear representation & add documentation (#22222) |
| 45435399fe | 2022-03-13 | Support Uploading Bigger Files to Google Drive (#22179) |
| 42a891d605 | 2022-03-13 | Update ''GKEDeleteClusterOperator', ''GKECreateClusterOperator'' docstrings (#22212) |
| d08284ed25 | 2022-03-11 | `` Add map_index to XCom model and interface (#22112)`` |
| 828d1cba4d | 2022-03-10 | Add support for ARM platform (#22127) |
| 4ac771c316 | 2022-03-09 | Fix spelling (#22107) |
| dd0724fdd2 | 2022-03-08 | Add guide for DataprocInstantiateInlineWorkflowTemplateOperator (#22062) |
| dfd9805a23 | 2022-03-08 | Use yaml safe load (#22091) |
| eba9703751 | 2022-03-08 | Revert "Use yaml safe load (#22085)" (#22089) |
| 7f4935bab3 | 2022-03-08 | Use yaml safe load (#22085) |
| a11d831e3f | 2022-03-07 | Allow for uploading metadata with GCS Hook Upload (#22058) |
Latest change: 2022-03-07
| Commit | Committed | Subject |
|---|---|---|
| f5b96315fe | 2022-03-07 | Add documentation for Feb Providers release (#22056) |
| 6db9b0029b | 2022-03-07 | Add Looker PDT operators (#20882) |
| 9020b3a89d | 2022-03-06 | Add autodetect arg to external table creation in GCSToBigQueryOperator (#21944) |
| a0e2ebaa27 | 2022-03-02 | Unpin 'google-cloud-memcache' (#21912) |
| 84ed747db8 | 2022-03-02 | Unpin ''pandas-gbq'' and remove unused code (#21915) |
| fb6b2d1fee | 2022-03-01 | Make project_id argument optional in all dataproc operators (#21866) |
| 08575ddd8a | 2022-03-01 | Change BaseOperatorLink interface to take a ti_key, not a datetime (#21798) |
| 6ca118dff1 | 2022-03-01 | Allow templates in more DataprocUpdateClusterOperator fields (#21865) |
| 0c55ca2cda | 2022-02-28 | Suppress hook warnings from the Bigquery transfers (#20119) |
| 73eb24f25c | 2022-02-24 | Fix bigquery_dts parameter docstring typo (#21786) |
| 3b4c26eb3a | 2022-02-23 | Add Dataproc assets/links (#21756) |
| 6061cc4219 | 2022-02-20 | Add Auto ML operators for Vertex AI service (#21470) |
| 295efd36ea | 2022-02-17 | Dataflow Assets (#21639) |
| af2c047320 | 2022-02-16 | Add GoogleCalendarToGCSOperator (#20769) |
| 1b568d73e1 | 2022-02-15 | Extract ClientInfo to module level (#21554) |
| dc03000de8 | 2022-02-15 | Datafusion assets (#21518) |
| 56365b102c | 2022-02-15 | Dataproc metastore assets (#21267) |
| 6692e9191d | 2022-02-15 | Normalize *_conn_id parameters in BigQuery sensors (#21430) |
| 2eb10565b2 | 2022-02-15 | Fixed PostgresToGCSOperator fail on empty resultset for use_server_side_cursor=True (#21307) |
| da1e6578e0 | 2022-02-15 | Fix multi query scenario in bigquery example DAG (#21575) |
Latest change: 2022-02-14
| Commit | Committed | Subject |
|---|---|---|
| 28378d867a | 2022-02-14 | Add documentation for RC3 release of providers for Jan 2022 (#21553) |
| 6bb0857df9 | 2022-02-13 | (providers_google) add a location check in bigquery (#19571) |
| 6579648af2 | 2022-02-13 | Fix bigquery-hook when no engine_kwargs are passed |
| da485da29a | 2022-02-13 | Add support for BeamGoPipelineOperator (#20386) |
| 05a883b35e | 2022-02-11 | Google Cloud Composer opearators (#21251) |
| 833087f4f9 | 2022-02-10 | Enable asynchronous job submission in BigQuery hook (#21385) |
| 51aff276ca | 2022-02-10 | Optionally raise an error if source file does not exist in GCSToGCSOperator (#21391) |
| 07fe9e8c6a | 2022-02-09 | Never set DagRun.state to State.NONE (#21263) |
| 0a3ff43d41 | 2022-02-08 | Add pre-commit check for docstring param types (#21398) |
| d94fa37830 | 2022-02-08 | Fixed changelog for January 2022 (delayed) provider's release (#21439) |
| e973740208 | 2022-02-08 | Create CustomJob and Datasets operators for Vertex AI service (#21253) |
| 34d63fabc0 | 2022-02-08 | Fix BigQueryDataTransferServiceHook.get_transfer_run() request parameter (#21293) |
| 6b88d432d9 | 2022-02-06 | Support to upload file to Google Shared Drive (#21319) |
| 1a77bc6481 | 2022-02-06 | :bug: (BigQueryHook) fix compatibility with sqlalchemy engine (#19508) |
| 6c3a67d4fc | 2022-02-05 | Add documentation for January 2021 providers release (#21257) |
| 39e395f981 | 2022-02-04 | Add more SQL template fields renderers (#21237) |
| e840acf8d1 | 2022-02-04 | Fix BigQuery system test (#21320) |
| ddb5246bd1 | 2022-02-03 | Refactor operator links to not create ad hoc TaskInstances (#21285) |
| 1d4b709e20 | 2022-01-28 | Revert "Create CustomJob and Datasets operators for Vertex AI service (#20077)" (#21203) |
| 48d44b885b | 2022-01-28 | Cloudsql import links fix. (#21199) |
| 640c0b6763 | 2022-01-28 | Create CustomJob and Datasets operators for Vertex AI service (#20077) |
| cb73053211 | 2022-01-27 | Add optional features in providers. (#21074) |
| 60aa518ebf | 2022-01-26 | batch as templated field in DataprocCreateBatchOperator (#20905) |
| 623163f16a | 2022-01-25 | Extend dataproc example dag (#21091) |
| 86ef016eab | 2022-01-23 | Make timeout Optional for wait_for_operation (#20981) |
| 506efb6fa3 | 2022-01-21 | Squelch more deprecation warnings (#21003) |
| 372849486c | 2022-01-21 | Fix last google provider MyPy errors (#21010) |
| 73c0d241d8 | 2022-01-21 | Remove a few stray ':type's in docs (#21014) |
| 602abe8394 | 2022-01-20 | Remove ':type' lines now sphinx-autoapi supports typehints (#20951) |
| b8526abc2c | 2022-01-19 | Add encoding parameter to 'GCSToLocalFilesystemOperator' to fix #20901 (#20919) |
| 58452f97db | 2022-01-03 | Add hook for integrating with Google Calendar (#20542) |
Latest change: 2021-12-31
| Commit | Committed | Subject |
|---|---|---|
| f77417eb0d | 2021-12-31 | Fix K8S changelog to be PyPI-compatible (#20614) |
| 97496ba2b4 | 2021-12-31 | Update documentation for provider December 2021 release (#20523) |
| a22d5bd076 | 2021-12-31 | Fix mypy errors in Google Cloud provider (#20611) |
| 4233ebe5ce | 2021-12-31 | Fix setting of project ID in ''provide_authorized_gcloud'' (#20428) |
| 83f8e178ba | 2021-12-31 | Even more typing in operators (template_fields/ext) (#20608) |
| 746ee587da | 2021-12-31 | Delete pods by default in KubernetesPodOperator (#20575) |
| 41dbe2c4fc | 2021-12-30 | Fix mypy errors in google/cloud/operators/stackdriver (#20601) |
| dda688776c | 2021-12-30 | Fix Google mlengine MyPy errors (#20569) |
| d56e7b56bb | 2021-12-30 | Fix template_fields type to have MyPy friendly Sequence type (#20571) |
| bd9e8cef26 | 2021-12-30 | Fix Google Mypy Dataproc errors (#20570) |
| a6e60ce25d | 2021-12-30 | Change download_video parameter to resourceName (#20528) |
| af4a2b0240 | 2021-12-30 | Fix big query to mssql/mysql transfer issues (#20001) |
| a0821235fb | 2021-12-30 | Use typed Context EVERYWHERE (#20565) |
| da88ed1943 | 2021-12-29 | Fix MyPy errors in Google Cloud (again) (#20469) |
| 3a480f5ff4 | 2021-12-29 | Fix passing the gzip compression parameter on sftp_to_gcs. (#20553) |
| bfd6d45cec | 2021-12-29 | switch to follow_redirects on httpx.get call in CloudSQL provider (#20239) |
| 7d4d38b546 | 2021-12-29 | avoid deprecation warnings in BigQuery transfer operators (#20502) |
| b7086f9815 | 2021-12-28 | Use Python3.7+ syntax in pyupgrade (#20501) |
| a4622e19fa | 2021-12-22 | Support regional GKE cluster (#18966) |
| 2ffdcf4b41 | 2021-12-21 | Fixes docstring for PubSubCreateSubscriptionOperator (#20237) |
| d4c4f9e09e | 2021-12-21 | Fix mypy errors for google.cloud_build (#20234) |
| c6dbb3f885 | 2021-12-21 | Fix MyPy for Google Bigquery (#20329) |
| ed604b62f3 | 2021-12-18 | Fix remaining MyPy errors in Google Provider (#20358) |
| 17404f1f10 | 2021-12-16 | Move source_objects datatype check out of GCSToBigQueryOperator.__init__ (#20347) |
| 174681911f | 2021-12-16 | Fix MyPy Errors for dataproc package (#20327) |
| 2fb5e1d0ec | 2021-12-15 | Fix cached_property MyPy declaration and related MyPy errors (#20226) |
| 21b8661886 | 2021-12-15 | Fix missing get_backup method for Dataproc Metastore (#20326) |
| cdaa9a2529 | 2021-12-15 | Fix MyPy errors for google.cloud.tasks (#20233) |
| 43efde6230 | 2021-12-15 | Fix MyPy Errors for Apache Beam (and Dataflow) provider. (#20301) |
| c4b3694101 | 2021-12-15 | Fix MyPy errors in leveldb (#20222) |
| 1570519a97 | 2021-12-14 | Fix MyPy errors for google.cloud.transfers (#20229) |
| 632bd0133e | 2021-12-13 | Fix MyPY errors for google.cloud.example_dags (#20232) |
| 644051abcb | 2021-12-13 | Fix MyPy errors for google/marketing_platform and suite (#20227) |
| a208463802 | 2021-12-13 | Organize S3 Classes in Amazon Provider (#20167) |
| 98514cc159 | 2021-12-13 | Add optional location to bigquery data transfer service (#15088) (#20221) |
| 1f662571b2 | 2021-12-12 | Fix MyPy errors in google.cloud.sensors (#20228) |
| 22341b90da | 2021-12-11 | Add Google Cloud Tasks how-to documentation (#20145) |
| e9262752dc | 2021-12-11 | Finalised Datastore documentation (#20138) |
| fa96b09395 | 2021-12-09 | Update Sphinx and Sphinx-AutoAPI (#20079) |
| ed8b63ba24 | 2021-12-08 | Providers facebook hook multiple account (#19377) |
| 50bf536656 | 2021-12-08 | Remove deprecated method call (blob.download_as_string) (#20091) |
| 564fe635bd | 2021-12-06 | Added example DAG for MSSQL to Google Cloud Storage (GCS) (#19873) |
| cb082d361a | 2021-12-02 | Remove deprecated template_fields from GoogleDriveToGCSOperator (#19991) |
| 6977c47572 | 2021-12-01 | BigQueryHook fix typo in run_load doc string (#19924) |
| f6dca1fa5e | 2021-12-01 | Update doc reference links (#19909) |
Latest change: 2021-11-30
| Commit | Committed | Subject |
|---|---|---|
| 853576d901 | 2021-11-30 | Update documentation for November 2021 provider's release (#19882) |
| fb478c00cd | 2021-11-28 | Move 'bucket_name' validation out of '__init__' in Google Marketing Platform operators (#19383) |
| e9e530979a | 2021-11-28 | Update 'default_args' value in example_functions DAG from str to int (#19865) |
| bf68b9a846 | 2021-11-26 | Create dataproc serverless spark batches operator (#19248) |
| a192cecf6b | 2021-11-26 | updates pipeline_timeout CloudDataFusionStartPipelineOperator (#18773) |
| eb163c81d1 | 2021-11-25 | Fix GCS system tests (#19227) |
| 744d11bdb2 | 2021-11-25 | Clean up ''default_args'' usage in docs (#19803) |
| 0b2e1a8744 | 2021-11-22 | Added wait mechanizm to the DataprocJobSensor to avoid 509 errors when Job is not available (#19740) |
| 3336bb6c3c | 2021-11-19 | Fix badly merged impersonation in GKEPodOperator (#19696) |
| 952ef908bc | 2021-11-19 | Support impersonation_chain parameter in the GKEStartPodOperator (#19518) |
| 853c16465a | 2021-11-18 | Clean-up of google cloud example dags - batch 3 (#19664) |
| 355dec8fea | 2021-11-17 | Misc. documentation typos and language improvements (#19599) |
| b9d31cd449 | 2021-11-17 | Cleanup dynamic 'start_date' use for miscellaneous Google example DAGs (#19400) |
| daf234bd5e | 2021-11-16 | Remove reference to deprecated operator in example_dataproc (#19619) |
| 48f228cf9e | 2021-11-15 | #16691 Providing more information in docs for DataprocCreateCluster operator migration (#19446) |
| 6ef44b6a50 | 2021-11-15 | Clean-up of google cloud example dags - batch 2 (#19527) |
| dc0159e7e4 | 2021-11-14 | Add support in GCP connection for reading key from Secret Manager (#19164) |
| 4212c49324 | 2021-11-14 | Update Azure modules to comply with AIP-21 (#19431) |
| aa2cb5545f | 2021-11-12 | Remove remaining 'pylint: disable' comments (#19541) |
| c8dc0311da | 2021-11-08 | Fix Cloud SQL system tests (#19014) |
| 26ad55beb0 | 2021-11-08 | Add dataproc metastore operators (#18945) |
| 9efb989d19 | 2021-11-07 | Clean-up of google cloud example dags (#19436) |
| f421409b4d | 2021-11-05 | Fix typos in warnings, docstrings, exceptions (#19424) |
| a3c9956f79 | 2021-10-30 | Add support of 'path' parameter for GCloud Storage Transfer Service operators (#17446) |
Latest change: 2021-10-29
| Commit | Committed | Subject |
|---|---|---|
| d9567eb106 | 2021-10-29 | Prepare documentation for October Provider's release (#19321) |
| 55abc2f620 | 2021-10-28 | Support query timeout as an argument in CassandraToGCSOperator (#18927) |
| e4aa377da7 | 2021-10-28 | Update BigQueryCreateExternalTableOperator doc and parameters (#18676) |
| 20847fdbf8 | 2021-10-27 | Add value to "namespaceId" of query (#19163) |
| 3c08c025c5 | 2021-10-27 | Move validation of templated input params to run after the context init (#19048) |
| eba1b68b30 | 2021-10-27 | Update dataflow.py (#19231) |
| 7ecf29f70d | 2021-10-26 | Fix hard-coded /tmp directory in CloudSQL Hook (#19229) |
| 726a1517ec | 2021-10-26 | Fix bug in Dataflow hook when no jobs are returned (#18981) |
| d9192a55ba | 2021-10-22 | Replacing non-attribute template_fields for BigQueryToMsSqlOperator (#19052) |
| 4fae04a471 | 2021-10-21 | Upgrade the Dataproc package to 3.0.0 and migrate from v1beta2 to v1 api (#18879) |
| 0e95b57772 | 2021-10-19 | Google provider catch invalid secret name (#18790) |
| 86a2a19ad2 | 2021-10-17 | More f-strings (#18855) |
| a418fd96f7 | 2021-10-17 | Use google cloud credentials when executing beam command in subprocess (#18992) |
| 5c3e453820 | 2021-10-15 | Fix BigQueryToMsSqlOperator documentation (#18995) |
| 406b38b2e3 | 2021-10-15 | Replace default api_version of FacebookAdsReportToGcsOperator (#18996) |
| 1571f80546 | 2021-10-14 | Add pre-commit hook for common misspelling check in files (#18964) |
| 20df60de24 | 2021-10-07 | Dataflow Operators - use project and location from job in on_kill method. (#18699) |
| 86bf2a29ba | 2021-10-04 | Simplify strings previously split across lines (#18679) |
Latest change: 2021-09-30
| Commit | Committed | Subject |
|---|---|---|
| 840ea3efb9 | 2021-09-30 | Update documentation for September providers release (#18613) |
| 9279c44c91 | 2021-09-29 | Fix part of Google system tests (#18494) |
| 2fadf3c3cf | 2021-09-27 | Fix kubernetes engine system test (#18548) |
| a458fcc573 | 2021-09-27 | Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278) |
| 97d6892318 | 2021-09-25 | Rename AzureDataLakeStorage to ADLS (#18493) |
| a5439eee72 | 2021-09-23 | Add index to the dataset name to have separate dataset for each example DAG (#18459) |
| 18d7e1e227 | 2021-09-21 | Fix BigQuery system test (#18373) |
| e25eea052f | 2021-09-19 | Inclusive Language (#18349) |
| 7458f1e786 | 2021-09-18 | Remove check for at least one schema in GCSToBigquery (#18150) |
| 2474f8922d | 2021-09-13 | Migrate Google Cloud Build from Discovery API to Python SDK (#18184) |
| 8ae2bb9bfa | 2021-09-13 | Fix error when create external table using table resource (#17998) |
| 9140ad8d8f | 2021-09-11 | Use parameters instead of params (#18143) |
| 3d4bfdcbb9 | 2021-09-10 | Add missing __init__.py files for some test packages (#18142) |
| cfb602a33d | 2021-09-10 | Fix ''BigQuery'' data extraction in ''BigQueryToMySqlOperator'' (#18073) |
| 2fd3f27ebd | 2021-09-10 | Make next_dagrun_info take a data interval (#18088) |
| 944dcfbb91 | 2021-09-07 | Change TaskInstance and TaskReschedule PK from execution_date to run_id (#17719) |
| bfad233b91 | 2021-09-06 | Fix providers tests in main branch with eager upgrades (#18040) |
| 21348c194d | 2021-09-03 | fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006) |
| 9a0c10ba3f | 2021-09-01 | deduplicate running jobs on BigQueryInsertJobOperator (#17496) |
| fe34582fc2 | 2021-09-01 | New google operator: SQLToGoogleSheetsOperator (#17887) |
| 500780651c | 2021-08-31 | Add possibility to run DAGs from system tests and see DAGs logs (#17868) |
Latest change: 2021-08-30
| Commit | Committed | Subject |
|---|---|---|
| 0a68588479 | 2021-08-30 | Add August 2021 Provider's documentation (#17890) |
| b5da846dd1 | 2021-08-30 | Fix missing Data Fusion sensor integration (#17914) |
| 07405e6df4 | 2021-08-30 | [AIRFLOW-9300] Add DatafusionPipelineStateSensor and aync option to the CloudDataFusionStartPipelineOperator (#17787) |
| 42e13e1a5a | 2021-08-30 | Remove all deprecation warnings in providers (#17900) |
| aa5952e58c | 2021-08-27 | Gcp ai hyperparameter tuning (#17790) |
| 87769db98f | 2021-08-27 | Allow omission of 'initial_node_count' if 'node_pools' is specified (#17820) |
| be75dcd39c | 2021-08-23 | Update description about the new ''connection-types'' provider meta-data |
| d04aa13526 | 2021-08-20 | [Airflow 13779] use provided parameters in the wait_for_pipeline_state hook (#17137) |
| 76ed2a49c6 | 2021-08-19 | Import Hooks lazily individually in providers manager (#17682) |
| b68d1935f9 | 2021-08-19 | Add error check for config_file parameter in GKEStartPodOperator (#17700) |
| 29aab6434f | 2021-08-17 | Adds secrets backend/logging/auth information to provider yaml (#17625) |
| b06d528603 | 2021-08-11 | Don't cache Google Secret Manager client (#17539) |
| 67cbb0f181 | 2021-08-02 | Enable specifying dictionary paths in 'template_fields_renderers' (#17321) |
| c384f9b0f5 | 2021-07-29 | GCP Secret Manager error handling for missing credentials (#17264) |
Latest change: 2021-07-26
| Commit | Committed | Subject |
|---|---|---|
| 87f408b1e7 | 2021-07-26 | Prepares docs for Rc2 release of July providers (#17116) |
| 448e50bd23 | 2021-07-26 | Updating Google Cloud example DAGs to use XComArgs (#16875) |
| aaf44ccace | 2021-07-26 | Updating miscellaneous Google example DAGs to use XComArgs (#16876) |
| d01cc945dd | 2021-07-26 | Fixes several failing tests after broken main (#17222) |
| babc4250f3 | 2021-07-26 | Fixes statich check failures (#17218) |
| 5d2224795b | 2021-07-25 | Google Ads Hook: Support newer versions of the google-ads library (#17160) |
| 966b250199 | 2021-07-25 | Fix GCStoGCS operator with replace diabled and existing destination object (#16991) |
| 763919d415 | 2021-07-25 | Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162) |
| 81bd40933e | 2021-07-23 | [CASSANDRA-16814] Fix cassandra to gcs type inconsistency. (#17183) |
| 026ffe65d4 | 2021-07-19 | fix: dataprocpysparkjob project_id as self.project_id (#17075) |
| d02ded65ea | 2021-07-15 | Fixed wrongly escaped characters in amazon's changelog (#17020) |
| b916b75079 | 2021-07-15 | Prepare documentation for July release of providers. (#17015) |
| a3f5c93806 | 2021-07-13 | Update alias for field_mask in Google Memmcache (#16975) |
| b0f7f91fe2 | 2021-07-07 | Standardise dataproc location param to region (#16034) |
| 866a601b76 | 2021-06-28 | Removes pylint from our toolchain (#16682) |
Latest change: 2021-06-18
| Commit | Committed | Subject |
|---|---|---|
| bbc627a3da | 2021-06-18 | Prepares documentation for rc2 release of Providers (#16501) |
| cbf8001d76 | 2021-06-16 | Synchronizes updated changelog after buggfix release (#16464) |
| 8a9c337838 | 2021-06-15 | Remove class references in changelogs (#16454) |
| 1fba5402bb | 2021-06-15 | More documentation update for June providers release (#16405) |
| 3c5cc42e13 | 2021-06-14 | Fix deprecation warnings location in google provider (#16403) |
| b272f9cec9 | 2021-06-13 | fix: ensure datetime-related values fully compatible with MySQL and BigQuery (#15026) |
| 7f8f75eb80 | 2021-06-12 | Add BigQueryToMsSqlOperator (#15422) |
| 0c80a7d411 | 2021-06-11 | Fixes AzureFileShare connection extras (#16388) |
| 9c94b72d44 | 2021-06-07 | Updated documentation for June 2021 provider release (#16294) |
| 1e647029e4 | 2021-06-01 | Rename the main branch of the Airflow repo to be 'main' (#16149) |
| 99d1535287 | 2021-05-31 | Fix: GCS To BigQuery source_object (#16160) |
| e1137523d4 | 2021-05-30 | Fix: Unnecessary downloads in ''GCSToLocalFilesystemOperator'' (#16171) |
| 904709d34f | 2021-05-27 | Check synctatic correctness for code-snippets (#16005) |
| 86768859c6 | 2021-05-26 | Fix bigquery type error when export format is parquet (#16027) |
| 6ae9aeec3f | 2021-05-26 | pass wait_for_done parameter down to _DataflowJobsController (#15541) |
| 476d0f6e3d | 2021-05-22 | Bump pyupgrade v2.13.0 to v2.18.1 (#15991) |
| aa4713e43f | 2021-05-21 | Use api version only in GoogleAdsHook not operators (#15266) |
| 76a80bb17c | 2021-05-19 | Move plyvel to google provider extra (#15812) |
| bb115da0b7 | 2021-05-17 | Get rid of requests as core dependency (#15781) |
| 9c8391a13f | 2021-05-10 | Fix spelling (#15699) |
| 3711a29e5e | 2021-05-09 | Fix argument ordering and type of bucket and object (#15738) |
| a01567c471 | 2021-05-08 | Fix sql_to_gcs docstring lint error (#15730) |
| f3fada9101 | 2021-05-07 | Add short description to BaseSQLToGCSOperator docstring (#15728) |
| 37681bca00 | 2021-05-07 | Auto-apply apply_default decorator (#15667) |
| b8c0fde38a | 2021-05-07 | Add extra links for google dataproc (#10343) |
| 3b4fdd0a7a | 2021-05-06 | add oracle connection link (#15632) |
| cf6324e43b | 2021-05-04 | Implement BigQuery Table Schema Update Operator (#15367) |
| 0f97a3970d | 2021-05-04 | Rename example bucket names to use INVALID BUCKET NAME by default (#15651) |
Latest change: 2021-05-01
| Commit | Committed | Subject |
|---|---|---|
| 807ad32ce5 | 2021-05-01 | Prepares provider release after PIP 21 compatibility (#15576) |
| 814e471d13 | 2021-04-29 | Update pre-commit checks (#15583) |
| bf2b48174a | 2021-04-27 | Add Connection Documentation for Providers (#15499) |
| 4b031d39e1 | 2021-04-27 | Make Airflow code Pylint 2.8 compatible (#15534) |
| e229f3541d | 2021-04-27 | Use Pip 21.* to install airflow officially (#15513) |
| 71c673e427 | 2021-04-22 | Update Docstrings of Modules with Missing Params (#15391) |
| 3b9a91806e | 2021-04-22 | Bugfix: Fix rendering of ''object_name'' in ''GCSToLocalFilesystemOperator'' (#15487) |
| c5e302030d | 2021-04-21 | Fix typo in DataprocCreateClusterOperator (#15462) |
| 42a1ca8aab | 2021-04-20 | Fixes wrongly specified path for leveldb hook (#15453) |
| 6da36bad2c | 2021-04-18 | [Airflow-15245] - passing custom image family name to the DataProcClusterCreateoperator (#15250) |
| f649905606 | 2021-04-15 | fix docstring typos (#15392) |
| 7bf69edca0 | 2021-04-08 | Fix typo in a docstring (#15276) |
Latest change: 2021-04-06
| Commit | Committed | Subject |
|---|---|---|
| 042be2e4e0 | 2021-04-06 | Updated documentation for provider packages before April release (#15236) |
| eae22cec9c | 2021-04-06 | Adds 'Trino' provider (with lower memory footprint for tests) (#15187) |
| e49722859b | 2021-04-05 | Updates 3.6 limits for latest versions of a few libraries (#15209) |
| 1d641d8f11 | 2021-04-01 | update remaining old import paths of operators (#15127) |
| 099c490cff | 2021-03-28 | Override project in dataprocSubmitJobOperator (#14981) |
| 5379698892 | 2021-03-27 | Improve docstrings for various modules (#15047) |
| a7ca1b3b0b | 2021-03-26 | Fix Sphinx Issues with Docstrings (#14968) |
| a7e144bec8 | 2021-03-23 | Google Dataflow Hook to handle no Job Type (#14914) |
| 72ea841b4b | 2021-03-22 | GCS to BigQuery Transfer Operator with Labels and Description parameter (#14881) |
| e172bd0e16 | 2021-03-22 | Update docstrings to adhere to sphinx standards (#14918) |
| 68e4c4dcb0 | 2021-03-20 | Remove Backport Providers (#14886) |
| ddc9133d36 | 2021-03-15 | Add GCS timespan transform operator (#13996) |
| 943baff670 | 2021-03-10 | Add job labels to bigquery check operators. (#14685) |
| 6dc24c95e3 | 2021-03-07 | Fix grammar and remove duplicate words (#14647) |
| e7bb17aeb8 | 2021-03-06 | Use built-in 'cached_property' on Python 3.8 where possible (#14606) |
| 7daebefd15 | 2021-03-05 | Use libyaml C library when available. (#14577) |
| 35c9a90292 | 2021-03-01 | Add Google leveldb hook and operator (#13109) (#14105) |
Latest change: 2021-02-27
| Commit | Committed | Subject |
|---|---|---|
| 589d6dec92 | 2021-02-27 | Prepare to release the next wave of providers: (#14487) |
| 50a1504c52 | 2021-02-27 | Fix spellings (#14483) |
| bfef559cf6 | 2021-02-27 | Corrects order of argument in docstring in GCSHook.download method (#14497) |
| 33214d9326 | 2021-02-26 | Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677) |
| c281979982 | 2021-02-23 | Documentation and example dag for CloudDLPDeidentifyContentOperator, GCSObjectExistenceSensor, GCSObjectsWithPrefixExistenceSensor (#14033) |
| ca35bd7f7f | 2021-02-21 | By default PIP will install all packages in .local folder (#14125) |
| a7e4266d67 | 2021-02-21 | Refactor GoogleDriveToGCSOperator to use common methods (#14276) |
| 1ab406663e | 2021-02-16 | Add GoogleDriveToLocalOperator (#14191) |
| 59c94c679e | 2021-02-13 | Add 'exists_ok' flag to BigQueryCreateEmptyTable(Dataset)Operator (#14026) |
| e31b27d593 | 2021-02-13 | Add materialized view support for BigQuery (#14201) |
| e3bcaa3ba3 | 2021-02-12 | Correct typo in GCSObjectsWtihPrefixExistenceSensor (#14179) |
| 7faa2d978c | 2021-02-10 | Add BigQueryUpdateTableOperator (#14149) |
| 1da6972165 | 2021-02-10 | Fixes to dataproc operators and hook (#14086) |
| 02288cf2ba | 2021-02-10 | Add param to CloudDataTransferServiceOperator (#14118) |
| 7d38645472 | 2021-02-09 | #9803 fix bug in copy operation without wildcard (#13919) |
| b0c382426c | 2021-02-07 | Add gdrive_to_gcs operator, drive sensor, additional functionality to drive hook, and supporting tests (#13982) |
| 5d7d46bb33 | 2021-02-05 | Improve GCSToSFTPOperator paths handling (#11284) |
| 10343ec29f | 2021-02-05 | Corrections in docs and tools after releasing provider RCs (#14082) |
Latest change: 2021-02-04
| Commit | Committed | Subject |
|---|---|---|
| 88bdcfa0df | 2021-02-04 | Prepare to release a new wave of providers. (#14013) |
| 1872d8719d | 2021-02-03 | Add Apache Beam operators (#12814) |
| 0e8c77b93a | 2021-02-03 | Support google-cloud-logging' >=2.0.0 (#13801) |
| 833e338323 | 2021-02-02 | Fix four bugs in StackdriverTaskHandler (#13784) |
| d2efb33239 | 2021-02-02 | Support google-cloud-monitoring>=2.0.0 (#13769) |
| ac2f72c98d | 2021-02-01 | Implement provider versioning tools (#13767) |
| 823741cfea | 2021-01-28 | Improve GCS system test envs (#13946) |
| 6d6588fe2b | 2021-01-28 | Add Google Cloud Workflows Operators (#13366) |
| 810c15ed85 | 2021-01-27 | Fix and improve GCP BigTable hook and system test (#13896) |
| 6616617331 | 2021-01-27 | Add env variables to PubSub example dag (#13794) |
| f473ca7130 | 2021-01-24 | Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851) |
| a9ac2b040b | 2021-01-23 | Switch to f-strings using flynt. (#13732) |
| 9592be88e5 | 2021-01-22 | Fix Google Spanner example dag (#13842) |
| af52fdb511 | 2021-01-22 | Improve environment variables in GCP Dataflow system test (#13841) |
| e7946f1cb7 | 2021-01-22 | Improve environment variables in GCP Datafusion system test (#13837) |
| 61c1d6ec6c | 2021-01-22 | Improve environment variables in GCP Memorystore system test (#13833) |
| 202f66093a | 2021-01-22 | Improve environment variables in GCP Lifeciences system test (#13834) |
| 70bf307f38 | 2021-01-21 | Add How To Guide for Dataflow (#13461) |
| 3fd5ef3555 | 2021-01-21 | Add missing logos for integrations (#13717) |
| 309788e5e2 | 2021-01-18 | Refactor DataprocOperators to support google-cloud-dataproc 2.0 (#13256) |
| 7ec858c452 | 2021-01-17 | updated Google DV360 Hook to fix SDF issue (#13703) |
| ef8617ec9d | 2021-01-14 | Support google-cloud-tasks>=2.0.0 (#13347) |
| 189af54043 | 2021-01-13 | Add system tests for Stackdriver operators (#13644) |
| a6f999b62e | 2021-01-11 | Support google-cloud-automl >=2.1.0 (#13505) |
| 947dbb73bb | 2021-01-11 | Support google-cloud-datacatalog>=3.0.0 (#13534) |
| 2fb68342b0 | 2021-01-07 | Replace deprecated module and operator in example_tasks.py (#13527) |
| 003584bbf1 | 2021-01-05 | Fix failing backport packages test (#13497) |
| 7d1ea4cb10 | 2021-01-05 | Replace deprecated module and operator in example_tasks.py (#13473) |
| c7d75ad887 | 2021-01-05 | Revert "Support google-cloud-datacatalog 3.0.0 (#13224)" (#13482) |
| feb84057d3 | 2021-01-04 | Support google-cloud-datacatalog 3.0.0 (#13224) |
| 3a3e739981 | 2021-01-04 | Fix insert_all method of BigQueryHook to support tables without schema (#13138) |
| c33d2c06b6 | 2021-01-02 | Fix another pylint c-extension-no-member (#13438) |
| f6518dd6a1 | 2021-01-02 | Generalize MLEngineStartTrainingJobOperator to custom images (#13318) |
| 9de7127083 | 2020-12-31 | Support google-cloud-bigquery-datatransfer>=3.0.0 (#13337) |
| 406181d64a | 2020-12-31 | Add Parquet data type to BaseSQLToGCSOperator (#13359) |
| 295d66f914 | 2020-12-30 | Fix Grammar in PIP warning (#13380) |
| 13a9747bf1 | 2020-12-28 | Revert "Support google-cloud-tasks>=2.0.0 (#13334)" (#13341) |
| 04ec45f045 | 2020-12-28 | Add DataprocCreateWorkflowTemplateOperator (#13338) |
| 1f712219fa | 2020-12-28 | Support google-cloud-tasks>=2.0.0 (#13334) |
| f4745c8ce1 | 2020-12-26 | Fix typo in example (#13321) |
| e9d65bd458 | 2020-12-24 | Decode Remote Google Logs (#13115) |
| e7aeacf335 | 2020-12-24 | Add OracleToGCS Transfer (#13246) |
| 323084e97d | 2020-12-24 | Add timeout option to gcs hook methods. (#13156) |
| 0b626c8042 | 2020-12-22 | Support google-cloud-redis>=2.0.0 (#13117) |
| 9042a58553 | 2020-12-22 | Add more operators to example DAGs for Cloud Tasks (#13235) |
| 8c00ec89b9 | 2020-12-22 | Support google-cloud-pubsub>=2.0.0 (#13127) |
| b26b0df5b0 | 2020-12-22 | Update compatibility with google-cloud-kms>=2.0 (#13124) |
| 9a1d3820d6 | 2020-12-22 | Support google-cloud-datacatalog>=1.0.0 (#13097) |
| f95b1c9c95 | 2020-12-21 | Add regional support to dataproc workflow template operators (#12907) |
| 6cf76d7ac0 | 2020-12-18 | Fix typo in pip upgrade command :( (#13148) |
| 23f27c1b1c | 2020-12-18 | Add system tests for CloudKMSHook (#13122) |
| cddbf81b12 | 2020-12-17 | Fix Google BigQueryHook method get_schema() (#13136) |
| 1259c712a4 | 2020-12-17 | Update compatibility with google-cloud-os-login>=2.0.0 (#13126) |
| bcf77586ef | 2020-12-16 | Fix Data Catalog operators (#13096) |
| 5090fb0c89 | 2020-12-15 | Add script to generate integrations.json (#13073) |
| b4b9cf5597 | 2020-12-14 | Check for missing references to operator guides (#13059) |
| 1c1ef7ee69 | 2020-12-14 | Add project_id to client inside BigQuery hook update_table method (#13018) |
Latest change: 2020-12-09
| Commit | Committed | Subject |
|---|---|---|
| 32971a1a2d | 2020-12-09 | Updates providers versions to 1.0.0 (#12955) |
| b40dffa085 | 2020-12-08 | Rename remaing modules to match AIP-21 (#12917) |
| 9b39f24780 | 2020-12-08 | Add support for dynamic connection form fields per provider (#12558) |
| 1dcd3e13fd | 2020-12-05 | Add support for extra links coming from the providers (#12472) |
| 2037303eef | 2020-11-29 | Adds support for Connection/Hook discovery from providers (#12466) |
| 02d94349be | 2020-11-29 | Don't use time.time() or timezone.utcnow() for duration calculations (#12353) |
| 76bcd08dca | 2020-11-28 | Added '@apply_defaults' decorator. (#12620) |
| e1ebfa68b1 | 2020-11-27 | Add DataflowJobMessagesSensor and DataflowAutoscalingEventsSensor (#12249) |
| 3fa51f94d7 | 2020-11-24 | Add check for duplicates in provider.yaml files (#12578) |
| c34ef853c8 | 2020-11-20 | Separate out documentation building per provider (#12444) |
| 9e3b2c554d | 2020-11-19 | GCP Secrets Optional Lookup (#12360) |
| 0080354502 | 2020-11-18 | Update provider READMEs for 1.0.0b2 batch release (#12449) |
| 7ca0b6f121 | 2020-11-18 | Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438) |
| 8d09506464 | 2020-11-18 | Fix download method in GCSToBigQueryOperator (#12442) |
| 2c0920fba5 | 2020-11-17 | Adds mechanism for provider package discovery. (#12383) |
| 2cda2f2a0a | 2020-11-17 | Add missing pre-commit definition - provider-yamls (#12393) |
| 80a957f142 | 2020-11-17 | Add Dataflow sensors - job metrics (#12039) |
| ae7cb4a1e2 | 2020-11-17 | Update wrong commit hash in backport provider changes (#12390) |
| 917e6c4424 | 2020-11-16 | Add provide_file_and_upload to GCSHook (#12310) |
| cfa4ecfeb0 | 2020-11-15 | Add DataflowJobStatusSensor and support non-blocking execution of jobs (#11726) |
| 6889a333cf | 2020-11-15 | Improvements for operators and hooks ref docs (#12366) |
| 7825e8f590 | 2020-11-13 | Docs installation improvements (#12304) |
| 32b59f8350 | 2020-11-12 | Fixes the sending of an empty list to BigQuery 'list_rows' (#12307) |
| 250436d962 | 2020-11-10 | Fix spelling in Python files (#12230) |
| 502ba309ea | 2020-11-10 | Enable Markdownlint rule - MD022/blanks-around-headings (#12225) |
| dd2095f4a8 | 2020-11-10 | Simplify string expressions & Use f-string (#12216) |
| f37c6e6fce | 2020-11-10 | Add Compute Engine SSH hook (#9879) |
| 85a18e13d9 | 2020-11-09 | Point at pypi project pages for cross-dependency of provider packages (#12212) |
| 59eb5de78c | 2020-11-09 | Update provider READMEs for up-coming 1.0.0beta1 releases (#12206) |
| 61feb6ec45 | 2020-11-09 | Provider's readmes generated for elasticsearch and google packages (#12194) |
| b2a28d1590 | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
| fcb6b00efe | 2020-11-08 | Add authentication to AWS with Google credentials (#12079) |
| 2ef3b7ef8c | 2020-11-08 | Fix ERROR - Object of type 'bytes' is not JSON serializable when using store_to_xcom_key parameter (#12172) |
| 0caec9fd32 | 2020-11-06 | Dataflow - add waiting for successful job cancel (#11501) |
| cf9437d79f | 2020-11-06 | Simplify string expressions (#12123) |
| 91a64db505 | 2020-11-04 | Format all files (without excepions) by black (#12091) |
| fd3db778e7 | 2020-11-04 | Add server side cursor support for postgres to GCS operator (#11793) |
| f1f1940261 | 2020-11-04 | Add DataflowStartSQLQuery operator (#8553) |
| 41bf172c1d | 2020-11-04 | Simplify string expressions (#12093) |
| 5f5244b74d | 2020-11-04 | Add template fields renderers to Biguery and Dataproc operators (#12067) |
| 4e8f9cc8d0 | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
| 8c42cf1b00 | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
| 45ae145c25 | 2020-11-03 | Log BigQuery job id in insert method of BigQueryHook (#12056) |
| e324b37a67 | 2020-11-03 | Add job name and progress logs to Cloud Storage Transfer Hook (#12014) |
| 6071fdd584 | 2020-11-02 | Improve handling server errors in DataprocSubmitJobOperator (#11947) |
| 2f703df12d | 2020-10-30 | Add SalesforceToGcsOperator (#10760) |
| e5713e00b3 | 2020-10-29 | Add drain option when canceling Dataflow pipelines (#11374) |
| 37eaac3c5d | 2020-10-29 | The PRs which are not approved run subset of tests (#11828) |
| 79cb771992 | 2020-10-28 | Fixing re pattern and changing to use a single character class. (#11857) |
| 5a439e84eb | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
| 240c7d4d72 | 2020-10-26 | Google Memcached hooks - improve protobuf messages handling (#11743) |
| 8afdb6ac6a | 2020-10-26 | Fix spellings (#11825) |
| 872b1566a1 | 2020-10-25 | Generated backport providers readmes/setup for 2020.10.29 (#11826) |
| 6ce855af11 | 2020-10-24 | Fix spelling (#11821) |
| 4830687453 | 2020-10-24 | Use Python 3 style super classes (#11806) |
| 727c739afb | 2020-10-22 | Improve Cloud Memorystore for Redis example (#11735) |
| 1da8379c91 | 2020-10-22 | Fix static checks after merging #10121 (#11737) |
| 91503308c7 | 2020-10-22 | Add Google Cloud Memorystore Memcached Operators (#10121) |
| 950c16d0b0 | 2020-10-21 | Retry requests in case of error in Google ML Engine Hook (#11712) |
| 2bfc53b5eb | 2020-10-21 | Fix doc errors in google provider files. (#11713) |
| 53e6062105 | 2020-10-21 | Enforce strict rules for yamllint (#11709) |
| 349b0811c3 | 2020-10-20 | Add D200 pydocstyle check (#11688) |
| 2d854c3505 | 2020-10-19 | Add service_account to Google ML Engine operator (#11619) |
| 46a121fb7b | 2020-10-18 | docs: Update Bigquery clustering docstrings (#11232) |
| 49c58147fe | 2020-10-18 | Strict type checking for provider Google (#11609) |
| 0823d46a7f | 2020-10-16 | Add type annotations for AWS operators and hooks (#11434) |
| 3c10ca6504 | 2020-10-16 | Add DataflowStartFlexTemplateOperator (#8550) |
| 8865d14df4 | 2020-10-16 | Strict type checking for provider google cloud (#11548) |
| 16e7129719 | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
| 06141d6d01 | 2020-10-12 | Google cloud operator strict type check (#11450) |
| d305876bee | 2020-10-12 | Remove redundant None provided as default to dict.get() (#11448) |
| 1845cd11b7 | 2020-10-11 | Strict type check for google ads and cloud hooks (#11390) |
| bd204bb91b | 2020-10-11 | Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409) |
| 75071831ba | 2020-10-10 | Remove redundant parentheses from Python files (#10967) |
| 8baf657fc2 | 2020-10-09 | Fix regression in DataflowTemplatedJobStartOperator (#11167) |
| b0fcf67559 | 2020-10-07 | Add AzureFileShareToGCSOperator (#10991) |
| 47b05a87f0 | 2020-10-07 | Improve handling of job_id in BigQuery operators (#11287) |
| 0a0e1af800 | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
| ca4238eb4d | 2020-10-02 | Fixed month in backport packages to October (#11242) |
| 5220e4c384 | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
| cb52fb0ae1 | 2020-09-27 | Add example DAG and system test for MySQLToGCSOperator (#10990) |
| 99accec29d | 2020-09-25 | Fix incorrect Usage of Optional[str] & Optional[int] (#11141) |
| e3f96ce7a8 | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
| daf8f31080 | 2020-09-23 | Add template fields renderers for better UI rendering (#11061) |
| f3e87c5030 | 2020-09-22 | Add D202 pydocstyle check (#11032) |
| cb979f9f21 | 2020-09-22 | Get Airflow configs with sensitive data from CloudSecretManagerBackend (#11024) |
| 76545bb3d6 | 2020-09-16 | Add example dag and system test for S3ToGCSOperator (#10951) |
| 22c631625f | 2020-09-16 | Fix more docs spellings (#10965) |
| 12a652f534 | 2020-09-13 | Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869) |
| 41a62735ed | 2020-09-11 | Add on_kill method to BigQueryInsertJobOperator (#10866) |
| 3e91da56e8 | 2020-09-11 | fix typo in firebase/example_filestore DAG (#10875) |
| 68cc7273bf | 2020-09-10 | Add on_kill method to DataprocSubmitJobOperator (#10847) |
| f920957214 | 2020-09-10 | Fix and remove some more typos from spelling_wordlist.txt (#10845) |
| 9549274d11 | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
| 078bfaf60a | 2020-09-08 | Extract missing gcs_to_local example DAG from gcs example (#10767) |
| 10ce31127f | 2020-09-08 | Deprecate using global as the default region in Google Dataproc operators and hooks (#10772) |
| f14f379716 | 2020-09-07 | [AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773) |
| c8ee455685 | 2020-09-07 | Refactor DataprocCreateCluster operator to use simpler interface (#10403) |
| ece685b5b8 | 2020-09-05 | Asynchronous execution of Dataproc jobs with a Sensor (#10673) |
| 6e3d7b63d3 | 2020-09-04 | Add masterConfig parameter to MLEngineStartTrainingJobOperator (#10578) |
| 804548d58f | 2020-09-01 | Add Dataprep operators (#10304) |
| 11c00bc820 | 2020-08-30 | Fix typos: duplicated "the" (#10647) |
| 2ca615cffe | 2020-08-29 | Update Google Cloud branding (#10642) |
| 1b533f617e | 2020-08-28 | Fix broken master - DLP (#10635) |
| 5ae82a56da | 2020-08-28 | Fix Google DLP example and improve ops idempotency (#10608) |
| 3867f76625 | 2020-08-28 | Update Google Cloud branding (#10615) |
| 91ff31ad10 | 2020-08-27 | Documentation for Google Cloud Data Loss Prevention (#8201) (#9651) |
| fdd9b6f65b | 2020-08-25 | Enable Black on Providers Packages (#10543) |
| d760265452 | 2020-08-25 | PyDocStyle: No whitespaces allowed surrounding docstring text (#10533) |
| d1bce91bb2 | 2020-08-25 | PyDocStyle: Enable D403: Capitalized first word of docstring (#10530) |
| 866701c801 | 2020-08-25 | Fix typo in "Cloud" (#10534) |
| 47265e7b58 | 2020-08-24 | Fix typo in PostgresHook (#10529) |
| 3696c34c28 | 2020-08-24 | Fix typo in the word "release" (#10528) |
| 2f2d8dbfaf | 2020-08-25 | Remove all "noinspection" comments native to IntelliJ (#10525) |
| 3734876d98 | 2020-08-24 | Implement impersonation in google operators (#10052) |
| b0598b5351 | 2020-08-24 | Add support for creating multiple replicated clusters in Bigtable hook and operator (#10475) |
| ee7ca128a1 | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
| 515cc72c99 | 2020-08-22 | Fix typo in timed_out (#10459) |
| 7c206a82a6 | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
| 88c7d2e526 | 2020-08-21 | Dataflow operators don't not always create a virtualenv (#10373) |
| 083c3c129b | 2020-08-18 | Simplified GCSTaskHandler configuration (#10365) |
| 1ae5bdf23e | 2020-08-17 | Add test for GCSTaskHandler (#9600) (#9861) |
| e195a980bc | 2020-08-16 | Add type annotations for mlengine_operator_utils (#10297) |
| 382c1011b6 | 2020-08-16 | Add Bigtable Update Instance Hook/Operator (#10340) |
| bfa5a8d5f1 | 2020-08-15 | CI: Fix failing docs-build (#10342) |
| be46d20fb4 | 2020-08-15 | Improve idempotency of BigQueryInsertJobOperator (#9590) |
| 47387a69e6 | 2020-08-14 | Catch Permission Denied exception when getting secret from GCP Secret Manager. (#10326) |
| 2f0613b0c2 | 2020-08-13 | Implement Google BigQuery Table Partition Sensor (#10218) |
| f6734b3b85 | 2020-08-12 | Enable Sphinx spellcheck for doc generation (#10280) |
| 8f8db8959e | 2020-08-12 | DbApiHook: Support kwargs in get_pandas_df (#9730) |
| ef088314f8 | 2020-08-09 | Added DataprepGetJobsForJobGroupOperator (#10246) |
| b43f90abf4 | 2020-08-09 | Fix various typos in the repo (#10263) |
| c29533888f | 2020-08-08 | Add labels param to Google MLEngine Operators (#10222) |
| cdec301254 | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
| eff0f03210 | 2020-08-06 | `` Update guide for Google Cloud Secret Manager Backend (#10172)`` |
| 24c8e4c2d6 | 2020-08-06 | Changes to all the constructors to remove the args argument (#10163) |
| 010322692e | 2020-08-06 | Improve handling Dataproc cluster creation with ERROR state (#9593) |
| 1437cb7495 | 2020-08-04 | Add correct signatures for operators in google provider package (#10144) |
| 6efa1b9cb7 | 2020-08-03 | Add additional Cloud Datastore operators (#10032) |
| 27020f8e58 | 2020-08-03 | Add try clause to DataFusionHook.wait_for_pipeline_state (#10031) |
| 4e3799fec4 | 2020-08-02 | [AIRFLOW-4541] Replace os.mkdirs usage with pathlib.Path(path).mkdir (#10117) |
| 85c56b1737 | 2020-08-02 | Add missing params to GCP Pub/Sub creation_subscription (#10106) |
| b79466c12f | 2020-08-02 | Fix sensor not providing arguments for GCSHook (#10074) |
| 4ee35d0279 | 2020-08-02 | Fix hook not passing gcp_conn_id to base class (#10075) |
| aeea71274d | 2020-08-02 | Remove 'args' parameter from provider operator constructors (#10097) |
| 4c84661adb | 2020-07-31 | Split Display Video 360 example into smaler DAGs (#10077) |
| 59cbff0874 | 2020-07-29 | Fix docstrings in BigQueryGetDataOperator (#10042) |
| 81b87d48ed | 2020-07-27 | Add unit tests for GcpBodyFieldSanitizer in Google providers (#9996) |
| 7d24b088cd | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
| 8b10a4b35e | 2020-07-25 | Stop using start_date in default_args in example_dags (#9982) |
| ef98edf4da | 2020-07-23 | Add more information about using GoogleAdsHook (#9951) |
| 33f0cd2657 | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
| 39a0288a47 | 2020-07-22 | Add Google Authentication for experimental API (#9848) |
| c2db0dfeb1 | 2020-07-22 | More strict rules in mypy (#9705) (#9906) |
| c4244e18bb | 2020-07-22 | Fix calling 'get_client' in BigQueryHook.table_exists (#9916) |
| 5eacc16420 | 2020-07-22 | Add support for impersonation in GCP hooks (#9915) |
| 1cfdebf5f8 | 2020-07-21 | Fix insert_job method of BigQueryHook (#9899) |
| c8c52e69c8 | 2020-07-21 | Remove type hint causing DeprecationWarning in Firestore operators (#9819) |
| eb6f1d1cf0 | 2020-07-16 | Fix typo in datafusion operator (#9859) |
| b01d95ec22 | 2020-07-15 | Change DAG.clear to take dag_run_state (#9824) |
| 6d65c15d15 | 2020-07-15 | Add guide for AI Platform (previously Machine Learning Engine) Operators (#9798) |
| 770de53eb5 | 2020-07-15 | BigQueryTableExistenceSensor needs to specify keyword arguments (#9832) |
| 2d8dbacdf6 | 2020-07-15 | Add CloudVisionDeleteReferenceImageOperator (#9698) |
| 9f017951b9 | 2020-07-15 | Add Google Deployment Manager Hook (#9159) |
| ed5004cca7 | 2020-07-14 | Allow 'replace' flag in gcs_to_gcs operator. (#9667) |
| 553bb7af7c | 2020-07-13 | Keep functions signatures in decorators (#9786) |
| 68925904e4 | 2020-07-13 | Add multiple file upload functionality to GCS hook (#8849) |
| 1de78e8f97 | 2020-07-12 | Add Google Stackdriver link (#9765) |
| 092d33f298 | 2020-07-11 | Fix StackdriverTaskHandler + add system tests (#9761) |
| b2305660f0 | 2020-07-09 | Update example DAG for AI Platform operators (#9727) |
| 23f80f34ad | 2020-07-08 | Move gcs & wasb task handlers to their respective provider packages (#9714) |
| 44d4ae809c | 2020-07-06 | Upgrade to latest pre-commit checks (#9686) |
| a79e2d4c4a | 2020-07-06 | Move provider's log task handlers to the provider package (#9604) |
| cd3d9d9340 | 2020-07-02 | Fix using .json template extension in GMP operators (#9566) |
| 4799af30ee | 2020-06-30 | Extend BigQuery example with include clause (#9572) |
| e33f1a12d7 | 2020-06-30 | Add template_ext to BigQueryInsertJobOperator (#9568) |
| 40add26d45 | 2020-06-29 | Remove almost all references to airflow.contrib (#9559) |
| c420dbd6e1 | 2020-06-27 | Bump Pylint to 2.5.3 (#9294) |
| 0051c89cba | 2020-06-26 | nitpick fix (#9527) |
| 87fdbd0708 | 2020-06-25 | Use literal syntax instead of function calls to create data structure (#9516) |
| 7256f4caa2 | 2020-06-22 | Pylint fixes and deprecation of rare used methods in Connection (#9419) |
| e13a14c873 | 2020-06-21 | Enable & Fix Whitespace related PyDocStyle Checks (#9458) |
| 5b680e27e8 | 2020-06-19 | Don't use connection to store task handler credentials (#9381) |
| d0e7db4024 | 2020-06-19 | Fixed release number for fresh release (#9408) |
| 416334e2ec | 2020-06-19 | Properly propagated warnings in operators (#9348) |
| 12af6a0800 | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
| c7e5bce57f | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
| 4e09c64423 | 2020-06-18 | Adds GCP Secret Manager Hook (#9368) |
| 40bf8f28f9 | 2020-06-18 | Detect automatically the lack of reference to the guide in the operator descriptions (#9290) |
| f6bd817a3a | 2020-06-16 | Introduce 'transfers' packages (#9320) |
| 639972d995 | 2020-06-16 | Add support for latest Apache Beam SDK in Dataflow operators (#9323) |
| 1459970b3b | 2020-06-15 | Rename CloudBuildCreateBuildOperator to CloudBuildCreateOperator (#9314) |
| 431ea3291c | 2020-06-15 | Resolve upstream tasks when template field is XComArg (#8805) |
| aee6ab94eb | 2020-06-15 | Wait for pipeline state in Data Fusion operators (#8954) |
| fb1c8b83d4 | 2020-06-10 | Add test for BQ operations using location (#9206) |
| a26afbfa51 | 2020-06-10 | Make generated job_id more informative in BQ insert_job (#9203) |
| c41192fa1f | 2020-06-10 | Upgrade pendulum to latest major version ~2.0 (#9184) |
| b1c8c5ed5b | 2020-06-09 | Allows using private endpoints in GKEStartPodOperator (#9169) |
| 5918efc86a | 2020-06-05 | Add 3.8 to the test matrices (#8836) |
| 9bcdadaf7e | 2020-06-05 | Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154) |
| f56811dff3 | 2020-06-05 | [AIRFLOW-6290] Create guide for GKE operators (#8883) |
| 76962867b5 | 2020-06-04 | Fix sql_to_gcs hook gzip of schema_file (#9140) |
| 17adcea835 | 2020-06-02 | Fix handling of subprocess error handling in s3_file_transform and gcs (#9106) |
| 7898525468 | 2020-06-01 | Add BigQueryInsertJobOperator (#8868) |
| 29eb68b90b | 2020-05-31 | Create guide for Dataproc Operators (#9037) |
| 886afaf622 | 2020-05-29 | Add example dag and system test for LocalFilesystemToGCSOperator (#9043) |
| a779c4dfc2 | 2020-05-29 | add separate example dags and system tests for GCSToGoogleSheetsOperator (#9066) |
| ada26be23c | 2020-05-29 | Add correct description for dst param in LocalFilesystemToGCSOperator (#9055) |
| 81b2761b86 | 2020-05-29 | add example dag and system test for GoogleSheetsToGCSOperator (#9056) |
| 0b0e4f7a4c | 2020-05-26 | Preparing for RC3 relase of backports (#9026) |
| 00642a46d0 | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
| 3994030ea6 | 2020-05-26 | Refactor BigQuery operators (#8858) |
| cdb3f25456 | 2020-05-26 | All classes in backport providers are now importable in Airflow 1.10 (#8991) |
| 1d36b0303b | 2020-05-23 | Fix references in docs (#8984) |
| cf5cf45e1c | 2020-05-23 | Support YAML input for CloudBuildCreateOperator (#8808) |
| 499493c5c5 | 2020-05-19 | [AIRFLOW-6586] Improvements to gcs sensor (#7197) |
| 375d1ca229 | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
| 841d816647 | 2020-05-19 | Allow setting the pooling time in DLPHook (#8824) |
| 12c5e5d8ae | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
| f3521fb0e3 | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
| 15273f0ea0 | 2020-05-16 | Check for same task instead of Equality to detect Duplicate Tasks (#8828) |
| 92585ca4cb | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
| e1e833bb26 | 2020-05-13 | Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816) |
| 8b54919711 | 2020-05-12 | Refactor BigQuery hook methods to use python library (#8631) |
| 6911dfe837 | 2020-05-12 | Fix template fields in Google operators (#8840) |
| 4b06fde0f1 | 2020-05-12 | Fix Flake8 errors (#8841) |
| 1d12c347cb | 2020-05-12 | Refactor BigQuery check operators (#8813) |
| 493b685d78 | 2020-05-10 | Add separate example DAGs and system tests for google cloud speech (#8778) |
| 79ef8bed89 | 2020-05-10 | Added Upload Multiple Entity Read Files to specified big query dataset (#8610) |
| 280f1f0c4c | 2020-05-10 | Correctly restore upstream_task_ids when deserializing Operators (#8775) |
| 58aefb23b1 | 2020-05-08 | Added SDFtoGCSOperator (#8740) |
| 723c52c942 | 2020-05-07 | Add documentation for SpannerDeployInstanceOperator (#8750) |
| 25ee4211b3 | 2020-05-06 | Support all RuntimeEnvironment parameters in DataflowTemplatedJobStartOperator (#8531) |
| 8d6f1aa4b5 | 2020-05-05 | Support num_retries field in env var for GCP connection (#8700) |
| 67caae0f25 | 2020-05-04 | Add system test for gcs_to_bigquery (#8556) |
| bc45fa6759 | 2020-05-03 | Add system test and docs for Facebook Ads operators (#8503) |
| a28c66f23d | 2020-04-30 | [AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625) |
| 992a24ce41 | 2020-04-28 | Split and improve BigQuery example DAG (#8529) |
| c1fb28230f | 2020-04-28 | Refactor BigQueryHook dataset operations (#8477) |
| e8d0f8feab | 2020-04-26 | Improve idempodency in CloudDataTransferServiceCreateJobOperator (#8430) |
| 37fdfa9775 | 2020-04-26 | [AIRFLOW-6281] Create guide for GCS to GCS transfer operators (#8442) |
| 14b22e6ffe | 2020-04-25 | Add hook and operator for Google Cloud Life Sciences (#8481) |
| 72ddc94d1e | 2020-04-23 | Pass location using parmamter in Dataflow integration (#8382) |
| 912aa4b423 | 2020-04-23 | Added GoogleDisplayVideo360DownloadLineItemsOperator (#8174) |
| 57c8c05839 | 2020-04-22 | Use python client in BQ hook create_empty_table/dataset and table_exists (#8377) |
| 5d3a7eef30 | 2020-04-20 | Allow multiple extra_packages in Dataflow (#8394) |
| 79c99b1b6a | 2020-04-18 | Added location parameter to BigQueryCheckOperator (#8273) |
| 79d3f33c1b | 2020-04-17 | Clean up temporary files in Dataflow operators (#8313) |
| efcffa323d | 2020-04-16 | Add Dataproc SparkR Example (#8240) |
| b198a1fa94 | 2020-04-15 | Create guide for BigQuery operators (#8276) |
| 2636cc932c | 2020-04-14 | Raise exception when GCP credential doesn't support account impersonation (#8213) |
| eee4ebaeeb | 2020-04-14 | Added Facebook Ads Operator #7887 (#8008) |
| 8cae07ea18 | 2020-04-14 | fixed typo (#8294) |
| 45c8983306 | 2020-04-13 | Less aggressive eager upgrade of requirements (#8267) |
| 1fd9ed3840 | 2020-04-13 | Add mypy plugin for decorators. (#8145) |
| 327b0a9f77 | 2020-04-13 | Added GoogleDisplayVideo360UploadLineItemsOperator (#8216) |
| bb5e403a32 | 2020-04-10 | Honor schema type for MySQL to GCS data pre-process (#8090) |
| 87969a350d | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |
| 3fc89f29f5 | 2020-04-06 | [AIRFLOW-7106] Cloud data fusion integration - Allow to pass args to start pipeline (#7849) |
| 7ef75d2393 | 2020-04-03 | [AIRFLOW-7117] Honor self.schema in sql_to_gcs as schema to upload (#8049) |
| ed2bc00576 | 2020-04-02 | Add Google Ads list accounts operator (#8007) |
| 3808a6206e | 2020-04-01 | Unify Google class/package names (#8033) |
| 8a02402576 | 2020-03-31 | Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011) |
| 8e89780071 | 2020-03-31 | Add more refactor steps for providers.google (#8010) |
| aae3b8fb27 | 2020-03-31 | Individual package READMEs (#8012) |
| 779023968f | 2020-03-30 | [AIRFLOW-7075] Operators for storing information from GCS into GA (#7743) |
| 49abce5217 | 2020-03-30 | Improve system tests for Cloud Build (#8003) |
| 0f19a930d1 | 2020-03-29 | Remove GKEStartPodOperator when backporting (#7908) |
| 0e1c238b2f | 2020-03-28 | Get Airflow Variables from GCP Secrets Manager (#7946) |
| eb4af4f944 | 2020-03-28 | Make BaseSecretsBackend.build_path generic (#7948) |
| 01f99426fd | 2020-03-28 | Add download/upload operators for GCS and Google Sheets (#7866) |
| 892522f8e2 | 2020-03-26 | Change signature of GSheetsHook methods (#7853) |
| bfd425157a | 2020-03-26 | Improve idempotency in MLEngineHook.create_model (#7811) |
| f9c226343d | 2020-03-26 | Fix CloudSecretsManagerBackend invalid connections_prefix (#7861) |
| e3920f12f4 | 2020-03-26 | Improve setUp/tearDown in Cloud Firestore system test (#7862) |
| 8ba8a7295a | 2020-03-26 | Improve example DAGs for Cloud Memorystore (#7855) |
| f7d1a437c1 | 2020-03-26 | Fix CloudMemorystoreCreateInstanceAndImportOperator operator (#7856) |
| beef6c230e | 2020-03-26 | Improve authorization in GCP system tests (#7863) |
| 5f165f3e42 | 2020-03-26 | [AIRFLOW-5801] Get GCP credentials from file instead of JSON blob (#7869) |
| 686d7d50bd | 2020-03-25 | Standardize SecretBackend class names (#7846) |
| 1982c3fdca | 2020-03-24 | Run Dataflow for ML Engine summary in venv (#7809) |
| eef87b9953 | 2020-03-23 | [AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830) |
| 529db07b2e | 2020-03-23 | Improve Google PubSub hook publish method (#7831) |
| 4bde99f132 | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
| a001489b59 | 2020-03-23 | Improve example DAG for ML Engine (#7810) |
| 9e5a8e7f83 | 2020-03-23 | Add call to Super class in 'google' providers (#7823) |
| b86bf79bff | 2020-03-23 | Fix typo in GCP credentials_provider's docstring (#7818) |
| 56c013ce92 | 2020-03-23 | Add missing docstring in BigQueryHook.create_empty_table (#7817) |
| 426a79847c | 2020-03-23 | Imrove support for laatest API in MLEngineStartTrainingJobOperator (#7812) |
| cdf1809fce | 2020-03-23 | [AIRFLOW-7104] Add Secret backend for GCP Secrets Manager (#7795) |
| 27dac00e12 | 2020-03-22 | [AIRFLOW-7099] Improve system test for cloud transfer service (#7794) |
| 0daf5d729a | 2020-03-22 | Add ability to specify a maximum modified time for objects in GCSToGCSOperator (#7791) |
| c8088c2bd7 | 2020-03-20 | [AIRFLOW-7100] Add GoogleAnalyticsGetAdsLinkOperator (#7781) |
| 5106a29314 | 2020-03-20 | [AIRFLOW-6752] Add GoogleAnalyticsRetrieveAdsLinksListOperator (#7748) |
| 759ce2a80c | 2020-03-20 | [AIRFLOW-6978] Add PubSubPullOperator (#7766) |
| 6b9b214e4c | 2020-03-20 | [AIRFLOW-6732] Add GoogleAdsHook and GoogleAdsToGcsOperator (#7692) |
| b118916969 | 2020-03-19 | [AIRFLOW-7069] Fix cloudsql system tests (#7770) |
| ae854cae5a | 2020-03-19 | [AIRFLOW-7082] Remove catch_http_exception decorator in GCP hooks (#7756) |
| 7e1e954d23 | 2020-03-19 | [AIRFLOW-7085] Cache credentials, project_id in GCP Base Hook (#7759) |
| 6e21c139b3 | 2020-03-19 | [AIRFLOW-XXXX] Fix reference to GCP classes in guides (#7762) |
| ce022a3f72 | 2020-03-19 | [AIRFLOW-XXXX] Add cross-references for operators guide (#7760) |
| 029c84e552 | 2020-03-18 | [AIRFLOW-5421] Add Presto to GCS transfer operator (#7718) |
| 63a3102ede | 2020-03-18 | [AIRFLOW-7064] Add CloudFirestoreExportDatabaseOperator (#7725) |
| 73305c7bd5 | 2020-03-18 | [AIRFLOW-7081] Remove env variables from GCP guide (#7755) |
| 60fdbf6d92 | 2020-03-18 | [AIRFLOW-5610] Add ability to specify multiple objects to copy in GCSToGCSOperator (#7728) |
| de7e934ca3 | 2020-03-17 | [AIRFLOW-7079] Remove redundant code for storing template_fields (#7750) |
| 0de0347b27 | 2020-03-17 | [AIRFLOW-6855]: Escape project_dataset_table in SQL query in gcs to bq … (#7475) |
| 91557c6f87 | 2020-03-17 | [AIRFLOW-7073] GKEStartPodOperator always use connection credentials (#7738) |
| 51161dbd9d | 2020-03-16 | [AIRFLOW-5664] Store timestamps with microseconds precision (#6354) |
| 2bc020c431 | 2020-03-14 | [AIRFLOW-7055] Verbose logging option for google provider (#7711) |
| c997cab42d | 2020-03-13 | [AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator (#7630) |
| 137896f326 | 2020-03-12 | [AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op (#7685) |
| 1f77f943d5 | 2020-03-10 | [AIRFLOW-6980] Improve system tests and building providers package (#7615) |
| bf9b6b6d70 | 2020-03-09 | [AIRFLOW-5013] Add GCP Data Catalog Hook and operators (#7664) |
| e5130dc9fe | 2020-03-09 | [AIRFLOW-2911] Add job cancellation capability to Dataflow service (#7659) |
| faf0df4b94 | 2020-03-09 | [AIRFLOW-XXXX] Fix upsert operator in BQ example DAG (#7666) |
| 42eef38217 | 2020-03-07 | [AIRFLOW-6877] Add cross-provider dependencies as extras (#7506) |
| b5b9795f04 | 2020-03-07 | [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (fix) (#7624) |
| 6b65038fb4 | 2020-03-06 | [AIRFLOW-6990] Improve system tests for Google Marketing Platform (#7631) |
| 755fe52249 | 2020-03-05 | [AIRFLOW-6915] Add AI Platform Console Link for MLEngineStartTrainingJobOperator (#7535) |
| cb2f339116 | 2020-03-04 | [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (#7609) |
| 09fea3ce8e | 2020-03-04 | [AIRFLOW-6977] Fix BigQuery DTS example DAG (#7612) |
| 8230ccc48b | 2020-03-04 | [AIRFLOW-6926] Fix Google Tasks operators return types and idempotency (#7547) |
| 0d1e3088aa | 2020-03-04 | [AIRFLOW-6970] Improve GCP Video Intelligence system tests (#7604) |
| ab6bb0012c | 2020-03-03 | [AIRFLOW-6971] Fix return type in CloudSpeechToTextRecognizeSpeechOperator (#7607) |
| 3db4ade3dc | 2020-02-29 | [AIRFLOW-6924] Fix Google DLP operators return types (#7546) |
| 008b4bab14 | 2020-02-27 | [AIRFLOW-6730] Use total_seconds instead of seconds (#7363) |
| bb552b2d9f | 2020-02-25 | [AIRFLOW-6908] Lazy load AirflowException (#7528) |
| d1a34246ac | 2020-02-25 | [AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators (#7322) |
| 3320e432a1 | 2020-02-24 | [AIRFLOW-6817] Lazy-load 'airflow.DAG' to keep user-facing API untouched (#7517) |
| dcf8743521 | 2020-02-24 | [AIRFLOW-6894] Prevent db query in example_dags (#7516) |
| 4d03e33c11 | 2020-02-22 | [AIRFLOW-6817] remove imports from 'airflow/__init__.py', replaced implicit imports with explicit imports, added entry to 'UPDATING.MD' - squashed/rebased (#7456) |
| 35b9616378 | 2020-02-21 | [AIRFLOW-4973] Add Cloud Data Fusion Pipeline integration (#7486) |
| aff3a361b4 | 2020-02-20 | [AIRFLOW-6558] Campaign Manager operators for conversions (#7420) |
| 9cbd7de6d1 | 2020-02-18 | [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412) |
| 5b199cb86b | 2020-02-17 | [AIRFLOW-XXXX] Typo in example_bigquery DAG (#7429) |
| 2c9345a8e0 | 2020-02-17 | [AIRFLOW-6759] Added MLEngine operator/hook to cancel MLEngine jobs (#7400) |
| 946bdc23c0 | 2020-02-16 | [AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator (#7126) |
| 2381c820c8 | 2020-02-13 | [AIRFLOW-6505] Let emoji encoded properly for json.dumps() (#7399) |
| 04c1fefbf2 | 2020-02-03 | [AIRFLOW-6676] added GCSDeleteBucketOperator (#7307) |
| a0252748ff | 2020-02-03 | [AIRFLOW-6717] Remove non-existent field from templated_fields (#7340) |
| 97a429f9d0 | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
| 9d8d075578 | 2020-02-03 | [AIRFLOW-6715] Fix Google Cloud DLP Example DAG (#7337) |
| cf141506a2 | 2020-02-02 | [AIRFLOW-6708] Set unique logger names (#7330) |
| 373c6aa4a2 | 2020-01-30 | [AIRFLOW-6682] Move GCP classes to providers package (#7295) |
| 83c037873f | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
| 057f3ae3a4 | 2020-01-29 | [AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286) |
| ceea293c16 | 2020-01-28 | [AIRFLOW-6656] Fix AIP-21 moving (#7272) |
| c42a375e79 | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
| 059eda05f8 | 2020-01-21 | [AIRFLOW-6610] Move software classes to providers package (#7231) |
| f4d3e5e545 | 2020-01-13 | [AIRFLOW-6102] [AIP-21] Rename Dataproc operators (#7151) |
| e7bf8ecb48 | 2020-01-13 | [AIRFLOW-6119] [AIP-21] Rename GCS operators, hooks and sensors (#7125) |
| 5b6772cb83 | 2020-01-09 | [AIRFLOW-6125] [AIP-21] Rename S3 operator and SFTP operator (#7112) |
| 4f8592ae8f | 2020-01-08 | [AIRFLOW-6118] [AIP-21] Rename Pubsub operators and hook (#7046) |
| 20299473f1 | 2020-01-03 | [AIRFLOW-6115] [AIP-21] Rename GCP vision operators (#7020) |
| 18e8cea4e7 | 2020-01-03 | [AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007) |
| 95087af140 | 2019-12-31 | [AIRFLOW-6110] [AIP-21] Rename natural_language service (#6968) |
| 69629a5a94 | 2019-12-09 | [AIRFLOW-5807] Move SFTP from contrib to providers. (#6464) |
| 25e9047a4a | 2019-12-09 | [AIRFLOW-6193] Do not use asserts in Airflow main code (#6749) |
| ed0a14f321 | 2019-12-09 | [AIRFLOW-6120] Rename GoogleCloudBaseHook (#6734) |
| 2f2f89c148 | 2019-12-01 | [AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701) |
| 03c870a617 | 2019-11-26 | [AIRFLOW-6010] Remove cyclic imports and pylint hacks (#6601) |
| 5c4cfea8c0 | 2019-11-15 | [AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator (#6393) |
| 44a8c37a9a | 2019-11-13 | [AIRFLOW-XXX] Fix the docstring for Dataproc get_job method (#6581) |
| d633d3ac44 | 2019-11-13 | [AIRFLOW-5691] Rewrite Dataproc operators to use python library (#6371) |
| d985c02d9f | 2019-11-05 | [AIRFLOW-XXX] Add How-To-Guide to GCP PubSub (#6497) |
| a296cdabdb | 2019-11-04 | [AIRFLOW-5743] Move Google PubSub to providers package (#6476) |
| 470b2a779d | 2019-10-30 | [AIRFLOW-5741] Move Cloud Natural Language to providers (#6421) |
| f2caa451fc | 2019-10-27 | [AIRFLOW-5742] Move Google Cloud Vision to providers package (#6424) |
| 16d7accb22 | 2019-10-22 | [AIRFLOW-4971] Add Google Display & Video 360 integration (#6170) |
| 4e661f535d | 2019-10-22 | [AIRFLOW-5379] Add Google Search Ads 360 operators (#6228) |
| 19e32b4e2c | 2019-10-18 | [AIRFLOW-5656] Rename provider to providers module (#6333) |