Azure: Microsoft Azure¶

Airflow has limited support for Microsoft Azure.

Some hooks are based on airflow.providers.microsoft.azure.hooks.base_azure which authenticate Azure’s Python SDK Clients.

Services¶

These integrations allow you to perform various operations within the Microsoft Azure.

Transfers¶

These integrations allow you to copy data from/to Microsoft Azure.

Microsoft Azure Blob Storage to Amazon Simple Storage Service (S3)¶

Source product documentation: Microsoft Azure Blob Storage
Target product documentation: Amazon Simple Storage Service (S3)
Operator guide: Azure Blob Storage to Amazon S3 transfer operator
Python API: airflow.providers.amazon.aws.transfers.azure_blob_to_s3
Provider: apache-airflow-providers-amazon

Microsoft Azure FileShare to Google Cloud Storage (GCS)¶

Source product documentation: Microsoft Azure FileShare
Target product documentation: Google Cloud Storage (GCS)
Operator guide: Transfers data from Azure FileShare Storage to Google Cloud Storage
Python API: airflow.providers.google.cloud.transfers.azure_fileshare_to_gcs
Provider: apache-airflow-providers-google

Microsoft Azure Data Lake Storage to Google Cloud Storage (GCS)¶

Source product documentation: Microsoft Azure Data Lake Storage
Target product documentation: Google Cloud Storage (GCS)
Python API: airflow.providers.google.cloud.transfers.adls_to_gcs
Provider: apache-airflow-providers-google

Microsoft Azure Blob Storage to Google Cloud Storage (GCS)¶

Source product documentation: Microsoft Azure Blob Storage
Target product documentation: Google Cloud Storage (GCS)
Operator guide: Azure Blob Storage to Google Cloud Storage (GCS) Transfer Operator
Python API: airflow.providers.google.cloud.transfers.azure_blob_to_gcs
Provider: apache-airflow-providers-google

Local to Microsoft Azure Data Lake Storage¶

Target product documentation: Microsoft Azure Data Lake Storage
Operator guide: Upload data from Local Filesystem to Azure Data Lake
Python API: airflow.providers.microsoft.azure.transfers.local_to_adls
Provider: apache-airflow-providers-microsoft-azure

Oracle to Microsoft Azure Data Lake Storage¶

Source product documentation: Oracle
Target product documentation: Microsoft Azure Data Lake Storage
Python API: airflow.providers.microsoft.azure.transfers.oracle_to_azure_data_lake
Provider: apache-airflow-providers-microsoft-azure

Local to Microsoft Azure Blob Storage¶

Target product documentation: Microsoft Azure Blob Storage
Operator guide: Upload data from Local Filesystem to Azure Blob Storage
Python API: airflow.providers.microsoft.azure.transfers.local_to_wasb
Provider: apache-airflow-providers-microsoft-azure

SSH File Transfer Protocol (SFTP) to Microsoft Azure Blob Storage¶

Source product documentation: SSH File Transfer Protocol (SFTP)
Target product documentation: Microsoft Azure Blob Storage
Operator guide: SFTP to Azure Blob Storage Transfer Operator
Python API: airflow.providers.microsoft.azure.transfers.sftp_to_wasb
Provider: apache-airflow-providers-microsoft-azure

Microsoft Azure Blob Storage to Google Cloud Storage (GCS)¶

Source product documentation: Microsoft Azure Blob Storage
Target product documentation: Google Cloud Storage (GCS)
Operator guide: Upload data from Azure Blob Storage to Google Cloud Storage (Moved to Google Providers)
Python API: airflow.providers.microsoft.azure.transfers.azure_blob_to_gcs
Provider: apache-airflow-providers-microsoft-azure

Microsoft Azure Blob Storage to Snowflake¶

Source product documentation: Microsoft Azure Blob Storage
Target product documentation: Snowflake
Python API: airflow.providers.snowflake.transfers.copy_into_snowflake
Provider: apache-airflow-providers-snowflake

Azure: Microsoft Azure¶

Services¶

Microsoft Azure¶

Microsoft Azure Batch¶

Microsoft Azure Blob Storage¶

Microsoft Azure Container Instances¶

Microsoft Azure Cosmos DB¶

Microsoft Azure Data Explorer¶

Microsoft Azure Data Factory¶

Microsoft Azure Data Lake Storage¶

Microsoft Azure Data Lake Storage Client Gen2¶

Microsoft Azure FileShare¶

Microsoft Azure Service Bus¶

Microsoft Azure Synapse¶

Transfers¶

Microsoft Azure Blob Storage to Amazon Simple Storage Service (S3)¶

Microsoft Azure FileShare to Google Cloud Storage (GCS)¶

Microsoft Azure Data Lake Storage to Google Cloud Storage (GCS)¶

Microsoft Azure Blob Storage to Google Cloud Storage (GCS)¶

Local to Microsoft Azure Data Lake Storage¶

Oracle to Microsoft Azure Data Lake Storage¶

Local to Microsoft Azure Blob Storage¶

SSH File Transfer Protocol (SFTP) to Microsoft Azure Blob Storage¶

Microsoft Azure Blob Storage to Google Cloud Storage (GCS)¶

Microsoft Azure Blob Storage to Snowflake¶