Azure DataLake Storage Operators¶

Prerequisite Tasks¶

To use these operators, you must do a few things:

Create necessary resources using AZURE PORTAL or AZURE CLI.
Install API libraries via pip.
pip install 'apache-airflow[azure]'
Detailed information is available Installation of Airflow™
Setup Connection.

ADLSDeleteOperator¶

Use the ADLSDeleteOperator to remove file(s) from Azure DataLake Storage

Below is an example of using this operator to delete a file from ADL.

tests/system/providers/microsoft/azure/example_adls_delete.py[source]

    remove_file = ADLSDeleteOperator(task_id="delete_task", path=REMOTE_FILE_PATH, recursive=True)

Reference¶

For further information, look at:

Azure Data lake Storage Documentation