How-to Guides

Setting up the sandbox in the Quick Start section was easy; building a production-grade environment requires a bit more work!

These how-to guides will step you through common tasks in using and configuring an Airflow environment.

• Setting Configuration Options
• Initializing a Database Backend
• Using Operators
  • BashOperator
  • Dingding Operators
  • Google Cloud Operators
  • Papermill
  • PythonOperator
  • Cross-DAG Dependencies
• Creating a custom Operator
  • Hooks
  • User interface
  • Templating
  • Define an operator extra link
• Managing Connections
  • Creating a Connection with the UI
  • Editing a Connection with the UI
  • Creating a Connection with Environment Variables
  • Connection Types
• Securing Connections
• Rotating encryption keys
• Writing Logs
  • Writing Logs Locally
  • Writing Logs to Amazon S3
  • Writing Logs to Azure Blob Storage
  • Writing Logs to Google Cloud Storage
  • Writing Logs to Elasticsearch
  • Writing Logs to Elasticsearch over TLS
• Running Airflow behind a reverse proxy
• Running Airflow with systemd
• Running Airflow with upstart
• Using the Test Mode Configuration
• Checking Airflow Health Status
• Define an operator extra link
  • Add or override Links to Existing Operators
• Email Configuration
• Tracking User Activity
• Using the Command Line Interface
  • Set Up connection to a remote Airflow instance
  • Set Up Bash/Zsh Completion
  • Creating a Connection
  • Exporting DAGs structure to images
  • Display DAGs structure