3

Apache Airflow Open-Source Workflow with Python

 3 years ago
source link: https://talkpython.fm/episodes/show/330/apache-airflow-open-source-workflow-with-python
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

Apache Airflow Open-Source Workflow with Python

Episode #330, published Fri, Aug 20, 2021, recorded Thu, Aug 5, 2021.
This episode is carbon neutral.
If you are working with data pipelines, you definitely need to give Apache Airflow a look. This pure-Python workflow framework is one of the most popular and capable out there. You create your workflows by writing Python code using clever language operators and then you can monitor them and even debug them visually once they get started.

Stop writing manual code or cron-job based code to create data pipelines check out Airflow. We're joined by three excellent guests from the Airflow community: Jarek Potiuk, Kaxil Naik, and Leah Cole.

Links from the show
Jarek Potiuk: linkedin.com
Kaxil Naik: @kaxil
Leah Cole: @leahecole

Airflow site: airflow.apache.org
Airflow on GitHub: github.com
Airflow community: airflow.apache.org
UI: github.com
Helm Chart for Apache Airflow: airflow.apache.org
Airflow Summit: airflowsummit.org
Astronomer: astronomer.io
Astronomer Registry (Easy to search for official and community Providers): registry.astronomer.io
REST API: airflow.apache.org
Contributing: github.com
Airflow Loves Kubernetes talk: airflowsummit.org
Episode transcripts: talkpython.fm

report

Recommend

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK