Setting up Airflow in AWS Cloud9 (min requirement: t2.large)
source link: https://gist.github.com/AlanBinu007/57c819c8ec574021c00dcda8e358c96b
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Setting up Airflow in AWS Cloud9 (min requirement
Instantly share code, notes, and snippets.
# setup docker-compose sudo curl -L "https://github.com/docker/compose/releases/download/1.29.2/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose sudo chmod +x /usr/local/bin/docker-compose sudo ln -s /usr/local/bin/docker-compose /usr/bin/docker-compose
# setup airflow 1.10.14 git clone https://github.com/xnuinside/airflow_in_docker_compose cd airflow_in_docker_compose docker-compose -f docker-compose-with-celery-executor.yml up --build
# setup airflow 2.1.0 curl -LfO 'https://airflow.apache.org/docs/apache-airflow/2.1.0/docker-compose.yaml' mkdir ./dags ./logs ./plugins echo -e "AIRFLOW_UID=$(id -u)\nAIRFLOW_GID=0" > .env docker-compose up airflow-init docker-compose up
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK