pip install apache-airflow
airflow initdb
import datetime
now = datetime.datetime.now()
print("Current time is: %s" % now)
with open("output.txt", "a") as f:
f.write(str(now)+"\n")
from airflow import DAG
from airflow.operators.bash_operator import BashOperator
from datetime import datetime, timedelta
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'start_date': datetime(2022, 1, 1),
'retries': 1,
'retry_delay': timedelta(minutes=1),
}
dag = DAG('my_dag', default_args=default_args, description='A simple tutorial DAG', schedule_interval=timedelta(days=1))
task = BashOperator(task_id='run_my_script', bash_command='python /path/to/my_script.py', dag=dag)
在上面的代码中,'task_id”指定了task的ID,'bash_command”指定了要执行的命令,即运行上述Python脚本,'dag”参数指定了该task所属的DAG。
airflow scheduler
airflow webserver