如果您遇到在Airflow中使用BashOperator运行多个命令时出现错误,请注意在BashOperator的参数中设置一个以"&&"分隔的命令列表。例如:
from airflow.operators.bash_operator import BashOperator
from datetime import datetime
default_args = {'start_date': datetime(2021, 1, 1)}
with DAG('my_dag', default_args=default_args, schedule_interval='*/10 * * * *', catchup=False) as dag:
bash_command = "command1 && command2"
run_this = BashOperator(task_id='run_my_command', bash_command=bash_command)
在此示例中,BashOperator将首先运行"command1",只有在"command1"成功运行后才会运行"command2"。
下一篇:Airflow-测试任务组。