这个问题的解决方法是在Airflow的配置文件中添加或更改一些配置项。具体地说,需要将以下配置项添加到“airflow.cfg”文件中:
worker_log_server_port = 8793 worker_log_server_timeout = 20
这些配置项的作用是为worker设置一个日志服务器端口,并设置一个超时时间来避免在获取日志文件时出现超时错误。完成后,重新启动Airflow服务,问题应该就会得到解决。以下是完整的示例代码:
[core] worker_log_server_port = 8793 worker_log_server_timeout = 20
[webserver] worker_refresh_batch_size = 5 worker_refresh_interval = 10
[scheduler] min_file_process_interval = 0
[celery] worker_concurrency = 16 worker_max_tasks_per_child = 1000 worker_prefetch_multiplier = 1