ValueError: unsupported pickle protocol: 5 while running jobs in Airflow

Viewed 695

We have installed Airflow 2.1.3 version in Linux server, worker is also available in the same server and while we are trying to run the job it says

Error: ValueError: unsupported pickle protocol: 5

airflow.exceptions.AirflowException: Celery command failed on host ******

Task level log:

*** Failed to fetch log file from worker. The request to ':///' is missing either

Currently using Python 3.6.8 version.

Is there any way to overcome this issue.

1 Answers

I'm using k8s and I had the same problem. In my case, the problem is because the python version was 3.7. So, I change my tag version from 2.2.3 to 2.2.3-python3.8 and it works

Related