Celery: Use PostgreSQL instead of RabbitMQ

Question

Is it possible to use a different message broker with celery?

For example: I would like to use PostgreSQL instead of RabbitMQ.

AFAIK it is only supported in the result backend: http://docs.celeryproject.org/en/latest/userguide/configuration.html#database-backend-settings

Since PostgreSQL 9.5 there is SKIP LOCKED which enables implementing robust message/work queues. See https://blog.2ndquadrant.com/what-is-select-skip-locked-for-in-postgresql-9-5/

user_5157801 · Answer

Is it possible to use a different message broker with celery?

before Version 4, it's sure yes! i have ever use mongodb for message broker in Celery 3, following the official document。

so if want to use PostgreSQL as the broker，it's ok，Celery also support SQLAlchemy.

However, if you want to use it in Celery 4.0, maybe it's a little difficult，one way in my mind is change the code for Kombu，yes，it's Kombu，not Celery！

Celery: Use PostgreSQL instead of RabbitMQ

2 Answers