Celery

Latest version: v5.4.0

Safety actively analyzes 690561 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 2 of 50

5.5.0b2

=======

:release-date: 2024-08-06
:release-by: Tomer Nosrati

Celery v5.5.0 Beta 2 is now available for testing.
Please help us test this version and report any issues.

Key Highlights
~~~~~~~~~~~~~~

Pydantic Support
----------------

This release introduces support for Pydantic models in Celery tasks.
For more info, see the new pydantic example and PR `9023 <https://github.com/celery/celery/pull/9023>`_ by mathiasertl.

After upgrading to this version, please share your feedback on the new Pydantic support.

Previous Beta Highlights
~~~~~~~~~~~~~~~~~~~~~~~~

Redis Broker Stability Improvements
-----------------------------------
The root cause of the Redis broker instability issue has been `identified and resolved <https://github.com/celery/kombu/pull/2007>`_
in the v5.4.0 release of Kombu, which should resolve the disconnections bug and offer additional improvements.

After upgrading to this version, please share your feedback on the Redis broker stability.

Relevant Issues:
`7276 <https://github.com/celery/celery/discussions/7276>`_,
`8091 <https://github.com/celery/celery/discussions/8091>`_,
`8030 <https://github.com/celery/celery/discussions/8030>`_,
`8384 <https://github.com/celery/celery/discussions/8384>`_

Quorum Queues Initial Support
-----------------------------
This release introduces the initial support for Quorum Queues with Celery.

See new configuration options for more details:

- :setting:`task_default_queue_type`
- :setting:`worker_detect_quorum_queues`

After upgrading to this version, please share your feedback on the Quorum Queues support.

Relevant Issues:
`6067 <https://github.com/celery/celery/discussions/6067>`_,
`9121 <https://github.com/celery/celery/discussions/9121>`_

What's Changed
~~~~~~~~~~~~~~

- Bump pytest from 8.3.1 to 8.3.2 (9153)
- Remove setuptools deprecated test command from setup.py (9159)
- Pin pre-commit to latest version 3.8.0 from Python 3.9 (9156)
- Bump mypy from 1.11.0 to 1.11.1 (9164)
- Change "docker-compose" to "docker compose" in Makefile (9169)
- update python versions and docker compose (9171)
- Add support for Pydantic model validation/serialization (fixes 8751) (9023)
- Allow local dynamodb to be installed on another host than localhost (8965)
- Terminate job implementation for gevent concurrency backend (9083)
- Bump Kombu to v5.4.0 (9177)
- Add check for soft_time_limit and time_limit values (9173)
- Prepare for (pre) release: v5.5.0b2 (9178)

.. _version-5.5.0b1:

5.5.0b1

=======

:release-date: 2024-07-24
:release-by: Tomer Nosrati

Celery v5.5.0 Beta 1 is now available for testing.
Please help us test this version and report any issues.

Key Highlights
~~~~~~~~~~~~~~

Redis Broker Stability Improvements
-----------------------------------
The root cause of the Redis broker instability issue has been `identified and resolved <https://github.com/celery/kombu/pull/2007>`_
in the release-candidate for Kombu v5.4.0. This beta release has been upgraded to use the new
Kombu RC version, which should resolve the disconnections bug and offer additional improvements.

After upgrading to this version, please share your feedback on the Redis broker stability.

Relevant Issues:
`7276 <https://github.com/celery/celery/discussions/7276>`_,
`8091 <https://github.com/celery/celery/discussions/8091>`_,
`8030 <https://github.com/celery/celery/discussions/8030>`_,
`8384 <https://github.com/celery/celery/discussions/8384>`_

Quorum Queues Initial Support
-----------------------------
This release introduces the initial support for Quorum Queues with Celery.

See new configuration options for more details:

- :setting:`task_default_queue_type`
- :setting:`worker_detect_quorum_queues`

After upgrading to this version, please share your feedback on the Quorum Queues support.

Relevant Issues:
`6067 <https://github.com/celery/celery/discussions/6067>`_,
`9121 <https://github.com/celery/celery/discussions/9121>`_

What's Changed
~~~~~~~~~~~~~~

- (docs): use correct version celery v.5.4.x (8975)
- Update mypy to 1.10.0 (8977)
- Limit pymongo<4.7 when Python <= 3.10 due to breaking changes in 4.7 (8988)
- Bump pytest from 8.1.1 to 8.2.0 (8987)
- Update README to Include FastAPI in Framework Integration Section (8978)
- Clarify return values of ..._on_commit methods (8984)
- add kafka broker docs (8935)
- Limit pymongo<4.7 regardless of Python version (8999)
- Update pymongo[srv] requirement from <4.7,>=4.0.2 to >=4.0.2,<4.8 (9000)
- Update elasticsearch requirement from <=8.13.0 to <=8.13.1 (9004)
- security: SecureSerializer: support generic low-level serializers (8982)
- don't kill if pid same as file (8997) (8998)
- Update cryptography to 42.0.6 (9005)
- Bump cryptography from 42.0.6 to 42.0.7 (9009)
- Added -vv to unit, integration and smoke tests (9014)
- SecuritySerializer: ensure pack separator will not be conflicted with serialized fields (9010)
- Update sphinx-click to 5.2.2 (9025)
- Bump sphinx-click from 5.2.2 to 6.0.0 (9029)
- Fix a typo to display the help message in first-steps-with-django (9036)
- Pinned requests to v2.31.0 due to docker-py bug 3256 (9039)
- Fix certificate validity check (9037)
- Revert "Pinned requests to v2.31.0 due to docker-py bug 3256" (9043)
- Bump pytest from 8.2.0 to 8.2.1 (9035)
- Update elasticsearch requirement from <=8.13.1 to <=8.13.2 (9045)
- Fix detection of custom task set as class attribute with Django (9038)
- Update elastic-transport requirement from <=8.13.0 to <=8.13.1 (9050)
- Bump pycouchdb from 1.14.2 to 1.16.0 (9052)
- Update pytest to 8.2.2 (9060)
- Bump cryptography from 42.0.7 to 42.0.8 (9061)
- Update elasticsearch requirement from <=8.13.2 to <=8.14.0 (9069)
- [enhance feature] Crontab schedule: allow using month names (9068)
- Enhance tox environment: [testenv:clean] (9072)
- Clarify docs about Reserve one task at a time (9073)
- GCS docs fixes (9075)
- Use hub.remove_writer instead of hub.remove for write fds (4185) (9055)
- Class method to process crontab string (9079)
- Fixed smoke tests env bug when using integration tasks that rely on Redis (9090)
- Bugfix - a task will run multiple times when chaining chains with groups (9021)
- Bump mypy from 1.10.0 to 1.10.1 (9096)
- Don't add a separator to global_keyprefix if it already has one (9080)
- Update pymongo[srv] requirement from <4.8,>=4.0.2 to >=4.0.2,<4.9 (9111)
- Added missing import in examples for Django (9099)
- Bump Kombu to v5.4.0rc1 (9117)
- Removed skipping Redis in t/smoke/tests/test_consumer.py tests (9118)
- Update pytest-subtests to 0.13.0 (9120)
- Increased smoke tests CI timeout (9122)
- Bump Kombu to v5.4.0rc2 (9127)
- Update zstandard to 0.23.0 (9129)
- Update pytest-subtests to 0.13.1 (9130)
- Changed retry to tenacity in smoke tests (9133)
- Bump mypy from 1.10.1 to 1.11.0 (9135)
- Update cryptography to 43.0.0 (9138)
- Update pytest to 8.3.1 (9137)
- Added support for Quorum Queues (9121)
- Bump Kombu to v5.4.0rc3 (9139)
- Cleanup in Changelog.rst (9141)
- Update Django docs for CELERY_CACHE_BACKEND (9143)
- Added missing docs to previous releases (9144)
- Fixed a few documentation build warnings (9145)
- docs(README): link invalid (9148)
- Prepare for (pre) release: v5.5.0b1 (9146)

.. _version-5.4.0:

5.4.2

=====
:release-date: 19 Sep, 2024
:release-by: Tomer Nosrati

Fixed issue with SQS 2113

- tzdata is required for machines without IANA database (2107)
- blacksmith.sh: Migrate workflows to Blacksmith (2112)
- Revert "Validate SQS SSL certs by default" (2114)
- Update pymongo to 4.9 (2115)
- Bump pymongo from 4.9 to 4.9.1 (2118)
- Prepare for release: v5.4.2 (2119)

.. _version-5.4.1:

5.4.1

=====
:release-date: 11 Sep, 2024
:release-by: Tomer Nosrati

- Update mypy to 1.11.2 (2101)
- SQS: Fixes 2091 queue_delete() method doesn't actually delete the queue (2099)
- Validate SQS SSL certs by default (2094)
- Resolving TypeError, during version unpacking (2098)
- Revert: allow users to disable broker heartbeats by not providing a timeout (2097, 2016) (2104)
- Update msgpack to 1.1.0 (2105)
- Update pytest to 8.3.3 (2108)
- Prepare for release: v5.4.1 (2109)

.. _version-5.4.0:

5.4

environments. The release candidate version is available for testing.
The official release is planned for March-April 2024.

- New Config: worker_enable_prefetch_count_reduction (8581)
- Added "Serverless" section to Redis doc (redis.rst) (8640)
- Upstash's Celery example repo link fix (8665)
- Update mypy version (8679)
- Update cryptography dependency to 41.0.7 (8690)
- Add type annotations to celery/utils/nodenames.py (8667)
- Issue 3426. Adding myself to the contributors. (8696)
- Bump actions/setup-python from 4 to 5 (8701)
- Fixed bug where chord.link_error() throws an exception on a dict type errback object (8702)
- Bump github/codeql-action from 2 to 3 (8725)
- Fixed multiprocessing integration tests not running on Mac (8727)
- Added make docker-docs (8729)
- Fix DeprecationWarning: datetime.datetime.utcnow() (8726)
- Remove `new` adjective in docs (8743)
- add type annotation to celery/utils/sysinfo.py (8747)
- add type annotation to celery/utils/iso8601.py (8750)
- Change type annotation to celery/utils/iso8601.py (8752)
- Update test deps (8754)
- Mark flaky: test_asyncresult_get_cancels_subscription() (8757)
- change _read_as_base64 (b64encode returns bytes) on celery/utils/term.py (8759)
- Replace string concatenation with fstring on celery/utils/term.py (8760)
- Add type annotation to celery/utils/term.py (8755)
- Skipping test_tasks::test_task_accepted (8761)
- Updated concurrency docs page. (8753)
- Changed pyup -> dependabot for updating dependencies (8764)
- Bump isort from 5.12.0 to 5.13.2 (8772)
- Update elasticsearch requirement from <=8.11.0 to <=8.11.1 (8775)
- Bump sphinx-click from 4.4.0 to 5.1.0 (8774)
- Bump python-memcached from 1.59 to 1.61 (8776)
- Update elastic-transport requirement from <=8.10.0 to <=8.11.0 (8780)
- python-memcached==1.61 -> python-memcached>=1.61 (8787)
- Remove usage of utcnow (8791)
- Smoke Tests (8793)
- Moved smoke tests to their own workflow (8797)
- Bugfix: Worker not consuming tasks after Redis broker restart (8796)
- Bugfix: Missing id on chain (8798)

.. _version-5.3.6:

5.4.0

=====
:release-date: 6 August, 2024
:release-by: Tomer Nosrati

We want to add a special thanks to contribution `2007 <https://github.com/celery/kombu/pull/2007>`_ by
awmackowiak for fixing the Redis reconnection bug. Restoring Redis stability has been an essential improvement - thank you!

The rest of the changes are listed below.

Changes
-------
- fix: Fanout exchange messages mixed across virtual databases in Redis sentinel (1986)
- Pin pymongo to latest version 4.7.2 (1994)
- enable/fix test_etcd.py (resolves 2001) (2002)
- Limit requests<2.32.0 due to docker-py issue 3256 (2011)
- enhance: allow users to disable broker heartbeats (1998)
- enhance: allow uses to disable broker heartbeats by not providing a timeout (1997, 1998) (2016)
- chore(typing): annotate `utils/debug.py` (1714)
- ConnectionPool can't be used after .resize(..., reset=True) (resolves 2018) (2024)
- Fix Redis connections after reconnect - consumer starts consuming the tasks after crash (2007)
- Add support for mongodb+srv scheme (1976)
- Added Changelog for v5.4.0rc1 (2033)
- Fixed bumpversion bug with RC versions (2034)
- Fix typo in README.rst (2036)
- Reverted limiting requests<2.32.0 in requirements/default.txt but kept in tox.ini due to docker-py issue 3256 (2041)
- Redis transport - Redelivered messages should respect the original priority (2026)
- Exclude Unit 3.9 from CI (2046)
- Fixed CI error from excluding Python 3.9 unit tests (2047)
- Fixed flaky integration test: test_publish_requeue_consume() (2048)
- fix: don't crash on `properties`.`body_encoding`: `utf-8` (1690)
- chore: handle kafka transport with confluentkafka ✨ (1574)
- Revert "Exclude Unit 3.9 from CI 2046" (2054)
- fix azure service bus isinstance checks when None (2053)
- Added Changelog for v5.4.0rc2 (2056)
- Fixed typo in Changelog for v5.4.0rc2 (2057)
- Use logging.Logger.warning (2058)
- SQS: add support for passing MessageAttributes (2059)
- Added Changelog for v5.4.0rc3 (2064)
- Prepare for release: v5.4.0 (2095)

Dependencies Updates
--------------------
- Update mypy to 1.10.0 (1988)
- Update pytest to 8.2.0 (1990)
- Bump pytest from 8.2.0 to 8.2.1 (2005)
- Pin typing_extensions to latest version 4.12.1 (2017)
- Bump pytest from 8.2.1 to 8.2.2 (2021)
- Bump pymongo from 4.7.2 to 4.7.3 (2022)
- Update flake8 to 7.1.0 (2028)
- Bump mypy from 1.10.0 to 1.10.1 (2039)
- Bump pymongo from 4.7.3 to 4.8.0 (2044)
- Pin zstandard to latest version 0.23.0 (2060)
- Update mypy to 1.11.0 (2062)
- Update pytest to 8.3.1 (2063)
- Update typing_extensions to 4.12.2 (2066)
- Pin vine to latest version 5.1.0 (2067)
- Update pytest to 8.3.2 (2076)
- Pin codecov to latest version 2.1.13 (2084)
- Pin pytest-freezer to latest version 0.4.8 (2085)
- Pin msgpack to latest version 1.0.8 (2080)
- Pin python-consul2 to latest version 0.1.5 (2078)
- Pin pycouchdb to latest version 1.16.0 (2079)
- Pin bumpversion to latest version 0.6.0 (2083)
- Pin kazoo to latest version 2.10.0 (2082)
- Pin pyro4 to latest version 4.82 (2081)
- Bump mypy from 1.11.0 to 1.11.1 (2087)
- Bump flake8 from 7.1.0 to 7.1.1 (2090)

Page 2 of 50

Links

Releases

Has known vulnerabilities

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.