Cog

An earlier fork of cog with concurrency support was published under the `0.10.0a` release channel. This is now unsupported and will receive no further updates. There are some breaking changes in the API that will be introduced with the release of the `0.14.0` beta. This alpha release is backwards compatible and you will see deprecation warnings when calling the deprecated functions.

* `emit_metric(name, value)` - this has been replaced by `current_scope().record_metric(name, value)`

> [!NOTE]
> Note that the use of `current_scope` is still experimental and will output warnings to the console. To suppress these you can ignore the `ExperimentalFeatureWarning`:
> python
> import warnings
> from cog import ExperimentalFeatureWarning
> warnings.filterwarnings("ignore", category=ExperimentalFeatureWarning)
>

Known limitations

* An async setup method cannot be used without an async predict method. Supported combinations are: sync setup/sync predict, async setup/async predict and sync setup/async predict.
* File uploads will block the event loop. If your model outputs `File` or `Path` types these will currently block the event loop. This may be an issue for large file outputs and will be fixed in a future release.

Other Changes

* Change torch vision to 0.20.0 for torch 2.5.0 cpu by 8W9aG in https://github.com/replicate/cog/pull/2074
* Ignore files within a .git directory by 8W9aG in https://github.com/replicate/cog/pull/2087
* Add fast build flag to cog by 8W9aG in https://github.com/replicate/cog/pull/2086
* Make dockerfile generators abstract by 8W9aG in https://github.com/replicate/cog/pull/2088
* Do not run a separate python install stage by 8W9aG in https://github.com/replicate/cog/pull/2094

**Full Changelog**: https://github.com/replicate/cog/compare/v0.13.6...v0.14.0-alpha1

Changelog
* 20c13d70edeb4137e88df3c8c9bcb404dc9b61b8 Fix deprecated snapshot.name_template
* 135599f2090a760659113094c8eb254de82d8a2c Prefix server errors with `Cog:` (1980)

This release includes fixes for running `cog build` on GitHub Actions, and improvements to the experience if you accidentally paste a Replicate API token (rather than a CLI auth token) into `cog login`.

~This release also ensures that the correct version of `cog` is installed into the built image when using Cog base images (the default).~ (This bug wasn't actually fixed in this release, and is finally fixed in v0.11.2.)

Changelog
* 15b50008468d002381958221cb06c0c3bc89f84f Add dotenv_if_exists to .envrc
* be927af411e0917dead6e2cb8ec6ac3397f3c8c0 Don't accept Replicate API tokens for CLI login
* cfa064a5983cd488f0ddf59c3a7895c3ac54538c Install cog when using base images (1973)
* fcb3c3c924d54fd7cabdaa482fbe72894afae614 Look up git metadata via GitHub env vars when available (1974)
* 574bdc7bdff1798a870ad29022d9352131db724a direnv: use `layout python` to automatically use venv (1970)

This release includes a fix for a bug present in [v0.9.21](https://github.com/replicate/cog/releases/tag/v0.9.21) and [v0.9.23](https://github.com/replicate/cog/releases/tag/v0.9.23).

The bug affected models that ran subprocesses, and could cause those subprocesses to fail with a broken pipe. The fix is in 1969.

Changelog
* f0011cc8c089359abe4c0f673f18a05ff965e795 Add Precompile Build Flag (1940)
* 3adf48b15acfefbd5fc7d92af77fd06d811fb177 Add mount caches to pip installs (1944)
* dbfa22f62ee6262927965ec379e20490d36d57bb Add timeout flag to predict (1879)
* 45d7d2deb4f4845a14acc6cf0f2e32346c3454a4 Don't unwrap and re-wrap streams (1969)
* 00881a177441547e5f1b94b2c3bb183e80300d10 Fix generator test (1964)
* 6ca089f0f19184c273f3ac08eb6675bf634f2415 Fix memory leak
* 03b40779acdcd8764b4bacc6d709593272b3a45a Install apt packages before pip packages (1954)
* f76e4d570b9f10908cd57255e132cfdd3ebce6ef Revert "Handle predictors with deferred annotations (1772)" (1918)

> [!IMPORTANT]
> This release includes changes from the previous tag, [v0.9.22](https://github.com/replicate/cog/releases/tag/v0.9.22), which doesn't have a corresponding release.

What's Changed
* fix code block in deploy.md by mguida22 in https://github.com/replicate/cog/pull/1941
* Add test against -march by 8W9aG in https://github.com/replicate/cog/pull/1938
* Rebuild ld cache in build by 8W9aG in https://github.com/replicate/cog/pull/1903
* Fix openapi schema by philandstuff in https://github.com/replicate/cog/pull/1947

New Contributors
* mguida22 made their first contribution in https://github.com/replicate/cog/pull/1941

**Full Changelog**: https://github.com/replicate/cog/compare/v0.9.21...v0.9.23

Changelog
* 6da017cf135ffb78a60ae12b57094614b44d19d8 Pin goreleaser to v2.2.0 to avoid pulling in go 1.23 (1953)

Changelog
* b1a616a0ebec30e02ec18123a4cf5d7ae869a692 Add Cython CFLAGS for package optimizations (1904)
* b76869f92250650c066c2c0f579f0f4532715a42 Add Torchvision and Torchaudio to base images (1897)
* 227503ef1ba0b7b963190c43fb1ae6866744b86d Add direct link to python in root (1907)
* dc0959e01fce1885df4d6a0202feb428615e144c Add findutils to base image (1909)
* 9b7adc5d1f39202636c95e38cdddd5413454968a Add new base images for torch 2.4.0 (1893)
* 26208388bff2f9a97c1eef18fc3cdb0acd9f8662 Add strip to cog builds (1902)
* e7a8f05ec23c9d4bfb4adddc15f3ab44ae64da03 Add zstd to base image packages (1905)
* c990866502c2a1e1a630cb847a36eae62ba41411 Allow filtering the generated matrix (1927)
* 804720d4e0105339841cc4df0e2d1c728b1378ee Bump github.com/docker/cli (1930)
* 506954b0032642829244545f6906ce67daf4203c Bump github.com/google/go-containerregistry from 0.20.1 to 0.20.2 (1869)
* e941b2054956579c163d9d38d814a627c4be0a4f Bump golang.org/x/sys from 0.22.0 to 0.25.0 (1931)
* 0125bd6cb42fe4d5c1c4622a8eff3e03a97b2866 Bump golang.org/x/term from 0.22.0 to 0.24.0 (1933)
* 26093c0ead817747c46a0cca3f94e22046cd3859 Clarify default install directory (1912)
* 35893d71ffe07a401ee54c01bc25a190b26db3e1 Deduplicate worker tests
* 1d1daf663491d4b4dc476484d05d213497e1d597 Fix generating matrix with all CPU torches (1913)
* 1be003084c60c6edad254b8609abd41cf4f5d5a9 Fix test build integration test (1926)
* 52c8768802a91f641582c3765f4579c7c15ea19c Generate optimized python binaries with pyenv (1900)
* 8832fb1d88d892e3fe1eca3188a3cdba3698dea1 Install opencv without python in base images (1910)
* 6c776209463b261000d80bc64165c505a635a7b2 Make StreamRedirector a context manager
* 39b44863a76150f03230e5f56c4be44b94039c4b Make `TestWorkerState` deterministic
* 21ad75c14b9e283bf2ae748edeb90fcb57189e38 Make cancelation test less flaky
* c2c658a92a9c745c25e4c717fa26c7cd99df1b89 Provide child worker directly to worker constructor
* 9aeb4d950465c6319998b638205c7a0fdd4398c0 Remove -march native cflags (1935)
* 39b6d5644080de455548b167b419da14c12d2afd Remove build base images job (1923)
* 8c50fea2ffb72e9c7dfe0cb86e11c41e7105fe22 Remove run_prediction
* 2394064eb41e7ef48be942adc21949fcd12e79f4 Set useCogBaseImage to false in base-image (1892)
* b4b028b8b984705913b295ead92442fd57b5ee09 Simplify TestWorkerState
* ee6fce0bcccff051c1ab7aafb82aba9f44d2be21 Support torch 2.4.1 (1929)
* 1a58942c3023087923bce70eeed2eba68ac15d0f Support torch patch base images (1894)