Tigerbeetle

Released: 2024-10-04

Note: this is an extra release to correct an availability issue in the upgrade path for `0.16.4`.
Specifically, the combination of `tigerbeetle 0.16.4` and a client at `0.16.3` can lead to an
assertion failure and a server crash. No data is lost, but the server becomes unavailable.

It is recommended to upgrade to `0.16.7`, but this is only _required_ if you are running older
clients. To upgrade, replace the binary on disk, and manually restart the replica.

Note that although the release is tagged at `0.16.7`, the binary advertises itself as `0.16.4`.

Safety And Performance

- [2377](https://github.com/tigerbeetle/tigerbeetle/pull/2378)

Fix an assertion which was incorrect when a pre-transient-error client retried a transient error,
and that transient error condition since disappeared. This mirrors 2345 which handles the case
when it is still failing.

Released: 2024-10-04

Note: this is an extra release to correct a potential issue in the upgrade path for `0.16.4`.
Specifically, the combination of `tigerbeetle 0.16.2` and newer, and any client before `0.16.2` can
lead to an assertion failure and a server crash. No data is lost, but the server becomes
unavailable.

It is recommended to upgrade to `0.16.6`, but this is only _required_ if you are running older
clients. To upgrade, replace the binary on disk, and manually restart the replica.

Note that although the release is tagged at `0.16.6`, the binary advertises itself as `0.16.4`.

Safety And Performance

- [2377](https://github.com/tigerbeetle/tigerbeetle/pull/2377)

Correctly parse AccountFilter from pre `0.16.2` clients.

Released: 2024-10-03

Note: this is an extra release to correct an availability issue in the upgrade path for `0.16.4`.
Specifically, the combination of `tigerbeetle 0.16.4` and a client at `0.16.3` can lead to an
assertion failure and a server crash. No data is lost, but the server becomes unavailable.

It is recommended to upgrade to `0.16.5`, but this is only _required_ if you are running older
clients. To upgrade, replace the binary on disk, and manually restart the replica.

Note that although the release is tagged at `0.16.5`, the binary advertises itself as `0.16.4`.

Safety And Performance

- [2345](https://github.com/tigerbeetle/tigerbeetle/pull/2345)

Fix an assertion which was incorrect when a pre-transient-error client retried a transient error.

Released: 2024-09-30

This release introduces "transient errors": error codes for `create_transfers` which depend on the
state of the database (e.g. `exceeds_credits`). Going forward, a transfer that fails with a
transient error will not succeed if retried.

See the [API tracking issue](https://github.com/tigerbeetle/tigerbeetle/issues/2231#issuecomment-2377879726)
and the [documentation](https://docs.tigerbeetle.com/reference/requests/create_transfers)
for more details.

Safety And Performance

- [2345](https://github.com/tigerbeetle/tigerbeetle/pull/2345)

Reduce chance of `recovering_head` status by recovering from torn writes in the WAL.
This improves the availability of the cluster, as `recovering_head` replicas cannot participate in
consensus until after they repair.

Features

- [2335](https://github.com/tigerbeetle/tigerbeetle/pull/2335)

Ensure idempotence for `create_transfers`' "transient errors" with new result code
`id_already_failed`. In particular, this guards against surprising behavior when the client is
running in a [stateless API service](https://docs.tigerbeetle.com/coding/system-architecture/).

Internals

- [2334](https://github.com/tigerbeetle/tigerbeetle/pull/2334),
[2362](https://github.com/tigerbeetle/tigerbeetle/pull/2362)

Fix VOPR false positives.

- [2115](https://github.com/tigerbeetle/tigerbeetle/pull/2115)

Fix multiple commands for non-interactive REPL.

TigerTracks 🎧

- [Lookin' Out My Back Door](https://www.youtube.com/watch?v=Aae_RHRptRg)

Released: 2024-09-23

Safety And Performance

- [2313](https://github.com/tigerbeetle/tigerbeetle/pull/2313)

Improve cluster availability by more aggressive recovery for crashes that happen while a replica
is checkpointing.

- [2328](https://github.com/tigerbeetle/tigerbeetle/pull/2328)

Add a more efficient recipe for balance-conditional transfers. A balance-conditional transfer
is a transfer that succeeds only if the source account has more than a threshold amount of funds
in it.

Features

- [2327](https://github.com/tigerbeetle/tigerbeetle/pull/2327)

Add a new recipe for enforcing `debits_must_not_exceed_credits` on some subset of transfers (this
is a special case of a balance-conditional transfer, with the threshold value being equal to
transferred amount).

Internals

- [2330](https://github.com/tigerbeetle/tigerbeetle/pull/2330)

Add `triaged` issue label to prevent newly opened issues from slipping through the cracks.

- [2332](https://github.com/tigerbeetle/tigerbeetle/pull/2332)

Add CI check for dead code.

- [2323](https://github.com/tigerbeetle/tigerbeetle/pull/2323)

Cleanup the source tree by removing top-level `tools` directory.

- [2316](https://github.com/tigerbeetle/tigerbeetle/pull/2316)

Make sure that process-spawning API used for build-time "scripting" consistently reports
errors when the subprocess fails or hangs.

TigerTracks 🎧

- [Prelude in G Major](https://open.spotify.com/track/70FROKEHubzMxSstCgaZZl?si=5bb7f8c6decc46aa)

Released: 2024-09-16

Safety And Performance

- [2312](https://github.com/tigerbeetle/tigerbeetle/pull/2312)

Tighten up the VSR assertions so the transition to `.recovering_head` can only be called from the
`.recovering` status.

- [2311](https://github.com/tigerbeetle/tigerbeetle/pull/2311)

Make the primary abdicate if it is unable to process requests due to a broken clock.

- [2260](https://github.com/tigerbeetle/tigerbeetle/pull/2260)

Smoke integration test using the real multiversion binary.

- [2270](https://github.com/tigerbeetle/tigerbeetle/pull/2270)

Workload generator based on the Java client to be used in integration tests (i.e. Antithesis).

Features

- [2298](https://github.com/tigerbeetle/tigerbeetle/pull/2298),
[2307](https://github.com/tigerbeetle/tigerbeetle/pull/2307),
[2304](https://github.com/tigerbeetle/tigerbeetle/pull/2304),
[2309](https://github.com/tigerbeetle/tigerbeetle/pull/2309),
[2321](https://github.com/tigerbeetle/tigerbeetle/pull/2321)

Remove `Tracy` integration and dependencies.
Add JSON traces for events with multiple running instances, such as IO, lookups, and scans.

- [2300](https://github.com/tigerbeetle/tigerbeetle/pull/2300)

Add the ability to filter by `user_data_{128,64,32}` and `code` in `get_account_transfers`
and `get_account_balances`.

Internals

- [2314](https://github.com/tigerbeetle/tigerbeetle/pull/2314),
[2315](https://github.com/tigerbeetle/tigerbeetle/pull/2315)

Mute the log on stderr when building client libraries.
Reduce the log's severity of some entries logged as `.err` to `.warn` for less noise when
running with `log_level = .err`.

- [2310](https://github.com/tigerbeetle/tigerbeetle/pull/2310)

Document and explain how time works in TigerBeetle ⏱️.

- [2291](https://github.com/tigerbeetle/tigerbeetle/pull/2291)

Refactor `Forest.compact` and remove some dead code.

- [2294](https://github.com/tigerbeetle/tigerbeetle/pull/2294)

Rewrite `commit_dispatch`, a chain of asynchronous stages calling each other, as a state machine
implementation that resembles linear control flow that is much easier to read.

- [2306](https://github.com/tigerbeetle/tigerbeetle/pull/2306)

Fix the Node.js example that was using an incorrect enum flag.
Thanks for the heads up jorispz!

- [2319](https://github.com/tigerbeetle/tigerbeetle/pull/2319)

Update outdated scripts in `HACKING.md`.

- [2317](https://github.com/tigerbeetle/tigerbeetle/pull/2317)

Use git timestamps to build Docker images.
This is a requirement for being deterministic in CI.

- [2318](https://github.com/tigerbeetle/tigerbeetle/pull/2318)

Devhub link to pending code reviews.

TigerTracks 🎧

- [What's On Your Mind](https://www.youtube.com/watch?v=Z5WRKnCRPHA)