Skytable-py

Fixes

- The save operation now automatically attempts to recover on failure during termination [see [166](https://github.com/skytable/skytable/pull/166)]
- More than one process can no longer concurrently use the same data directory, preventing any possible data corruption [see [169](https://github.com/skytable/skytable/pull/169), [#167](https://github.com/skytable/skytable/issues/167)]
- Fixed longstanding error in `sky-bench` component that caused key collisions
- Fixed bug in `sky-bench` that allowed passing 0 for the inputs
- Fixed handling of SIGTERM in `skyd` [see [178](https://github.com/skytable/skytable/pull/178)]
- Fixed incorrect termination codes [see [178](https://github.com/skytable/skytable/pull/178)]

Additions

- Added the `POP` query [[see 173](https://github.com/skytable/skytable/pull/173)]
- Added stress testing for testing correctness under load [[see 175](https://github.com/skytable/skytable/pull/175)]

Workflow

- Use Makefiles for builds [see [172](https://github.com/skytable/skytable/pull/172), [#174](https://github.com/skytable/skytable/pull/174)]
- Tier-1 Support for ARM64 [see [179](https://github.com/skytable/skytable/pull/179)]

> No breaking changes

- Snapshotting failure will now poison the database (customizable through CLI options or the configuration file)
[see [160](https://github.com/skytable/skytable/pull/160)]
- Added file-locking on Solaris [see [162](https://github.com/skytable/skytable/pull/162)]
- Fixed missing explicit `fsync` or `FlushFileBuffers` after writing data
- Optimized wait on snapshot busy-loop using `_mm_pause` (on x86/x86_64) or `__yield` (on aarch64/arm)

> Breaking changes!

- ⚠ Dropped support for Terrapipe 1.0 (reached EOL)
- ⚠ New disk storage format with much faster reads and/or writes
- Added support for Skyhash 1.0 (see [147](https://github.com/skytable/skytable/pull/147))
- Fixed persistence bugs (see [151](https://github.com/skytable/skytable/pull/151))
- Fixed bugs in background services (see [152](https://github.com/skytable/skytable/pull/152))
- Make BGSAVE recoverable (see [153](https://github.com/skytable/skytable/pull/153))
- Added `lskeys` action (see [155](https://github.com/skytable/skytable/pull/155))
- Added `compat` module (see [158](https://github.com/skytable/skytable/pull/158))
- Added backward compatibility for storage formats all the way upto 0.3.0. See [this wiki article](https://github.com/skytable/skytable/wiki/Disk-storage-formats) for more information

Upgrading existing clients

As Terrapipe 1.0 has reached EOL, all clients have to be upgraded to use the [Skyhash 1.0 Protocol](https://docs.skytable.io/protocol/skyhash).

Upgrading existing datasets

Please refer to [this wiki article](https://github.com/skytable/skytable/wiki/Disk-storage-formats).

Improvements in the new protocol (Skyhash)

- Upto 40% lower bandwidth requirements
- Upto 30% faster queries
- Support for recursive arrays
- More robust and well tested than Terrapipe

Internal codebase improvements

- BGSAVE is now tested by the test suite
- `skysh` and `sky-bench` both use the [Rust client driver for Skytable](https://github.com/skytable/client-rust).

> No breaking changes

Fix persistence (see [150](https://github.com/skytable/skytable/issues/150))

> No breaking changes

- `sky-bench` is less agressive and runs sanity test before benchmarking
- `skyd` now locks the data file (the `data.bin` file)
- The data directory structure has been changed (see 144) (all files are now stored in ./data/\*)
- Fixed 'Connection Forcibly Closed' errors on Windows (see 110)
- Add support for line-editing and keyboard shortcuts on `skysh` (see 142)
- Fixed problems while parsing snapshots in the snapshot directory (see 144)
- The old data directory structure has been deprecated (see 144)
- Official support for 32-bit platforms (see 139)
- Tier-2 Support for Linux musl (x86_64) (see 136, 135)

> No breaking changes

- Built-in TLS/SSL support
- Custom host/port settings in `sky-bench`
- Mock keys can be created with `sky-bench`
- Security patch for VE/S/00001 [(CVE-2021-32814)](https://nvd.nist.gov/vuln/detail/CVE-2021-32814)
- Escaping for spaces in `skysh`
- `tdb` is now called `skyd` (short for 'Skytable Daemon')