Quixstreams

What's Changed

Bugfixes
* Handle None values and types derived from python number type such as numpy types. https://github.com/quixio/quix-streams/pull/106 https://github.com/quixio/quix-streams/pull/109
* Add coding standards by SteveRosam in https://github.com/quixio/quix-streams/pull/101
* Add note on when raw data is used by tbedford in https://github.com/quixio/quix-streams/pull/107

**Full Changelog**: https://github.com/quixio/quix-streams/compare/v0.5.2...v0.5.3

In this release we switched to .net 8 preview and with this enabled python wrapper development on Mac Apple silicon!
Other notable changes:
- Serialization when publishing will use JSON for the entire message rather than protobuf by default. This is aimed to help debugging and ease integration with other tools. If protobuf is prefered, switch using the following snippet.

import quixstreams as qx
qx.CodecSettings.set_global_codec_type(codec_type=qx.CodecType.Protobuf)

- When App.Run is used on non-main thread it won't cause exception but instead log it and a warning, but function as it did before 0.5.1. Still hints at code issue, but at least previous functionality is restored.

Full changelog
* Add numpy type handling to migration guide by tbedford in https://github.com/quixio/quix-streams/pull/83
* Change build scripts to python where possible by peter-quix in https://github.com/quixio/quix-streams/pull/87
* Change bug template to allow easier and more to the point issue creation by peter-quix in https://github.com/quixio/quix-streams/pull/90
* Update documentation generation README.md by harisbotic in https://github.com/quixio/quix-streams/pull/92
* Documentation refresh by harisbotic in https://github.com/quixio/quix-streams/pull/81
* [task/34235] - add missing event docs by tbedford in https://github.com/quixio/quix-streams/pull/91
* Use .NET 8 for all platforms by harisbotic in https://github.com/quixio/quix-streams/pull/93
* Add JSON serialization support by harisbotic in https://github.com/quixio/quix-streams/pull/94
* Lower signal exception to warning when running on non-main thread by peter-quix in https://github.com/quixio/quix-streams/pull/96

New Contributors
* harisbotic made their first contribution in https://github.com/quixio/quix-streams/pull/92

**Full Changelog**: https://github.com/quixio/quix-streams/compare/v0.5.1...v0.5.2

Bugfixes
- Fixed segfault when exceptions are raised in non-windows systems. (74)
- add_tags in eventdatabuilder should work (61)
- fixed typehint in timeseriesdatabuilder (61)
- keyboard interrupt no longer logs an unavoidable exception (79)
- TimeseriesData conversion should no longer happen when it is not being used (introduced in 0.5.0) (84)

Improvements
- docs updated
- improved producer timeout errors. It will only log an exception if the client is unable to communicate with the broker, not when a connection resets (65)
- C performance improvements (75), should have an effect in python also
- unit tests are now consistently passing and the ones expected to fail are skipped for now (84)

What's Changed
* Update quickstart.md by tbedford in https://github.com/quixio/quix-streams/pull/56
* TimeSeriesDataBuilder and EventDataBuilder fixes by peter-quix in https://github.com/quixio/quix-streams/pull/61
* Squash some uses of Read and Write by SteveRosam in https://github.com/quixio/quix-streams/pull/63
* [task/36254] - fix broken links by tbedford in https://github.com/quixio/quix-streams/pull/66
* [task/35105] - tidy-migration-guide by tbedford in https://github.com/quixio/quix-streams/pull/59
* Tune down unnecessary producer exception 64 by peter-quix in https://github.com/quixio/quix-streams/pull/65
* [task/36304] - rename sdk to client library by tbedford in https://github.com/quixio/quix-streams/pull/67
* [task/33358] - add data processing 101 by tbedford in https://github.com/quixio/quix-streams/pull/58
* [Task/36318] - restructure connect to quix topic by tbedford in https://github.com/quixio/quix-streams/pull/68
* Correct admonition rendering by tbedford in https://github.com/quixio/quix-streams/pull/71
* [fix] - links to streams landing page/intro by tbedford in https://github.com/quixio/quix-streams/pull/72
* Link fixes by SteveRosam in https://github.com/quixio/quix-streams/pull/73
* Performance improvements & buffer fix by peter-quix in https://github.com/quixio/quix-streams/pull/75
* Fix segfault with some linux distributions by peter-quix in https://github.com/quixio/quix-streams/pull/74
* 79 - Handle KeyboardInterrupt signal when using app.run by peter-quix in https://github.com/quixio/quix-streams/pull/80
* [Task/33358] - additions to 'using Quix Streams' topic by tbedford in https://github.com/quixio/quix-streams/pull/69
* API reference for C and Python by smadurange in https://github.com/quixio/quix-streams/pull/77
* Unit tests fixes and log improvements by peter-quix in https://github.com/quixio/quix-streams/pull/84
* Up to 0.5.1.0 release version by peter-quix in https://github.com/quixio/quix-streams/pull/85

New Contributors
* smadurange made their first contribution in https://github.com/quixio/quix-streams/pull/77

**Full Changelog**: https://github.com/quixio/quix-streams/compare/v0.5.0...v0.5.1

First native release of QuixStreams library.
The migration guide can be found here: https://github.com/quixio/quix-streams/blob/main/docs/versionmigration.md#04---050

What's Changed
* Initial native library work by peter-quix in https://github.com/quixio/quix-streams/pull/29
* [task/33911] - update to reflect changes to sdk by tbedford in https://github.com/quixio/quix-streams/pull/30
* [task/33987] - adds install guide for m1 and m2 by tbedford in https://github.com/quixio/quix-streams/pull/31
* Native improvements 1 by peter-quix in https://github.com/quixio/quix-streams/pull/32
* Read and write 'time-series' data by srosam in https://github.com/quixio/quix-streams/pull/34
* 32251 App management - aka App.run() by srosam in https://github.com/quixio/quix-streams/pull/35
* Sentence casing titles and American spellings by srosam in https://github.com/quixio/quix-streams/pull/37
* Feature/native improvements 2 by peter-quix in https://github.com/quixio/quix-streams/pull/33
* native improvements 3 - memory leak fixes by peter-quix in https://github.com/quixio/quix-streams/pull/38
* native improvements 5 by peter-quix in https://github.com/quixio/quix-streams/pull/41
* Docs impr, smaller renamings, raw topic fix, mem leak fix by peter-quix in https://github.com/quixio/quix-streams/pull/45
* [task/31677] - Quickstart guide by tbedford in https://github.com/quixio/quix-streams/pull/27
* Add Nuget build, some renaming by peter-quix in https://github.com/quixio/quix-streams/pull/48
* Restructured readme and broke out optional info into supplementary topics by merlin-quix in https://github.com/quixio/quix-streams/pull/46
* code updates by srosam in https://github.com/quixio/quix-streams/pull/49
* Update README.md by tbedford in https://github.com/quixio/quix-streams/pull/50
* Code samples fixes in readme by PatrickMiraP in https://github.com/quixio/quix-streams/pull/51
* Update package version and fix ____KA____ stream by peter-quix in https://github.com/quixio/quix-streams/pull/52

New Contributors
* merlin-quix made their first contribution in https://github.com/quixio/quix-streams/pull/46
* PatrickMiraP made their first contribution in https://github.com/quixio/quix-streams/pull/51

**Full Changelog**: https://github.com/quixio/quix-streams/compare/v0.4.10...v0.5.0

The initial release of the QuixStreams library publicly. This version is equivalent to the last closed-source release.

**Full Changelog**: https://github.com/quixio/quix-streams/commits/v0.4.10

sdf = sdf.set_headers(
lambda value, key, timestamp, headers: [('APP_VERSION', APP_VERSION.encode())]
)


[NEW] New API to configure Kafka broker authentication

Docs:

- https://quix.io/docs/quix-streams/configuration.html#authentication

In version 2.6.0, we introduced the new API to specify the Kafka broker credentials via the `ConnectionConfig` object.

Previously, when connecting to the brokers with any kind of authentication, users needed to provide the same connection settings as dictionaries and do it separately for both consumer and producer.

Now, the Kafka connection can be configured once using the `ConnectionConfig` object.
With `ConnectionConfig` you may specify additional authentication settings like SASL parameters and more, and pass it as a `"broker_address"` parameter to the `Application`.

**Example:**

Configure the application to connect to the Kafka broker with SASL authentication.

python
from quixstreams import Application
from quixstreams.kafka.configuration import ConnectionConfig

connection = ConnectionConfig(
bootstrap_servers="my_url",
security_protocol="sasl_plaintext",
sasl_mechanism="PLAIN",
sasl_username="my_user",
sasl_password="my_pass"
)

app = Application(broker_address=connection)


Other Improvements
* Update requests and confluent_kafka dependencies by daniil-quix in https://github.com/quixio/quix-streams/pull/379
* Bug: configuring broker_address take priority over quix config by quentin-quix in https://github.com/quixio/quix-streams/pull/384
* Check partitions status after committing in checkpoint by quentin-quix in https://github.com/quixio/quix-streams/pull/386
* Configure the producer flush timeout with the max.poll.interval.ms by quentin-quix in https://github.com/quixio/quix-streams/pull/382
* Reduce the checkpointing log level by daniil-quix in https://github.com/quixio/quix-streams/pull/377
* Fix flaky tests that rely on kafka in docker by daniil-quix in https://github.com/quixio/quix-streams/pull/378
* Default logging configuration improvements by quentin-quix in https://github.com/quixio/quix-streams/pull/383



New Contributors
* quentin-quix made their first contribution in https://github.com/quixio/quix-streams/pull/383

**Full Changelog**: https://github.com/quixio/quix-streams/compare/v2.5.1...v2.6.0