Aperture-py

Changelog

List of aperture PRs merged since 1.2.0 release. For the full list of changes, see [list of changes][changes]

Documented ways to use environment variables in rabbitmq OTEL receiver (1706)

**New Feature:**
- Support for environment variables in `CustomMetricsConfig` and
RabbitMQ configurations 🌍
- Improved RabbitMQ receiver module loading 🐇

> 🎉 Environment variables, now we can use,
> In configs, they bring flexibility to choose.
> RabbitMQ receiver, always ready to load,
> A better experience, this update bestowed. 🚀

RabbitMQ demoapp scenario (1641)

This PR adds a scenario for RabbitMQ queue buildup.

The demo app is changed such that:
svc1 -> svc2-queue -> svc2 -> svc3-queue -> svc3,
svc3 has concurrency limit of 10, but will keep 50 messages
unacknowledged,
svc3-queue is configured with limit of 2000 messages and reject-publish
overflow behaviour.
Using the same AIMDConcurrencyController from our basic demo with setup
at 1000. No other parameters were changed. We could tighten the policy a
bit to not let ready messages overshoot so much beyond the setpoint. But
this makes for a great demo and Gabriel (Maersk) understood it.

![Screenshot 2023-04-04 at 09 33
16](https://user-images.githubusercontent.com/1553055/230439818-78b96305-95ca-4956-b71c-02f9c73a4847.png)

![Screenshot 2023-04-04 at 09 33
40](https://user-images.githubusercontent.com/1553055/230439832-a5ee824a-8374-4fde-b4e1-0748a8ea99e5.png)

> "RabbitMQ queues, oh what a sight,
> With policies and dashboards, all in one night.
> Import paths updated, code simplified,
> A load generator script, now we can abide."

Shrink aperturectl and aperture-operator by splitting some packages (1700)

Extract config packages out of following packages: distcache, etcd,
peers, discovery/kubernetes, agentfunctions, agentmanager and preview.
This results in aperturectl shrinking from 127M to 86M and
aperture-operator from 105M to 66M.

Main wins are from removing dependencies on olric (about 30MB) (both
bins) and etcd (aperture-operator).

Blueprint docs refs (1691)

- Documentation: Adds new sections to Blueprint docs, reorganizes
parameter descriptions, and removes documentation sections.
- New Feature: Adds a new file `ParameterComponents.js` which exports
React components for rendering parameter descriptions in a table format.
- Chore: Updates dependencies and script paths.

Co-authored-by: Hardik Shingala <hardik.shingalafluxninja.com>
Co-authored-by: Hardik Shingala <34568645+hdkshingalausers.noreply.github.com>

Make aperturectl compile on macos by removing unused dependency on gosigar (1689)

Due to chain of dependencies, aperturectl ended up depending on watchdog
(even though not actually using watchdog). By splitting out config, it
ends up depending only on watchdogconfig, dropping dependency on gosigar
and enabling GOOS=darwin build.

[changes]: https://github.com/fluxninja/aperture/compare/releases/aperture-controller/v1.2.0...releases/aperture-controller/v1.3.0

Changelog

List of aperture PRs merged since 1.2.0 release. For the full list of changes, see [list of changes][changes]

Documented ways to use environment variables in rabbitmq OTEL receiver (1706)

**New Feature:**
- Support for environment variables in `CustomMetricsConfig` and
RabbitMQ configurations 🌍
- Improved RabbitMQ receiver module loading 🐇

> 🎉 Environment variables, now we can use,
> In configs, they bring flexibility to choose.
> RabbitMQ receiver, always ready to load,
> A better experience, this update bestowed. 🚀

RabbitMQ demoapp scenario (1641)

This PR adds a scenario for RabbitMQ queue buildup.

The demo app is changed such that:
svc1 -> svc2-queue -> svc2 -> svc3-queue -> svc3,
svc3 has concurrency limit of 10, but will keep 50 messages
unacknowledged,
svc3-queue is configured with limit of 2000 messages and reject-publish
overflow behaviour.
Using the same AIMDConcurrencyController from our basic demo with setup
at 1000. No other parameters were changed. We could tighten the policy a
bit to not let ready messages overshoot so much beyond the setpoint. But
this makes for a great demo and Gabriel (Maersk) understood it.

![Screenshot 2023-04-04 at 09 33
16](https://user-images.githubusercontent.com/1553055/230439818-78b96305-95ca-4956-b71c-02f9c73a4847.png)

![Screenshot 2023-04-04 at 09 33
40](https://user-images.githubusercontent.com/1553055/230439832-a5ee824a-8374-4fde-b4e1-0748a8ea99e5.png)

> "RabbitMQ queues, oh what a sight,
> With policies and dashboards, all in one night.
> Import paths updated, code simplified,
> A load generator script, now we can abide."

Shrink aperturectl and aperture-operator by splitting some packages (1700)

Extract config packages out of following packages: distcache, etcd,
peers, discovery/kubernetes, agentfunctions, agentmanager and preview.
This results in aperturectl shrinking from 127M to 86M and
aperture-operator from 105M to 66M.

Main wins are from removing dependencies on olric (about 30MB) (both
bins) and etcd (aperture-operator).

Blueprint docs refs (1691)

- Documentation: Adds new sections to Blueprint docs, reorganizes
parameter descriptions, and removes documentation sections.
- New Feature: Adds a new file `ParameterComponents.js` which exports
React components for rendering parameter descriptions in a table format.
- Chore: Updates dependencies and script paths.

Co-authored-by: Hardik Shingala <hardik.shingalafluxninja.com>
Co-authored-by: Hardik Shingala <34568645+hdkshingalausers.noreply.github.com>

Make aperturectl compile on macos by removing unused dependency on gosigar (1689)

Due to chain of dependencies, aperturectl ended up depending on watchdog
(even though not actually using watchdog). By splitting out config, it
ends up depending only on watchdogconfig, dropping dependency on gosigar
and enabling GOOS=darwin build.

[changes]: https://github.com/fluxninja/aperture/compare/releases/aperture-controller/v1.2.0...releases/aperture-controller/v1.3.0-rc.2

Changelog

List of aperture PRs merged since 1.2.0 release. For the full list of changes, see [list of changes][changes]

Documented ways to use environment variables in rabbitmq OTEL receiver (1706)

**New Feature:**
- Support for environment variables in `CustomMetricsConfig` and
RabbitMQ configurations 🌍
- Improved RabbitMQ receiver module loading 🐇

> 🎉 Environment variables, now we can use,
> In configs, they bring flexibility to choose.
> RabbitMQ receiver, always ready to load,
> A better experience, this update bestowed. 🚀

RabbitMQ demoapp scenario (1641)

Description of change

This PR adds a scenario for RabbitMQ queue buildup.

The demo app is changed such that:
svc1 -> svc2-queue -> svc2 -> svc3-queue -> svc3,
svc3 has concurrency limit of 10, but will keep 50 messages
unacknowledged,
svc3-queue is configured with limit of 2000 messages and reject-publish
overflow behaviour.
Using the same AIMDConcurrencyController from our basic demo with setup
at 1000. No other parameters were changed. We could tighten the policy a
bit to not let ready messages overshoot so much beyond the setpoint. But
this makes for a great demo and Gabriel (Maersk) understood it.

![Screenshot 2023-04-04 at 09 33
16](https://user-images.githubusercontent.com/1553055/230439818-78b96305-95ca-4956-b71c-02f9c73a4847.png)

![Screenshot 2023-04-04 at 09 33
40](https://user-images.githubusercontent.com/1553055/230439832-a5ee824a-8374-4fde-b4e1-0748a8ea99e5.png)

Release Notes:

- New Feature: Added a scenario for RabbitMQ queue buildup to the demo
app, including configuration files, policies, and dashboards.
- Refactor: Updated various import paths, removed unnecessary code, and
simplified functions.
- Test: Added a load generator script for testing purposes.

> "RabbitMQ queues, oh what a sight,
> With policies and dashboards, all in one night.
> Import paths updated, code simplified,
> A load generator script, now we can abide."

Shrink aperturectl and aperture-operator by splitting some packages (1700)

Extract config packages out of following packages: distcache, etcd,
peers, discovery/kubernetes, agentfunctions, agentmanager and preview.
This results in aperturectl shrinking from 127M to 86M and
aperture-operator from 105M to 66M.

Main wins are from removing dependencies on olric (about 30MB) (both
bins) and etcd (aperture-operator).

Blueprint docs refs (1691)

- Documentation: Adds new sections to Blueprint docs, reorganizes
parameter descriptions, and removes documentation sections.
- New Feature: Adds a new file `ParameterComponents.js` which exports
React components for rendering parameter descriptions in a table format.
- Chore: Updates dependencies and script paths.

Co-authored-by: Hardik Shingala <hardik.shingalafluxninja.com>

Make aperturectl compile on macos by removing unused dependency on gosigar (1689)

Due to chain of dependencies, aperturectl ended up depending on watchdog
(even though not actually using watchdog). By splitting out config, it
ends up depending only on watchdogconfig, dropping dependency on gosigar
and enabling GOOS=darwin build.

[changes]: https://github.com/fluxninja/aperture/compare/releases/aperture-controller/v1.2.0...releases/aperture-controller/v1.3.0-rc.1

Changelog

List of aperture PRs merged since 1.1.0 release. For the full list of changes, see [list of changes][changes]

Allow limiting custom metrics pipeline to "once per agent group" (1681)

- Add leader-only receiver.
- Add `per_agent_group` flag in CustomMetricsConfig (uses
leader-only receiver internally).
- Allow omitting pipeline definition for "obvious" cases.
- Document RabbitMQ metrics integration in Get Started.

> "A new feature has arrived, limiting pipelines to one per group.
> With leader-only receivers, metrics flow without any troupe."

Add TLS configurability to Java SDK (1630)


docs: remove integrations hierarchy (1680)

- Documentation: Simplified the documentation hierarchy by removing
references to specific integrations and updating links. Minor changes
include fixing typos, grammar, and formatting.

deterministic graph output (1658)

Feature: Stabilized output of a graph by adding sorting to links, components, and ports alphabetically.
Bug fix: Changed the default value of the depth flag from 0 to 1 in cmd/aperturectl/cmd/compile.go.
Documentation: Removed code that checked if the YAML file had changed before generating a mermaid diagram, and instead generates the diagram every time in docs/tools/jsonnet/generate_jsonnet.sh.

Deprecated warnings/errors in aperturectl and docs (1656)


support tokens in check request & refactor rego classifier (1645)

New Feature: Support for tokens in Check Request and Rego Classifier
Refactor: Classifier now supports multiple labels, catch-all service renamed to any
Documentation: Improved flow label documentation
Test: Updates to test files

Log received signal before stopping app (1639)

This change allows easier debugging when app is being stopped because of received signal like SIGTERM.

Switch to buf for python grpc generation (1638)

Now we generate grpc code from proto with buf.

Also added logging to the sdk in case there is rpc error.

add flowcontrolresources and add deprecation tooling (1632)

- New Feature: Adds a new message `FlowControlResources` for flow
control resources and deprecates old fields in favor of a new one.
- Chore: Adds deprecation tooling for backwards compatibility.

add validator for grpc/http and refactor policy proto (1631)

- Refactor: Adds validation rules to the `PreviewRequest` message and
refactors the policy proto by adding messages for InPort, OutPort, and
ConstantSignal.
- New Feature: Adds a new proto message `Query` and its nested message
`PromQL` to the `query.proto` file.
- Documentation: Adds comments to the message fields in
`fluxmeter.proto`.
- Chore: Updates import statements and removes some messages from
certain files.

> "New features and refactorings galore,
> With validation rules and queries to explore.
> Import statements updated with care,
> And comments added to make things fair.
> This PR is cause for celebration,
> A step forward for our application!"

Refactor installation mode (1621)

This removes whole logic of determining installation mode.

Rationale:
1. Previous solution was not working
2. If we are going to rely on some files/envs being set, we can just
have installation mode as a config option.

[changes]: https://github.com/fluxninja/aperture/compare/releases/aperture-controller/v1.1.0...releases/aperture-controller/v1.2.0

Changelog

List of aperture PRs merged since 1.1.0 release. For the full list of changes, see [list of changes][changes]

Allow limiting custom metrics pipeline to "once per agent group" (1681)

- Add leader-only receiver.
- Add `per_agent_group` flag in CustomMetricsConfig (uses
leader-only receiver internally).
- Allow omitting pipeline definition for "obvious" cases.
- Document RabbitMQ metrics integration in Get Started.

> "A new feature has arrived, limiting pipelines to one per group.
> With leader-only receivers, metrics flow without any troupe."

Add TLS configurability to Java SDK (1630)


docs: remove integrations hierarchy (1680)

- Documentation: Simplified the documentation hierarchy by removing
references to specific integrations and updating links. Minor changes
include fixing typos, grammar, and formatting.

deterministic graph output (1658)

Feature: Stabilized output of a graph by adding sorting to links, components, and ports alphabetically.
Bug fix: Changed the default value of the depth flag from 0 to 1 in cmd/aperturectl/cmd/compile.go.
Documentation: Removed code that checked if the YAML file had changed before generating a mermaid diagram, and instead generates the diagram every time in docs/tools/jsonnet/generate_jsonnet.sh.

Deprecated warnings/errors in aperturectl and docs (1656)


support tokens in check request & refactor rego classifier (1645)

New Feature: Support for tokens in Check Request and Rego Classifier
Refactor: Classifier now supports multiple labels, catch-all service renamed to any
Documentation: Improved flow label documentation
Test: Updates to test files

Log received signal before stopping app (1639)

This change allows easier debugging when app is being stopped because of received signal like SIGTERM.

Switch to buf for python grpc generation (1638)

Now we generate grpc code from proto with buf.

Also added logging to the sdk in case there is rpc error.

add flowcontrolresources and add deprecation tooling (1632)

- New Feature: Adds a new message `FlowControlResources` for flow
control resources and deprecates old fields in favor of a new one.
- Chore: Adds deprecation tooling for backwards compatibility.

add validator for grpc/http and refactor policy proto (1631)

- Refactor: Adds validation rules to the `PreviewRequest` message and
refactors the policy proto by adding messages for InPort, OutPort, and
ConstantSignal.
- New Feature: Adds a new proto message `Query` and its nested message
`PromQL` to the `query.proto` file.
- Documentation: Adds comments to the message fields in
`fluxmeter.proto`.
- Chore: Updates import statements and removes some messages from
certain files.

> "New features and refactorings galore,
> With validation rules and queries to explore.
> Import statements updated with care,
> And comments added to make things fair.
> This PR is cause for celebration,
> A step forward for our application!"

Refactor installation mode (1621)

This removes whole logic of determining installation mode.

Rationale:
1. Previous solution was not working
2. If we are going to rely on some files/envs being set, we can just
have installation mode as a config option.

[changes]: https://github.com/fluxninja/aperture/compare/releases/aperture-controller/v1.1.0...releases/aperture-controller/v1.2.0-rc.2

Changelog

List of aperture PRs merged since 1.1.0 release. For the full list of changes, see [list of changes][changes]

support tokens in check request & refactor rego classifier (1645)

Release Notes:

New Feature: Support for tokens in Check Request and Rego Classifier
Refactor: Classifier now supports multiple labels, catch-all service renamed to any
Documentation: Improved flow label documentation
Test: Updates to test files

Log received signal before stopping app (1639)

This change allows easier debugging when app is being stopped because of received signal like SIGTERM.

Switch to buf for python grpc generation (1638)



Now we generate grpc code from proto with buf.

Also added logging to the sdk in case there is rpc error.


add flowcontrolresources and add deprecation tooling (1632)

- New Feature: Adds a new message `FlowControlResources` for flow
control resources and deprecates old fields in favor of a new one.
- Chore: Adds deprecation tooling for backwards compatibility.

add validator for grpc/http and refactor policy proto (1631)

Release Notes:

- Refactor: Adds validation rules to the `PreviewRequest` message and
refactors the policy proto by adding messages for InPort, OutPort, and
ConstantSignal.
- New Feature: Adds a new proto message `Query` and its nested message
`PromQL` to the `query.proto` file.
- Documentation: Adds comments to the message fields in
`fluxmeter.proto`.
- Chore: Updates import statements and removes some messages from
certain files.

> "New features and refactorings galore,
> With validation rules and queries to explore.
> Import statements updated with care,
> And comments added to make things fair.
> This PR is cause for celebration,
> A step forward for our application!"

Refactor installation mode (1621)

This removes whole logic of determining installation mode.

Rationale:
1. Previous solution was not working
2. If we are going to rely on some files/envs being set, we can just
have installation mode as a config option.

[changes]: https://github.com/fluxninja/aperture/compare/releases/aperture-controller/v1.1.0...releases/aperture-controller/v1.2.0-rc.1