Aperture-py

Changelog

List of aperture PRs merged since 0.27.0 release. For the full list of changes, see [list of changes][changes]

update openai action (1599)

This pull request includes a new feature and a bug fix. The `openai`
action has been updated to include `pull_request_review_comment` events
and added a `cancel-in-progress` field to cancel in-progress workflows.
Additionally, a typo in a comment has been fixed.

Move otel components (1597)

remove build.sh script (1594)

Description of change
Added the `build.sh` script inside the cloud repo. Now we no longer
required the build.sh script inside the aperture repo.
Tried using aperturectl to build cloud components but it didn't work.

Closes https://github.com/fluxninja/aperture/issues/1583

Fix Aperture Version build arg (1587)

Aperture Agent/Controller version was not properly passed to the Docker image.

Also, this PR changes context.TODO to context.Background in OTEL tests. This changes is used as trigger to build new Aperture images with proper versions.

Migrate otel contrib packages to extensions/integrations/otel directory (1589)

Description of change
- Fix issue in aperturectl build where package name for bundled
extensions was not correctly used
- Add receiver and processor group tags when building agent and
controller otel components

Go 1.20.2 (1592)

![Screenshot 2023-03-16 at 2 36 27
PM](https://user-images.githubusercontent.com/18579817/225758117-8705ab95-7383-487b-8c04-d573af4f2799.png)

This pull request updates the Golang version to 1.20.2 and makes related
changes such as updating cache keys, compatibility flags, and
Dockerfiles. These changes ensure that the project stays up-to-date with
the latest version of Golang and maintains its compatibility with other
dependencies. This update does not introduce any new features or bug
fixes but is essential for maintaining the project's stability and
security.

aperturectl: make build config and output directory optional (1590)

This pull request introduces a new feature that makes the build
configuration and output directory optional for `aperturectl`. Users can
now build without specifying these parameters, which can be useful in
certain scenarios.

Add extensions list to info (1584)

Add nil pointer check in setupSentryWriter (1582)

Bug fix: This pull request adds a nil pointer check in setupSentryWriter
function to prevent any potential issues.

Restore build.sh in info package (1581)

This pull request adds a script to build a Go binary and inject
build-time variables, which is used in every Dockerfile requiring
version endpoint.

- Chore: Adds `build.sh` script for building Go binaries with build-time
variables.

Use per-cmd build-config.yaml in Dockerfiles (1580)


fix: add race flag to controller build (1576)

Description of change
Race flag argument was added to Agent build but was missing to
controller build so added it.

Replace dynamic plugins with statically linked extensions (1573)

Description of change

- Plugins removed and replaced by extensions
- Added extension builder in aperturectl

---------

Co-authored-by: Hasit Mistry <hasitfluxninja.com>

Add source/destination services array in classifier input (1568)

New Feature: This pull request adds source and destination services
array to the classifier input, creates flow labels from them, and
updates telemetry accordingly.

Add ability to list discovery entities in aperturectl (1561)

Description of change
- Add `discovery entities` command that list all entities by IP
addresses
- Add `--find-by="[name|ip]=<string>" flag to get by name or ip

**New Feature:** Added new functions to list discovery entities and a
single discovery entity by IP address or name. These functions were
added to `pkg/agentfunctions/agents/agents.go` and
`pkg/discovery/entities/entities-service.go`. Additionally, two new RPCs
were added to `api/aperture/cmd/v1/cmd.proto`. The changes also include
minor updates to documentation and CircleCI configuration.

[changes]: https://github.com/fluxninja/aperture/compare/releases/aperture-controller/v0.27.0...releases/aperture-controller/v1.0.0-rc.3

Changelog

List of aperture PRs merged since 0.27.0 release. For the full list of changes, see [list of changes][changes]

update openai action (1599)

This pull request includes a new feature and a bug fix. The `openai`
action has been updated to include `pull_request_review_comment` events
and added a `cancel-in-progress` field to cancel in-progress workflows.
Additionally, a typo in a comment has been fixed.

Move otel components (1597)

remove build.sh script (1594)

Description of change
Added the `build.sh` script inside the cloud repo. Now we no longer
required the build.sh script inside the aperture repo.
Tried using aperturectl to build cloud components but it didn't work.

Closes https://github.com/fluxninja/aperture/issues/1583

Fix Aperture Version build arg (1587)

Aperture Agent/Controller version was not properly passed to the Docker image.

Also, this PR changes context.TODO to context.Background in OTEL tests. This changes is used as trigger to build new Aperture images with proper versions.

Migrate otel contrib packages to extensions/integrations/otel directory (1589)

Description of change
- Fix issue in aperturectl build where package name for bundled
extensions was not correctly used
- Add receiver and processor group tags when building agent and
controller otel components

Go 1.20.2 (1592)

![Screenshot 2023-03-16 at 2 36 27
PM](https://user-images.githubusercontent.com/18579817/225758117-8705ab95-7383-487b-8c04-d573af4f2799.png)

This pull request updates the Golang version to 1.20.2 and makes related
changes such as updating cache keys, compatibility flags, and
Dockerfiles. These changes ensure that the project stays up-to-date with
the latest version of Golang and maintains its compatibility with other
dependencies. This update does not introduce any new features or bug
fixes but is essential for maintaining the project's stability and
security.

aperturectl: make build config and output directory optional (1590)

This pull request introduces a new feature that makes the build
configuration and output directory optional for `aperturectl`. Users can
now build without specifying these parameters, which can be useful in
certain scenarios.

Add extensions list to info (1584)

Add nil pointer check in setupSentryWriter (1582)

Bug fix: This pull request adds a nil pointer check in setupSentryWriter
function to prevent any potential issues.

Restore build.sh in info package (1581)

This pull request adds a script to build a Go binary and inject
build-time variables, which is used in every Dockerfile requiring
version endpoint.

- Chore: Adds `build.sh` script for building Go binaries with build-time
variables.

Use per-cmd build-config.yaml in Dockerfiles (1580)


fix: add race flag to controller build (1576)

Description of change
Race flag argument was added to Agent build but was missing to
controller build so added it.

Replace dynamic plugins with statically linked extensions (1573)

Description of change

- Plugins removed and replaced by extensions
- Added extension builder in aperturectl

---------

Co-authored-by: Hasit Mistry <hasitfluxninja.com>

Add source/destination services array in classifier input (1568)

New Feature: This pull request adds source and destination services
array to the classifier input, creates flow labels from them, and
updates telemetry accordingly.

Add ability to list discovery entities in aperturectl (1561)

Description of change
- Add `discovery entities` command that list all entities by IP
addresses
- Add `--find-by="[name|ip]=<string>" flag to get by name or ip

**New Feature:** Added new functions to list discovery entities and a
single discovery entity by IP address or name. These functions were
added to `pkg/agentfunctions/agents/agents.go` and
`pkg/discovery/entities/entities-service.go`. Additionally, two new RPCs
were added to `api/aperture/cmd/v1/cmd.proto`. The changes also include
minor updates to documentation and CircleCI configuration.

[changes]: https://github.com/fluxninja/aperture/compare/releases/aperture-controller/v0.27.0...releases/aperture-controller/v1.0.0-rc.2

Changelog

List of aperture PRs merged since 0.27.0 release. For the full list of changes, see [list of changes][changes]

Fix Aperture Version build arg (1587)

Aperture Agent/Controller version was not properly passed to the Docker image.

Also, this PR changes context.TODO to context.Background in OTEL tests. This changes is used as trigger to build new Aperture images with proper versions.

Migrate otel contrib packages to extensions/integrations/otel directory (1589)

- Fix issue in aperturectl build where package name for bundled
extensions was not correctly used
- Add receiver and processor group tags when building agent and
controller otel components

Go 1.20.2 (1592)


![Screenshot 2023-03-16 at 2 36 27
PM](https://user-images.githubusercontent.com/18579817/225758117-8705ab95-7383-487b-8c04-d573af4f2799.png)

This pull request updates the Golang version to 1.20.2 and makes related
changes such as updating cache keys, compatibility flags, and
Dockerfiles. These changes ensure that the project stays up-to-date with
the latest version of Golang and maintains its compatibility with other
dependencies. This update does not introduce any new features or bug
fixes but is essential for maintaining the project's stability and
security.

aperturectl: make build config and output directory optional (1590)

This pull request introduces a new feature that makes the build
configuration and output directory optional for `aperturectl`. Users can
now build without specifying these parameters, which can be useful in
certain scenarios.

Revert "Export metrics for with pod count" (1591)

Export metrics for with pod count (1588)

**Release Notes**

New Feature: This pull request adds the ability to export metrics for
pod count in Kubernetes clusters. Users can now monitor their clusters
more effectively with this new feature. Various Kubernetes metrics such
as namespace name, node name, status, replicaset name, daemonset name,
statefulset name, job name, cronjob name, and deployment name have also
been added.

Add extensions list to info (1584)

Add nil pointer check in setupSentryWriter (1582)

Bug fix: This pull request adds a nil pointer check in setupSentryWriter
function to prevent any potential issues.

Restore build.sh in info package (1581)

This pull request restores a script to build a Go binary and inject
build-time variables, which is used in every Dockerfile requiring
version endpoint.

Use per-cmd build-config.yaml in Dockerfiles (1580)


fix: add race flag to controller build (1576)

Race flag argument was added to Agent build but was missing to
controller build so added it.

Replace dynamic plugins with statically linked extensions (1573)

- Plugins removed and replaced by extensions
- Added extension builder in aperturectl

Add source/destination services array in classifier input (1568)

New Feature: This pull request adds source and destination services
array to the classifier input, creates flow labels from them, and
updates telemetry accordingly.

Add ability to list discovery entities in aperturectl (1561)

- Add `discovery entities` command that list all entities by IP
addresses
- Add `--find-by="[name|ip]=<string>" flag to get by name or ip

[changes]: https://github.com/fluxninja/aperture/compare/releases/aperture-controller/v0.27.0...releases/aperture-controller/v1.0.0-rc.1

Changelog

List of aperture PRs merged since 0.26.0 release. For the full list of changes, see [list of changes][changes]

Add source/destination services array in classifier input (1568)

Add ability to list discovery entities in aperturectl (1561)

Add autoscale command in aperturectl (1553)

Auto Scale Docs and Tutorial (1544)

Report Flow Control Points by all Agents (1543)

simplify endpoint removal code (1529)

Update readiness test in aperture test suite (1538)

In this change, we check for components under `/system/readiness` to all
be ready. If any of the components are not ready, we fail the test. This
check needs to pass 2 times repeatedly before we can pass the test
because some of the OTEL components might not be ready yet.

Set FN exporter `num_consumers` to 1 (1536)

Having more than one queue consumer lead to metrics batches being sent out of order and thus being rejected by FN ARC.

Plug OTEL state to readiness checks (1525)

Without this Agent/Controller could report being ready, while in fact OTEL was not ready.

Refactor service discovery (1531)

Add service informer (1517)

add UpdateValue functonality in notifiers (1528)

Add readiness system in status registry (1527)

- Add platform's readiness status under
`/system/readiness/component/platform` path to mark agent as ready
- Rename status paths
- Rename `subsystem` -> `system`
- Rename `jg` -> `job-group`
- Add test for platform readiness status

[changes]: https://github.com/fluxninja/aperture/compare/releases/aperture-controller/v0.26.0...releases/aperture-controller/v0.27.0

Changelog

List of aperture PRs merged since 0.26.0 release. For the full list of changes, see [list of changes][changes]

Add source/destination services array in classifier input (1568)

Add ability to list discovery entities in aperturectl (1561)

Add autoscale command in aperturectl (1553)

Auto Scale Docs and Tutorial (1544)

Report Flow Control Points by all Agents (1543)

simplify endpoint removal code (1529)

Update readiness test in aperture test suite (1538)

In this change, we check for components under `/system/readiness` to all
be ready. If any of the components are not ready, we fail the test. This
check needs to pass 2 times repeatedly before we can pass the test
because some of the OTEL components might not be ready yet.

Set FN exporter `num_consumers` to 1 (1536)

Having more than one queue consumer lead to metrics batches being sent out of order and thus being rejected by FN ARC.

Plug OTEL state to readiness checks (1525)

Without this Agent/Controller could report being ready, while in fact OTEL was not ready.

Refactor service discovery (1531)

Add service informer (1517)

add UpdateValue functonality in notifiers (1528)

Add readiness system in status registry (1527)

- Add platform's readiness status under
`/system/readiness/component/platform` path to mark agent as ready
- Rename status paths
- Rename `subsystem` -> `system`
- Rename `jg` -> `job-group`
- Add test for platform readiness status

[changes]: https://github.com/fluxninja/aperture/compare/releases/aperture-controller/v0.26.0...releases/aperture-controller/v0.27.0-rc.2

Changelog

List of aperture PRs merged since 0.26.0 release. For the full list of changes, see [list of changes][changes]

Add autoscale command in aperturectl (1553)

---------

Co-authored-by: Hasit Mistry <hasitfluxninja.com>

Auto Scale Docs and Tutorial (1544)


Report Flow Control Points by all Agents (1543)

Agents know only about Control Points present on their Nodes, so all of them need to report CPs to FN ARC instead of only Agent Leader doing so.

Reduce metrics batching time (1542)

Scrape interval for metrics sent to FN ARC is 10 seconds. Having batching set at the same value (10 seconds) may lead to two data points for the same metrics sent in the same batch and thus rejected.

simplify endpoint removal code (1529)

---------

Co-authored-by: Hasit Mistry <hasitfluxninja.com>

Update readiness test in aperture test suite (1538)

Description of change
In this change, we check for components under `/system/readiness` to all
be ready. If any of the components are not ready, we fail the test. This
check needs to pass 2 times repeatedly before we can pass the test
because some of the OTEL components might not be ready yet.

Set FN exporter `num_consumers` to 1 (1536)

Having more than one queue consumer lead to metrics batches being sent out of order and thus being rejected by FN ARC.

Plug OTEL state to readiness checks (1525)

Without this Agent/Controller could report being ready, while in fact OTEL was not ready.

Refactor service discovery (1531)

![Screenshot 2023-03-06 at 6 03 42
PM](https://user-images.githubusercontent.com/18579817/223300441-399f184a-9e75-4874-865c-2fcc16d88ac2.png)

Add service informer (1517)

add UpdateValue functonality in notifiers (1528)

Add readiness system in status registry (1527)

Description of change
- Add platform's readiness status under
`/system/readiness/component/platform` path to mark agent as ready
- Rename status paths
- Rename `subsystem` -> `system`
- Rename `jg` -> `job-group`
- Add test for platform readiness status

[changes]: https://github.com/fluxninja/aperture/compare/releases/aperture-controller/v0.26.0...releases/aperture-controller/v0.27.0-rc.1