What's Changed * add basic evaluators by aybruhm in https://github.com/Agenta-AI/agenta/pull/1074 * Evaluation - auto regex test by aybruhm in https://github.com/Agenta-AI/agenta/pull/1100 * Evaluation - Auto webhook test by aybruhm in https://github.com/Agenta-AI/agenta/pull/1101 * Evaluation - Custom code run by aybruhm in https://github.com/Agenta-AI/agenta/pull/1104 * Evaluation - Aggregate evaluator results by aybruhm in https://github.com/Agenta-AI/agenta/pull/1107 * [Bug]: Resolve evaluation scenario get endpoint by aybruhm in https://github.com/Agenta-AI/agenta/pull/1121 * Improve: Resolve evaluation results router and aggregate evaluation results by aybruhm in https://github.com/Agenta-AI/agenta/pull/1125 * [Enhancement]: Integration Tests for Evaluation by aybruhm in https://github.com/Agenta-AI/agenta/pull/1122 * Sync evaluation with main by aybruhm in https://github.com/Agenta-AI/agenta/pull/1140 * Enhancement: RPM/TPM Rate Limiting for Evaluation by aybruhm in https://github.com/Agenta-AI/agenta/pull/1148 * Feat: Migrate Agenta to use Beanie ODM by devgenix in https://github.com/Agenta-AI/agenta/pull/1149 * Refactor - Cleanup redundant code in evaluations branch by aybruhm in https://github.com/Agenta-AI/agenta/pull/1168 * Cypress tests for new evaluation by bekossy in https://github.com/Agenta-AI/agenta/pull/1170 * Refactor evaluations backend by mmabrouk in https://github.com/Agenta-AI/agenta/pull/1172 * merge main by mmabrouk in https://github.com/Agenta-AI/agenta/pull/1173 * Lm keys by aakrem in https://github.com/Agenta-AI/agenta/pull/1181 * Schemas migrations by aybruhm in https://github.com/Agenta-AI/agenta/pull/1179 * Main to evaluations in backend by aakrem in https://github.com/Agenta-AI/agenta/pull/1187 * Fix issue with dynamic inputs in eval by mmabrouk in https://github.com/Agenta-AI/agenta/pull/1188 * Migration - Update odmantic reference to beanie link & migrate old evaluation scenarios to new evaluation scenarios by aybruhm in https://github.com/Agenta-AI/agenta/pull/1191 * Refreshing playground and testset results in an alert by bekossy in https://github.com/Agenta-AI/agenta/pull/1174 * Export button always activated by mmabrouk in https://github.com/Agenta-AI/agenta/pull/1203 * Migration - modify logic to assign evaluations to their respective users by aybruhm in https://github.com/Agenta-AI/agenta/pull/1205 * Expected answer and notes not being exported in human eval by bekossy in https://github.com/Agenta-AI/agenta/pull/1212 * Enhancement: Migration issues fix by aybruhm in https://github.com/Agenta-AI/agenta/pull/1214 * Main to evaluations in backend by aakrem in https://github.com/Agenta-AI/agenta/pull/1217 * Evaluations in backend by mmabrouk in https://github.com/Agenta-AI/agenta/pull/1137 * Update pyproject.toml by mmabrouk in https://github.com/Agenta-AI/agenta/pull/1219
What's Changed * fix(frontend): in deployment showing deployed_app_variant_revision_id instead of variant_id ashrafchowdury * fix(frontend): Eliminate login screen errors in after logging out bekossy * chore(frontend): dependency version updates for security recommendations ardaerzin
What's Changed * Updated the `API` docs * Added `fetch by trace id` endpoint * Removed the `CLI`, templates, and managed hosting of custom workflow * Added scopes in custom workflows [security] * Combined license checks (`oss` and `ee`) in `api` * Increased discoverability of variants creation and comparison in Playground * Improved route handling in custom workflows * Fixed `csv` import * Fixed misc. authentication/authorization related issues * Improved scrolling behavior in the Playground * Improved `add to testset` functionality in the Playground * Several bug fixes.