📢 **Breaking change**
1. We changed `meta` table schema and will add `start_dt` column and also changed the index, we will auto-backup the `meta` table and do auto-upgrade, but if you can, please backup your metadata. As part of automatic migration we backup `meta` table to `meta_backup_20240330` ,it has all schema versions of a schema in single DB row
1. We no longer support `DynamoDB` and `Sled` from this version. If you are using them, please use the old version (<= 0.9.2) and migrate to MySQL or PostgreSQL first.
2. We only support `MySQL` and `PostgreSQL` as metadata store for cluster mode from this version, and support `SQLite` as default for local mode.
3. We support both `NATS` and `Etcd` as cluster coordinator from this version. you can set `ZO_CLUSTER_COORDINATOR=nats` to enable `NATS` to replace `Etcd`.
4. ⚠️⚠️⚠️Once you start using this version, you shouldn't rollback to 0.9.x version, this version includes db changes , which are incompatible with previous versions. If applications is running in cluster mode please scale all deployments to zero only use single `compactor` to upgrade to `v0.10.0` after upgrade and everything work well, we can scale up application to desired state.
New Features
- **Customization & UI Enhancements:**
- Introduced UI changes for custom logos and interesting fields. Now supports enterprise API for uploading/deleting custom logos. (3030, 3058, 3034)
- Dashboard improvements include table text wrap and cascading variables for enhanced user experience. (3026, 3022)
- Added `regexp_match_to_fields` UDF and `storage_type` label for `storage_time` to enrich data manipulation capabilities. (3041, 3063)
- Implemented dashboard reporting UI for better data visualization and report management. (3098)
- Launched super cluster feature for advanced cluster management and performance. (3039, 3226)
- Added `queue` to infrastructure for improved job handling. (3051)
- Enhanced trace visibility and added SBOM (Software Bill of Materials) for better security and compliance. (3095, 3197, 3202)
- **Performance & Optimization:**
- Significant performance improvements in field search by hashmap, ingestion load, and disk cache management. (3096, 3218, 3196)
- Optimized ingester functions and introduced backend job for loading disk cache to reduce memory usage. (3201, 3196)
- Improved database alert table and node cache status for faster access and reliability. (3168, 3169)
- **Security & Stability:**
- Enhanced security measures with CSP `unsafe-eval` fixes, cookie settings as environment variables, and sanitized HTML rendering. (3118, 3152, 3167)
- Stability improvements with fixes to WAL on Windows, schema inference issues, and error handling enhancements. (3184, 3127, 3128, 3187)
- **API & Schema Enhancements:**
- Introduced reports in the backend, replacing TRIGGERS with `infra::scheduler`, and added new endpoints for health check and logout. (3086, 3090, 3212)
- Schema enhancements including lock per request per stream, separate key for schema versions, and complete super cluster implementation. (3110, 3021, 3226)
- **Developer Experience:**
- Improved secret handling in forks, added database lock to replace etcd lock, and enabled query cancellation by session ID for better control. (3111, 3107, 3130)
- Code refactoring and debug enhancements for a smoother development process. (3141, 3194)
Fixes & Improvements
- Multiple bug fixes addressing issues from cache handling, page loading states, to schema settings retention and search functionalities. (e.g., 2955, 2970, 2971, 2972, 2989, 2993, 2998, 2999, 3007, 3008, 3027, 3028, 3032, 3036, 3037, 3040, 3043, 3048, 3049, 3052, 3059, 3064, 3066, 3068, 3072, 3075, 3079, 3082, 3083, 3085, 3093, 3101, 3103, 3105, 3106, 3108, 3114, 3117, 3123, 3126, 3127, 3128, 3133, 3135, 3137, 3138, 3140, 3142, 3144, 3145, 3146, 3147, 3149, 3151, 3155, 3162, 3164, 3166, 3167, 3169, 3170, 3181, 3183, 3184, 3186, 3187, 3189, 3191, 3192, 3193, 3194, 3195, 3196, 3200, 3205, 3206, 3208, 3210, 3213, 3223, 3224, 3225, 3227, 3228, 3229, 3237, 3238, 3239, 3242, 3243)
- Addressed UI issues in RUM error explorer, dashboard variable dropdowns, and custom logo spacing.
- Resolved critical issues such as root user access, duplicate requests, and stream page loading states.
- Corrected typos and updated dependencies for better performance and security.
Testing & Maintenance
- Enhanced test coverage with new test cases for search queries, aggregation queries, drilldown tests, and quick mode. (e.g., 3031, 3046, 3064, 3070, 3115, 3116, 3124, 3145)
- Continuous integration improvements with support for JavaScript license file checker and profiling CPU for OpenObserve. (3203, 3183)
**This release brings a plethora of new features, performance optimizations, and bug fixes aimed at improving the user experience, security, and stability of our platform. We thank our contributors for their hard work and dedication.**
🐳 Docker Images
Available at:
- https://gallery.ecr.aws/zinclabs/openobserve
- https://hub.docker.com/r/openobserve/openobserve/tags
Version tags:
- `public.ecr.aws/zinclabs/openobserve:v0.10.0`
- `public.ecr.aws/zinclabs/openobserve:v0.10.0-simd`
- `openobserve/openobserve:v0.10.0`
- `openobserve/openobserve:v0.10.0-simd`
**📒 Documentation**: https://openobserve.ai/docs/
New Contributors
* taimingl made their first contribution in https://github.com/openobserve/openobserve/pull/3041
* worrycare made their first contribution in https://github.com/openobserve/openobserve/pull/3104
* deterclosed made their first contribution in https://github.com/openobserve/openobserve/pull/3080
* RanolP made their first contribution in https://github.com/openobserve/openobserve/pull/3151
* yonas made their first contribution in https://github.com/openobserve/openobserve/pull/3164
**Full Changelog**: https://github.com/openobserve/openobserve/compare/v0.9.1...v0.10.0