Elastalert2

Breaking changes
- None

New features
- Adding the optional timestamp_to_datetime_format_expr rule parameter, allowing custom modification of the Elasticsearch timestamp string before parsing it into datetime. - [978](https://github.com/jertel/elastalert2/pull/978) - thpiron

Other changes
- Upgrade pylint 2.15.2 to 2.15.3 and pytest-cov 3.0.0 to 4.0.0 and sphinx 5.1.1 to 5.2.3; Add Google Chat proxy support - [972](https://github.com/jertel/elastalert2/pull/972) - nsano-rururu
- Fix Jira assign issue - [974](https://github.com/jertel/elastalert2/pull/974) - jorge-gyant
- [Kubernetes] Add extraContainers value to helm chart - [975](https://github.com/jertel/elastalert2/pull/975) - Kasape
- [docs] Updated index configuration documentation - [979](https://github.com/jertel/elastalert2/pull/979) - nsano-rururu
- [Kubernetes] Change 'metrics' to 'metrics.enabled' in helm chart documentation - [981](https://github.com/jertel/elastalert2/pull/981) - Kasape

Breaking changes
- None

New features
- [Telegram] Added new telegram_parse_mode setting to switch between markdown and html body formats. - [924](https://github.com/jertel/elastalert2/pull/924) - polshe-v

Other changes
- Pin package version of `exotel` to `0.1.5` - [931](https://github.com/jertel/elastalert2/pull/931)
- Add support for Kibana 8.4 for Kibana Discover - [935](https://github.com/jertel/elastalert2/pull/935) - nsano-rururu
- Upgrade pylint 2.14.5 to 2.15.2 and tox 3.25.1 to 3.26.0 and sphinx 5.0.2 to 5.1.1 - [937](https://github.com/jertel/elastalert2/pull/937) - nsano-rururu
- Upgrade pytest 7.1.2 to 7.1.3 - [941](https://github.com/jertel/elastalert2/pull/941) - nsano-rururu

Breaking changes
- When using HTTP POST 2, it is no longer necessary to pre-escape strings (should they contain control chars) from events in elastic search which are replaced by the jinja2 template.

- [Kubernetes] [Breaking] Reconfigure metrics to follow prometheus operator nomenclature. `metrics` value, now control the addition of metrics endpoint (command argument), the creation of a service to expose the metrics endpoint and the (optional) creation of prometheus-operator objects: serviceMonitor and prometheurRules to match implementations of other charts. The labels of the chart have been modified, so you'll need to uninstall and reinstall the chart for the upgrade to work. - [902](https://github.com/jertel/elastalert2/pull/902) - PedroMSantosD

New features
- [Kubernetes] Chart is now able to create a service for the metrics, and optional prometheus-operator custom resources serviceMonitor and prometheusRule. - [902](https://github.com/jertel/elastalert2/pull/902) - PedroMSantosD

Other changes
- Upgrade pylint 2.13.8 to 2.14.3, Upgrade sphinx 4.5.0 to 5.0.2 - [891](https://github.com/jertel/elastalert2/pull/891) - nsano-rururu
- Add support for Kibana 8.3 for Kibana Discover - [897](https://github.com/jertel/elastalert2/pull/897) - nsano-rururu
- Fix internal json decode error in HTTP POST 2 if values from ES event contain control chars (e.g. newline) and are used in the jinja2 template - [898](https://github.com/jertel/elastalert2/pull/898) - ddurham2
- Upgrade pylint 2.14.3 to 2.14.5 and tox 3.25.0 to 3.25.1 - [911](https://github.com/jertel/elastalert2/pull/911) - nsano-rururu

Breaking changes
- None

New features
- None

Other changes
- Upgrade stomp 8.0.0 to 8.0.1 - [832](https://github.com/jertel/elastalert2/pull/832) - jertel
- Add support for Kibana 8.2 for Kibana Discover, Upgrade Pytest 7.1.1 to 7.1.2, Upgrade pylint 2.13.5 to 2.13.8, Upgrade Jinja2 3.1.1 to 3.1.2 - [840](https://github.com/jertel/elastalert2/pull/840) - nsano-rururu
- Add the possibility to use rule and match fields in the description of TheHive alerts - [855](https://github.com/jertel/elastalert2/pull/855) - luffynextgen
- Fix missing colon on schema.yml and add unit test on it - [866](https://github.com/jertel/elastalert2/pull/866) - Isekai-Seikatsu
- Add the possibility to use tags, message and tlp level in TheHive observables [873](https://github.com/jertel/elastalert2/pull/873) - luffynextgen
- Support OpenSearch 2.x - [880](https://github.com/jertel/elastalert2/pull/880) - jertel

Breaking changes
- Remove Simple Alerter - [793](https://github.com/jertel/elastalert2/pull/793) - nsano-rururu

New features
- Add support for Kibana 8.1 for Kibana Discover - [763](https://github.com/jertel/elastalert2/pull/763) - nsano-rururu
- [MS Teams] Add arbitrary text value support for Facts - [790](https://github.com/jertel/elastalert2/pull/790) - iamxeph
- [MS Teams] Use alert_subject as ms_teams_alert_summary if ms_teams_alert_summary is not set - [802](https://github.com/jertel/elastalert2/pull/802) - iamxeph
- [Mattermost] List support for mattermost_channel_override - [809](https://github.com/jertel/elastalert2/pull/809) - nsano-rururu
- [Zabbix] Add the ability to specify `zbx_host` from available elasticsearch field - [820](https://github.com/jertel/elastalert2/pull/820) - timeforplanb123

Other changes
- [Docs] Update FAQ ssl_show_warn - [764](https://github.com/jertel/elastalert2/pull/764) - nsano-rururu
- [Docs] Update FAQ telegram and Amazon SNS - [765](https://github.com/jertel/elastalert2/pull/765) - nsano-rururu
- Upgrade Pytest 7.0.1 to 7.1.1 - [776](https://github.com/jertel/elastalert2/pull/776) - nsano-rururu
- [Kubernetes] Add support for automatic SMTP mail server credential management - [780](https://github.com/jertel/elastalert2/pull/780) - lusson-luo
- Upgrade sphinx 4.4.0 to 4.5.0 - [782](https://github.com/jertel/elastalert2/pull/782) - nsano-rururu
- Upgrade pylint 2.12.2 to 2.13.2 - [783](https://github.com/jertel/elastalert2/pull/783) - nsano-rururu
- Upgrade jinja2 3.0.3 to 3.1.1 - [784](https://github.com/jertel/elastalert2/pull/784) - nsano-rururu
- Update schema.yaml(Alertmanager, Spike, Flatline, New Term, Metric Aggregation, Percentage Match) - [789](https://github.com/jertel/elastalert2/pull/789) - nsano-rururu
- Upgrade pylint 2.13.2 to 2.13.3 - [792](https://github.com/jertel/elastalert2/pull/792) - nsano-rururu
- Upgrade pylint 2.13.3 to 2.13.4 - [801](https://github.com/jertel/elastalert2/pull/801) - nsano-rururu
- Fix SpikeRule - [804](https://github.com/jertel/elastalert2/pull/804) - nsano-rururu
- [Kubernetes] Add scanSubdirectories (defaults to true) as an option in Helm Chart - [805](https://github.com/jertel/elastalert2/pull/805) - louzadod
- Upgrade pylint 2.13.4 to 2.13.5 - [808](https://github.com/jertel/elastalert2/pull/808) - nsano-rururu
- Update documentation on Cloud ID support - [810](https://github.com/jertel/elastalert2/pull/810) - ferozsalam
- Upgrade tox 3.24.5 to 3.25.0 - [813](https://github.com/jertel/elastalert2/pull/813) - nsano-rururu
- [Kubernetes] Add support to specify rules directory - [816](https://github.com/jertel/elastalert2/pull/816) SBe
- Fix HTTP POST 2 alerter for nested payload keys - [823](https://github.com/jertel/elastalert2/pull/823) - lepouletsuisse
- [Kubernetes] Expose prometheus metrics to kubernetes pod service discovery mechanism - [827](https://github.com/jertel/elastalert2/pull/827) - PedroMSantosD

Breaking changes
- Add support for Elasticsearch 8, remove support for Elasticsearch 6 and below - [744](https://github.com/jertel/elastalert2/pull/744) - ferozsalam, jertel, and nsano-rururu
WARNING! Read the [ES 8 upgrade notes](https://elastalert2.readthedocs.io/en/latest/recipes/faq.html#does-elastalert-2-support-elasticsearch-8) BEFORE upgrading your cluster to Elasticsearch 8. Failure to do so can result in your cluster no longer starting and unable to rollback to 7.x.
- Kibana dashboard integration has been removed, as it only was supported with older versions of Elasticsearch and Kibana. Per the above breaking change those older versions are no longer supported by ElastAlert 2.
- Dockerfile refactor for app home and user home to be the same directory (/opt/elastalert/). Before app home is /opt/elastalert/ and user home is /opt/elastalert/elastalert. After app home and user home are the same /opt/elastalert/ - [656](https://github.com/jertel/elastalert2/pull/656)

New features
- [MS Teams] Kibana Discover URL and Facts - [660](https://github.com/jertel/elastalert2/pull/660) - thib12
- Add support for Kibana 7.17 for Kibana Discover - [695](https://github.com/jertel/elastalert2/pull/695) - nsano-rururu
- Added a fixed name metric_agg_value to MetricAggregationRule match_body - [697](https://github.com/jertel/elastalert2/pull/697) - iamxeph

Other changes
- Load Jinja template when loading an alert - [654](https://github.com/jertel/elastalert2/pull/654) - thib12
- Upgrade tox 3.24.4 to 3.24.5 - [655](https://github.com/jertel/elastalert2/pull/655) - nsano-rururu
- Upgrade sphinx 4.3.2 to 4.4.0 - [661](https://github.com/jertel/elastalert2/pull/661) - nsano-rururu
- [Docs] Fix Running Docker container - [674](https://github.com/jertel/elastalert2/pull/674) - nsano-rururu
- [Exotel] Added exotel_message_body to schema.yaml - [685](https://github.com/jertel/elastalert2/pull/685) - nsano-rururu
- Upgrade Pytest 6.2.5 to 7.0.0 - [696](https://github.com/jertel/elastalert2/pull/696) - nsano-rururu
- python-dateutil version specification change - [704](https://github.com/jertel/elastalert2/pull/704) - nsano-rururu
- Update minimum versions for third-party dependencies in requirements.txt and setup.py - [705](https://github.com/jertel/elastalert2/pull/705) - nsano-rururu
- [Docs] Document updates for Alerts and email addresses etc - [706](https://github.com/jertel/elastalert2/pull/706) - nsano-rururu
- [Docs] Update of RuleType Configuration Cheat Sheet - [707](https://github.com/jertel/elastalert2/pull/707) - nsano-rururu
- Upgrade Pytest 7.0.0 to 7.0.1 - [710](https://github.com/jertel/elastalert2/pull/710) - nsano-rururu
- Fixing jira_transition_to schema bug. Change property type from boolean to string - [721](https://github.com/jertel/elastalert2/pull/721) - toxisch
- Begin Elasticsearch 8 support - ElastAlert 2 now supports setup with fresh ES 8 instances, and works with some alert types - [731](https://github.com/jertel/elastalert2/pull/731) - ferozsalam
- Enable dynamic setting of rules volume in helm chart - [732](https://github.com/jertel/elastalert2/pull/732) - ChrisFraun
- Do not install tests via pip install - [733](https://github.com/jertel/elastalert2/pull/733) - buzzdeee
- [Docs] Add Elasticsearch 8 support documentation - [735](https://github.com/jertel/elastalert2/pull/735) - ferozsalam
- Remove download_dashboard - [740](https://github.com/jertel/elastalert2/pull/740) - nsano-rururu
- [Docs] Added documentation for metric|spike aggregation rule types for percentiles - [e682ea8](https://github.com/jertel/elastalert2/commit/e682ea8113bf9f413b6339e6803b5262881f2b30)- jertel
- [Jira] Add support for Jira authentication via Personal Access Token - [750](https://github.com/jertel/elastalert2/pull/750) - buzzdeee
- [Docs] Update docs Negation, and, or - [754](https://github.com/jertel/elastalert2/pull/754) - nsano-rururu
- Remove call to `print` from elastalert.py - [755](https://github.com/jertel/elastalert2/pull/755) - ferozsalam
- [Docs] Added dingtalk_proxy, dingtalk_proxy_login, dingtalk_proxy_pass to docs - [756](https://github.com/jertel/elastalert2/pull/756) - nsano-rururu