Pymisp

---------------------

New
~~~
- Enable TCP keepalive. [Raphaël Vinot]

Changes
~~~~~~~
- Bump deps. [Raphaël Vinot]
- Bump version, deps. [Raphaël Vinot]
- Improve warning on invalid template, bump deps. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Make mypy happy. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Add in test case. [Tom King]
- Add ability to filter by sharing group for RestSearch for MISP >=
v2.4.158. [Tom King]

Fix
~~~
- Delete sharing group after deleting the event. [Raphaël Vinot]
- Give more time to MISP to publish the events before searching.
[Raphaël Vinot]
- Improper json check on non-json responses. [Raphaël Vinot]

Fix 854
- Mark all attributes in a soft deleted object as soft deleted too.
[Raphaël Vinot]

Bump misp-objects, deps.
- Make flake8 happy. [Raphaël Vinot]
- Properly convert MSG to EML. [Raphaël Vinot]
- Update lock file. [Raphaël Vinot]
- [feed] fixes bug when template_uuid does not exist. [Christophe
Vandeplas]

Other
~~~~~
- Update api.py. [Derekt2]
- Fix typo in logging message. [Philipp Hauswirth]
- Fig: [feed] fixes bugs during export with old data. [Christophe
Vandeplas]
- Update pyproject.toml. [Steven]

Add publicsuffixlist optional package for URL Object, which has a more current list than pyfaup
- Fix multiple_space warning. [malvidin]
- Option to include more URLObject attributes Add publicsuffixlist faup
for URLObject Windows support URLObject with PSLFaup prefers IP to
host/domain. [malvidin]
- Ensure that keys are sorted in the returned `_to_feed()` dictionary.
[Yun Zheng Hu]

This allows for better deterministic feed output generation.

---------------------

New
~~~
- [example:copyTagsFromAttributesToEvent] Added script to copy tags from
attributes to the event level. [Sami Mokaddem]

Changes
~~~~~~~
- Bump version. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Massive bump deps for python 3.7. [Raphaël Vinot]

---------------------

Changes
~~~~~~~
- Bump object templates. [Raphaël Vinot]
- Bump changelog. [Raphaël Vinot]
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump deps, objects. [Raphaël Vinot]
- [tests] reverted. [Alexandre Dulaunoy]
- [misp-objects] updated to the latest version. [Alexandre Dulaunoy]
- [tests] subversion are supported. [Alexandre Dulaunoy]
- Bump changelog. [Raphaël Vinot]
- Bump required python version for doc. [Raphaël Vinot]
- Remove python 3.6 from metadata. [Raphaël Vinot]

Fix
~~~
- [tests] check if the version is a substring as PyMISP might contain
sub version. [Alexandre Dulaunoy]
- Incorrect call when requesting a new API key. [Raphaël Vinot]

---------------------

New
~~~
- Get_new_authkey for a user. [Raphaël Vinot]
- [dep] Use pydeep2 instead of pydeep. [Jakub Onderka]

Changes
~~~~~~~
- Re-bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump changelog. [Raphaël Vinot]
- Bump misp-objects. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump new minimal python version to 3.7. [Raphaël Vinot]
- Perl dependencies not longer required. [Jakub Onderka]
- Simplify submodules checkout. [Jakub Onderka]
- Use https for link to documentation. [Jakub Onderka]
- Bump deps. [Raphaël Vinot]
- [misp-objects] updated to the latest version. [Alexandre Dulaunoy]
- [FIPS] no clean way to support OpenSSL hashlib interface for FIPS.
[Alexandre Dulaunoy]
- [FIPS] falling back on older version of Python not having
usedforsecurity. [Alexandre Dulaunoy]
- [FIPS] in some cases, the `usedforsecurity` is not used. So fail if
the FIPS compliance is required and then the `usedforsecurity` is
disabled. [Alexandre Dulaunoy]
- [feeds] FIPS: when MD5 hashes are generated for fast-lookup it's not
for security. [Alexandre Dulaunoy]

hashlib provides an option to tell if the hash is used for security or
not. By default, it's set to True. For the feed cache generation, it's
not. Then usedforsecurity=False
- Bump deps. [Raphaël Vinot]
- Bump deps, objects. [Raphaël Vinot]

Fix
~~~
- Libfuzzy-dev is not longer required. [Jakub Onderka]
- [mispevent] cannot type. [Alexandre Dulaunoy]
- Make mypy happy. [Raphaël Vinot]

Other
~~~~~
- Create add_filetype_object_from_csv.py. [Félix Herrenschmidt]
- Add feed option for local tag exclusion 817. [deku]

---------------------

Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump deps, object templates. [Raphaël Vinot]
- Bump objects templates. [Raphaël Vinot]
- Bump misp-objects. [Raphaël Vinot]
- Lief doesn't supports python 3.10. [Raphaël Vinot]
- Debug poetry install, freezes on the GHA. [Raphaël Vinot]
- Bump deps, use pytest. [Raphaël Vinot]
- [feed-generator] support for distribution and sharing groups.
[Christophe Vandeplas]

Fix
~~~
- Update live tests to support proper format of SGs. [Raphaël Vinot]
- [sharinggroups] Fixes wrong model for SharingGroupOrg. [Christophe
Vandeplas]
- [feed-generator] code style fixes. [Christophe Vandeplas]
- [feed-generator] keeping function compatibility. [Christophe
Vandeplas]
- [feed-generator] fix missing except type. [Christophe Vandeplas]

---------------------

New
~~~
- Add Blind Carbon Copy (bcc) headers. [Sami Tainio]
- Add few keys to email object creator. [Raphaël Vinot]

Fix 787
- Test cases for edit objects and upload stix. [Raphaël Vinot]

Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump misp-objects. [Raphaël Vinot]
- [feed-generator] Make the feature to exlude attribute type more
generic. [Sami Mokaddem]
- [feed-generator] Added exclude malware samples option. [Sami Mokaddem]
- Bump deps, chardet is required by pyfaup. [Raphaël Vinot]
- Removed a whitespace. [Sami Tainio]
- Keep strict and generate attributes when needed. [Raphaël Vinot]
- Slight changes regarding timezones. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Unified constructors. [Thomas Dupuy]
- Slight changes regarding timezones. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- [types] remove the duplicate. [Alexandre Dulaunoy]
- [describeTypes] remove duplicate filename-pattern. [Alexandre
Dulaunoy]
- [misp-objects] updated. [Alexandre Dulaunoy]
- [misp-objects] updated to the latest version. [Alexandre Dulaunoy]
- Bump many dependencies. [Raphaël Vinot]
- Add in test case for get_sharing_group and validate orgs are present.
[Tom King]
- Improve sharing groups, bring back organsations included and ability
to get specific SG. [Tom King]
- Add in test case for searching against orgs and users. [Tom King]
- Add ability to search against orgs and users by freetext search (both)
or organisation (users) [Tom King]
- [test] Check if all category types exists. [Jakub Onderka]
- Bump changelog. [Raphaël Vinot]
- Bump misp-objects. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- [py] Typo. [Steve Clement]
- [describeTypes] updated to include ssh-fingerprint. [Alexandre
Dulaunoy]
- [doc] Minor fixes, note and typo. [Steve Clement]
- Bump deps. [Raphaël Vinot]
- [misp-objects] updated to the latest version. [Alexandre Dulaunoy]
- [misp-objects] updated to the latest version. [Alexandre Dulaunoy]
- Update tutorial for custom objects. [Raphaël Vinot]
- Bump deps. [Raphaël Vinot]
- Bump live tests. [Raphaël Vinot]
- [misp-objects] updated to the latest version. [Alexandre Dulaunoy]
- [types] updated types/categories mapping. [Christophe Vandeplas]
- Remove test files. [Raphaël Vinot]
- Automatically pull the malwares repo when running
tests/testlive_comprehensive.py. [Raphaël Vinot]
- Remove submodules with malware. [Raphaël Vinot]
- Add test for updating a objects from a custom template. [Raphaël
Vinot]
- Re-bump changelog. [Raphaël Vinot]

Fix
~~~
- [feed-generator] Revert back the event initial search to use the index
endpoint instead of RestSearch. [Sami Mokaddem]

Relying on RestSearch was offering more flexibility than index in terms of filtering options,
however, it might introduce a significant overhead potentially leading to timeout.
- PyMISP.get_user_setting method. [Jakub Onderka]
- [tests] Remove debug prints. [Jakub Onderka]
- Fix final nosetest. [Tom King]
- Fix nosetests. [Tom King]
- [types] Update types to use `filename-pattern` type. [Jakub Onderka]
- [test] Remove debug print. [Jakub Onderka]
- [test] Correct error messages for blocked event. [Jakub Onderka]
- Missing import in __init__ [Raphaël Vinot]

Fix 796
- [tests] Fixed stix test. [chrisr3d]
- [py] Typo. [Steve Clement]
- Message_from_bytes really dislikes newline at the beginning of a mail.
[Raphaël Vinot]
- Skip IPs in Received header. [Raphaël Vinot]
- Name is passed to super. [Raphaël Vinot]
- Do not create empty manifest, json load dislikes it. [Raphaël Vinot]
- Initial round of cleanup on redis feed generator. [Raphaël Vinot]
- Upload of STIX document with non-ascii characters. [Raphaël Vinot]

Due to: https://github.com/psf/requests/issues/5560

TL;DR: a variable of type str passed to data in a POST request will be
silently re-encoded to ISO-8859-1, making MISP barf on the other side.
- Remove outdated deps from setup.py. [Raphaël Vinot]

Fix https://github.com/MISP/MISP/issues/7729

Other
~~~~~
- Update README.md. [Raphaël Vinot]
- Remove unicode to ascii parts. [Sami Tainio]
- Fix 787 and add Unicode to ASCII function. [Sami Tainio]

Fix 787
- Uses regex to pick up the hostnames/domains from the "Received: from" headers.

Unicode to ASCII function
- Spam messages more often than not contain junk text as unicode characters in the headers. The "from" and "subject" headers being the most common ones. Before this change the script would error on such emails or sometimes replace the unicode characters with questionmarks "?".
- Function takes argument as an input and then encodes it in ascii while ignoring any malformed data. It then returns an ASCII string without the unicode characters.
- Currently implemented for "from" and "subject" handling.
- Update README.md. [Raphaël Vinot]

Not using travis anymore.