Pymisp-async

-----------------------

New
~~~
- Add option to locally expand malware samples with LIEF. [Raphaël
Vinot]

Changes
~~~~~~~
- Bump Changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bump misp-objects. [Raphaël Vinot]
- Remove legacy tests. [Raphaël Vinot]
- Improve deprecation message on PyMISP. [Raphaël Vinot]
- [describeTypes] updated to add community-id. [Alexandre Dulaunoy]
- Bump examples to python3. [Raphaël Vinot]
- Reorganise ExpandedPyMISP methods, normalise the parameters. [Raphaël
Vinot]
- Deprecate everything in PyMISP. [Raphaël Vinot]

Fix
~~~
- Python < 3.6 support. [Raphaël Vinot]

Other
~~~~~
- Create statistical reports for MISP. [Koen Van Impe]

PyMISP script to run every x-days to get an overview of new
events/attributes ; MISP-Galaxies ; MITRE ; Tags

Output of report is on screen or sent via e-mail ; all stats attached
as CSV

---------------------

New
~~~
- Introduce ability to create a sharing group. [Tom King]
- Allow to pass delimiter & quotechar to the CSV loader. [Raphaël Vinot]
- [example] Added edit_organisation examples. [Steve Clement]
- Method to POST a STIX file to MISP and create a new event. [Raphaël
Vinot]
- Object generator for ssh authorized_keys files. [Raphaël Vinot]
- Allow custom user-agent. [Christophe Vandeplas]

Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- Bumb misp-objects. [Raphaël Vinot]
- [tests] WTF upload_sample on travis. [Raphaël Vinot]
- [tests] Add custom error message on upload_sample - fix last commit.
[Raphaël Vinot]
- [tests] Add custom error message on upload_sample. [Raphaël Vinot]
- Remove roaming as it can't be set in this request. [Tom King]
- Allow for deletion of security group. [Tom King]
- Bump dependencies. [Raphaël Vinot]
- [last] You can now paginate over multiple results in the last example
command. [Alexandre Dulaunoy]

You can do stuff like this:

python3 last.py -l 48h -m 10 -p 2 | jq .[].Event.info

which means the last 10 events on second page which are between a
time range of 0 and 48 hours.
- [tests] now deleted flag is returning only the deleted values (to be
consistent) [Alexandre Dulaunoy]
- [misp-objects] updated to the latest version. [Alexandre Dulaunoy]
- Bump deps (lief 0.10 dev) [Raphaël Vinot]
- Use pydeep from pypi, add test. [Raphaël Vinot]
- Bump dependencies. [Raphaël Vinot]
- Bump dependencies. [Raphaël Vinot]
- Bump Pipfile for python 3.7. [Raphaël Vinot]

Fix
~~~
- Skip attribute in object when value is empty, skip empty objects.
[Raphaël Vinot]
- [perms] Added try/except for various permission conditions, also
create the output dir if not exist fix: [try/except] Catch Ctrl-c
keyboard interrupt fix: [style] isort imports. [Steve Clement]
- [direct_call] Allows the response type to be something else than a
JSON (e.g. csv). [mokaddem]
- [feed generator] Added missing fields. [iglocska]
- Properly fix deprecation warning. [Raphaël Vinot]

fix 390
- Travis & python2. [Raphaël Vinot]
- Last commit foobar. [Raphaël Vinot]
- Install lief on python < 3.7 with pipenv. [Raphaël Vinot]

Other
~~~~~
- [openioc] changed default mapping for
RouteEntryItem/Destination/string. [0x3c7]
- [openioc] Changed mapping for RouteEntryItem/Destination/string to
domain instead of url because UrlHistoryItem/URL is mostly used for
urls. [0x3c7]
- Fixes other mapping to other types. [0x3c7]
- [openioc] Allow the use of types in openioc content tags. [0x3c7]
- Sync sightings between MISP servers. [Koen Van Impe]

Sync sightings between MISP servers
Sync from multiple clients to one authoritative MISP instance.
To be run from cron
(blog docu coming)
- Added includeWarninglistHits as a possible filter for the event level
restsearch. [Jeroen Pinoy]
- Resolve issue with change_sharing_group which do not update event
successfully. [hrifflet]
- Use misp_verifycert flag. [Koen Van Impe]
- Take 'to_ids' setting in account and PEP8 checks. [Koen Van Impe]

- Include check if 'to_ids' is included in the data returned from the
import module
- PEP8 checks
- Automation script that links vmray_submit and vmray_import. [Koen Van
Impe]

Import finished VMRay tasks ; add attributes to event
Makes use of the 'incomplete' workflow taxonomy
Needs to be put in a cronjob to run in the background
- Update PyMISP_tutorial.ipynb. [Carlos Borges]

The function to collect event_id and put it into a list isn't looking into each MISPAttribute.
Just updated the script to look it.

---------------------

New
~~~
- Test cases for attributes and proposals. [Raphaël Vinot]
- Improve python3.6+ lib. [Raphaël Vinot]
- Add_attributes method in MISPObject (for multiple attributes) [Raphaël
Vinot]
- Method to set the default role. [Raphaël Vinot]
- Default to "me" in the get_user method, update ExpandedPyMISP.
[Raphaël Vinot]

Fix 377
- Add get_object to ExpandedPyMISP. [Raphaël Vinot]

Fix 372
- Test cases for CSV loader, add cleaner methods in ExpandedPyMISP.
[Raphaël Vinot]
- Add CSV loader. [Raphaël Vinot]

Fix 376
- Helper to create MISP Objects for regcheck.org.uk. [Raphaël Vinot]
- Test for ACLs in testlive. [Raphaël Vinot]
- Test for manual calls to add_object and add_object_reference. [Raphaël
Vinot]
- Test update object in event. [Raphaël Vinot]

Changes
~~~~~~~
- Bump changelog. [Raphaël Vinot]
- Bump Objects. [Raphaël Vinot]
- Bump version, Bump changelog. [Raphaël Vinot]
- Add python 3.7 support for pipenv users. [Raphaël Vinot]
- Allow to pass a eml as string to EmailObject. [Raphaël Vinot]
- Bump dependencies. [Raphaël Vinot]

Fix CVE-2019-11324 (urllib3)
- Bump dependencies. [Raphaël Vinot]
- Bump misp-objects. [Raphaël Vinot]
- Allow to pass an AbstractMISP to add_reference. [Raphaël Vinot]

Fix 379
- Rework notebooks. [Raphaël Vinot]
- Bump dependencies. [Raphaël Vinot]
- Display an error on failure in testlive. [Raphaël Vinot]
- Add tests for disable_tag. [Raphaël Vinot]
- Bump misp-objects. [Raphaël Vinot]
- Reorganize some tests. [Raphaël Vinot]
- Orders of tests in make_bool. [Raphaël Vinot]
- Bump dependencies. [Raphaël Vinot]
- Initial set of refactoring on PDF generator. [Raphaël Vinot]
- Add i8n for pdfexport, without all the fonts in the main repo.
[Raphaël Vinot]

Fix
~~~
- Bump Test files because of new template version. [Raphaël Vinot]
- Build on readthedocs. [Raphaël Vinot]
- [typo] Fixed a small typo I noticed in the docs. [Steve Clement]
- Add missing files for testing (CSV loader) [Raphaël Vinot]
- Properly test query ACLs. [Raphaël Vinot]
- Update all json submodules at one place in testlive. [Raphaël Vinot]
- Disable some tests for the run on travis. [Raphaël Vinot]
- [exportpdf] Doc update. [Falconieri]
- [exportpdf] Coding Style. [Falconieri]
- Improper handling of to_ids passed as integer in MISPEvent. [Raphaël
Vinot]

Fix 364
- Do not fail when importing the reportlab file. [Raphaël Vinot]
- PDF Export requires python 3.6+. [Raphaël Vinot]
- Do not run PDF Export tests on python < 3.6. [Raphaël Vinot]
- [exportpdf] Custom path for fonts and font package. [Falconieri]
- Allow to use global variables HTTP_PROXY and HTTPS_PROXY again.
[Raphaël Vinot]

Fix 365
- Slight changes in new .change_disable_correlation method. [Raphaël
Vinot]
- Get_object_template_id was broken. Add test case. [Raphaël Vinot]

Fix 361

Other
~~~~~
- New Add test for ASNObject. [Raphaël Vinot]
- Update README.md. [Steve Clement]

Added number of monthly PyPi downloads
- Add: [exportpdf] documentation added about exportPDF. [Falconieri]
- Fix for "'NoneType' object has no attribute 'setdefault'" [Jacco
Ligthart]
- Fix a type on function name. [l3m0ntr33]
- Add new function
PyMISP.change_disablecorrelation(attribute_uuid,disable_correlation)
to be able to enable/disable correlation on attributes. [hrifflet]

---------------------

New
~~~
- [badge] Added pypi and python version badge. [Steve Clement]
- Add auth parameter to pass to python-requests. [Raphaël Vinot]
- Add readthedocs config. [Raphaël Vinot]

Changes
~~~~~~~
- Build all formats for the documentation. [Raphaël Vinot]
- Bump version. [Raphaël Vinot]
- [jupyter] remove all the response key (as response is removing it)
[Alexandre Dulaunoy]
- Enforce strict in object testing to ease debugging. [Raphaël Vinot]
- Bump misp-objects. [Raphaël Vinot]
- [pipenv] Pipfile.lock generated. [Alexandre Dulaunoy]
- [exportpdf] BIG refactoring. Classes, comments, Galaxy starting.
[Falconieri]
- [exportPDF] add basic handling of clusters. [Falconieri]
- [exportpdf] Add metadata, bugfixes cases (too long values,
sanitization), links to misp instances. [Falconieri]
- Add sphinx-autodoc-typehints. [Raphaël Vinot]
- Use version 2 of readthedoc config file. [Raphaël Vinot]
- [doc] add a reference to the Jupyter Notebook. [Alexandre Dulaunoy]
- Remove dependency on six. [Raphaël Vinot]

Fix
~~~
- [exportpdf] fix empty object/attribute/galaxy bugs. [Falconieri]
- [exportpdf] Add suggestions (UX) [Falconieri]
- [exportpdf] switch page size to A4. [Falconieri]
- [exportpdf] switch page size to A4. [Falconieri]
- Hopefully last fix for python 2.7 & reportlab. [Raphaël Vinot]
- Python 2.7 blah foo. [Raphaël Vinot]
- Bump tests relatively to the file template. [Raphaël Vinot]
- Let's act as if python2 doesn't exists. [Raphaël Vinot]
- Properly pass the auth parameter to the request. [Raphaël Vinot]
- Properly catch error if reportlab isn't installed. [Raphaël Vinot]
- Make sure install works even without reportlab installed. [Raphaël
Vinot]
- [gitmodules] revert to official misp-objects. [Steve Clement]
- URLJoin condition for double quotes. [Hannah Ward]
- Do not override sub-path from root URL. [Hannah Ward]
- [exportpdf] None if no Galaxies bug. [Falconieri]
- [reportlab] Galaxies and Clusters printing. [Falconieri]
- [reportlab] Clusters added. Still UX to perform. [Falconieri]
- [reportlab] working clusters and galaxies. Not nice however.
[Falconieri]
- [exportPDF] Adding facultative text description, sightings, tests
cases. [Falconieri]
- [exportpdf] Add Object date. [Falconieri]
- [exportpdf] Double property printing error fixed. [Falconieri]
- [exportpdf] Refactoring, nicer code. [Falconieri]
- [exportpdf] tests paths. [Falconieri]
- [exportpdf] Remove comment that codefactor doesn't like. [Falconieri]
- [pdfexport] Fix tests paths, dependency in pipfile, imports, and
'file' name overwrite in test function. [Falconieri]
- Copy event dictionary when creating a MISPEvent. [Raphaël Vinot]

Fix 321
- Wrong documentation on PyMISP.search_sightings. [Raphaël Vinot]

Fix 336
- Disable all logging in the tests. [Raphaël Vinot]
- Typo in sphinx config. [Raphaël Vinot]
- Typo in documentation. [Raphaël Vinot]
- Fix dependencies for py2. [Raphaël Vinot]
- Disable STIX test on travis. [Raphaël Vinot]
- Properly inform user when they try to run the live tests on old
systems. [Raphaël Vinot]

Fix 329

Other
~~~~~
- Re-bump changelog. [Raphaël Vinot]
- - Set my misp-objects… [Steve Clement]
- Add : [exportpdf] Objects handling, tests cases, test files.
[Falconieri]
- Add: [exportpdf] Handling pictures embedded as attributes.
[Falconieri]
- Add : [exportpdf] Picture management, manual. [Falconieri]
- Fix & add: [exportpdf] Add metadata, fix special cases (too long
values, sanitization) [Falconieri]
- Add: exportpdf tool working. [Falconieri]
- General improvement : deisgn, exhaustiviness of mispEvent values
displayed, good pratice concerning paragraphe/table made. [Falconieri]
- Update with table basics. [Falconieri]
- Structure of the improvements OK : test file, test folder, report
generator. [Falconieri]
- Search function fix to comply new version of MISP. [Armīns Palms]

---------------------

New
~~~
- Add test cases for stix export. [Raphaël Vinot]

Changes
~~~~~~~
- Bump Version & changelog. [Raphaël Vinot]
- Bump misp-objects. [Raphaël Vinot]
- [datamodel] new anonymised type added. [Alexandre Dulaunoy]
- [data] types updated to include the new zeek type. [Alexandre
Dulaunoy]

Other
~~~~~
- Check if IOC values are in warninglist. [Armīns Palms]

---------------------

New
~~~
- Add missing test case for NOT on attribute level, update Pipfile.
[Raphaël Vinot]
- Add support for unix timestamp in set_date. [Raphaël Vinot]

fix 302
- Add test for references when adding/updating a full event. [Raphaël
Vinot]
- Bump describe types. [Raphaël Vinot]

fix 317
- [usersStats] Possibility to fetch users/statistics data for all
context (usage, org, tags, ...) [Sami Mokaddem]

Changes
~~~~~~~
- Bump Changelog. [Raphaël Vinot]
- Bump version, misp-objects. [Raphaël Vinot]
- Force to_ids to be a boolean, as MISP is expecting. [Raphaël Vinot]

fix 320
- Add support for sharing group filter for search_index. [Tom King]
- Support for Payload Delivery > Other attribute as PyMISP function.
[Tom King]
- Add Pipfile config. [Raphaël Vinot]
- [data] fix describeTypes. [Alexandre Dulaunoy]
- [data] new types added (hassh-md5 and hasshserver-md5) [Alexandre
Dulaunoy]
- Bump misp-objects. [Raphaël Vinot]
- [misp-objects] templates updated to the latest version. [Alexandre
Dulaunoy]
- [data] describeTypes updated (grabbed from MISP HEAD) [Alexandre
Dulaunoy]
- [data] ja3-fingerprint-md5 type added. [Alexandre Dulaunoy]
- [test] set a default distribution for massive event creation.
[Alexandre Dulaunoy]
- [data] describeTypes.json updated to the latest version. [Alexandre
Dulaunoy]
- More flexibility when loading an object from python dict. [Raphaël
Vinot]
- Pass all parameters to the search API. [Raphaël Vinot]
- Remove compat for MISP 2.4.52, cleanup. [Raphaël Vinot]
- Set verifycert to false in tests. [Raphaël Vinot]
- [tests] Added verifycert option in case of using self-signed cert.
[Steve Clement]

Fix
~~~
- Remove jupyter & ipython from dev install so it works with python2.
[Raphaël Vinot]
- Wrong variable name in MISPEvent. [Raphaël Vinot]
- Documentation error fix 278. [Raphaël Vinot]
- Attempt to fix memory footprint in MISPAttribute. [Raphaël Vinot]
- Still support simple event dict content. [Raphaël Vinot]
- Don't modify event passed to the add_attribute methods. [Raphaël
Vinot]

fix 321
- The wrong class name was used when there is an error at Event
creation. [Raphaël Vinot]
- Use new API in get_csv.py. [Raphaël Vinot]

Fix 314
- Test case was broken. [Raphaël Vinot]
- Create massive event using ExpandedPyMISP. [Raphaël Vinot]
- Error vs errors key. [Raphaël Vinot]
- Typo. [Raphaël Vinot]
- Get_object_template_id. [Christophe Vandeplas]

Other
~~~~~
- Update pymisp tutorial. [Sandro Winkler]

Extract the "response" field from the json result returned by misp.search_index
- Sort describeTypes.json output. [Christophe Vandeplas]

This is needed for the compatibility with the gen_misp_types_categories.py script. Data was sorted using the order_dict function of the gen_misp_types_categories script.