Open-interpreter

Critical fixes and cool new magic commands in this one.

- **New magic commands:** `%% {insert shell code}` for custom shell code running and `%info` added by CyanideByte
- Significantly better debugging with more system information in errors, thank you Notnaton!
- **Create multiple agents** / instances [and watch them communicate](https://docs.openinterpreter.com/usage/python/multiple-instances) in Python
- Azure now works with the `config` thanks to hargunmujral in https://github.com/KillianLucas/open-interpreter/pull/786
- CyanideByte made it so if the user can't access `gpt-4`, we give a great error, and let them switch to `gpt-3.5`
- pratss10 added some helpful documentation (with screenshots!) for setting up `gpt-4`
- `vision` now works via the Python package
- Brand new German [`README`](https://github.com/KillianLucas/open-interpreter/blob/main/docs/README_DE.md) thanks to iongpt!
- We're significantly more organized — one folder for the `terminal_interface`, another for `core`
- Much better `shell` output processing
- [**Finally, a proper ROADMAP!**](https://github.com/KillianLucas/open-interpreter/blob/main/docs/ROADMAP.md)

**Thank you to everyone that made it happen!**

Cannot go without thanking the extraordinary ericrallen for this release as well, who practically single-handedly brought our issues below 100 (from nearly 300 just a few weeks ago). Have a safe trip to Japan Eric!

New Contributors
* joshuavial made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/767
* pratss10 made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/773
* hargunmujral made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/786
* iongpt made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/738

**Full Changelog**: https://github.com/KillianLucas/open-interpreter/compare/v0.1.15...v0.1.16

Quick fixes to resolve some common issues:

* [Streaming responses in Python](https://docs.openinterpreter.com/usage/python/streaming-response) missing flag issue has been fixed (`end_of_message` wasn't always being emitted)
* Added more useful info to system info by Notnaton in https://github.com/KillianLucas/open-interpreter/pull/750
* chore: popen using utf8 encoding by fatelei in https://github.com/KillianLucas/open-interpreter/pull/742
* MOD: close subprocess and its file handles when reset by coderfengyun in https://github.com/KillianLucas/open-interpreter/pull/476

New Contributors
* fatelei made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/742
* coderfengyun made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/476

**Full Changelog**: https://github.com/KillianLucas/open-interpreter/compare/v0.1.14...v0.1.15

- An issue with UNIX files has been resolved (748)
- Experimental support for Python in `--vision` mode has been added

**Full Changelog**: https://github.com/KillianLucas/open-interpreter/compare/v0.1.13...v0.1.14

Quick fix for `--vision` support Windows. File paths should now be properly recognized and loaded into the model.

**Full Changelog**: https://github.com/KillianLucas/open-interpreter/compare/v0.1.12...v0.1.13

A quick one, a fun one. Added experimental `vision` support for OpenAI users.

shell
interpreter --vision


Drag files / screenshots into your terminal to use it. Also supports reflection for HTML. (It can see the designs it produces!)

**Vision II** will introduce support for reflective vision in many more languages.

What's Changed
* Get more system info in debug mode by Notnaton in https://github.com/KillianLucas/open-interpreter/pull/701
* Quickfix .lower() by Notnaton in https://github.com/KillianLucas/open-interpreter/pull/744
* Unsupported lang fix by CyanideByte in https://github.com/KillianLucas/open-interpreter/pull/745

New Contributors
* CyanideByte made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/745

**Full Changelog**: https://github.com/KillianLucas/open-interpreter/compare/v0.1.11...v0.1.12

- **Local mode is now powered by LM Studio.** Running `--local` will tell you how to setup LM Studio + connect to it automatically.
- It's way smaller. Removed the MASSIVE local embedding model, chromadb, oobabooga, a bunch of other packages we didn't really need. Semgrep is now optional.
- The system message is tighter, so it's cheaper + faster on any LLM.

Several crashes have also been resolved, temperature is now properly set to 0 (which should increase performance on OpenAI models), Powershell on Linux support, an ugly print statement was removed, we're now enforcing a consistent code style (`black`, `isort`), and much more:

What's Changed
* Fix a crash in get_relevant_procedures_string by Notnaton in https://github.com/KillianLucas/open-interpreter/pull/676
* Fixed issue with 3.5 Models hallucinating a function called "python", causing empty returns by Cobular in https://github.com/KillianLucas/open-interpreter/pull/683
* Fixed Issue 661 by shubhexists in https://github.com/KillianLucas/open-interpreter/pull/687
* Consider hiding the api-key by Notnaton in https://github.com/KillianLucas/open-interpreter/pull/682
* Remove space from language by Notnaton in https://github.com/KillianLucas/open-interpreter/pull/680
* Update README.md by Shivam250702 in https://github.com/KillianLucas/open-interpreter/pull/677
* docs: fix typo in docs/WINDOWS.md by suravshresth in https://github.com/KillianLucas/open-interpreter/pull/658
* Update MACOS.md by ihgalis in https://github.com/KillianLucas/open-interpreter/pull/471
* Update README.md with ref to MACOS.md by ihgalis in https://github.com/KillianLucas/open-interpreter/pull/472
* Clarity updates to README.md by shruti222patel in https://github.com/KillianLucas/open-interpreter/pull/674
* fix: make sure safe_mode is disabled by default by ericrallen in https://github.com/KillianLucas/open-interpreter/pull/705
* Update README.md to say Mistral 7B by Maclean-D in https://github.com/KillianLucas/open-interpreter/pull/690
* fix: default to 0 if temperature is unset by ericrallen in https://github.com/KillianLucas/open-interpreter/pull/710
* chore: add better docs for safe_mode; load semgrep if available by ericrallen in https://github.com/KillianLucas/open-interpreter/pull/709
* chore: remove extraneous chroma package; clean up dependency list by ericrallen in https://github.com/KillianLucas/open-interpreter/pull/704
* fix: make all local models run through the html entity buffer by ericrallen in https://github.com/KillianLucas/open-interpreter/pull/703
* Fix GNU readline support for user input by cowile in https://github.com/KillianLucas/open-interpreter/pull/522
* docs: fix markdown formatting; better explain %tokens by ericrallen in https://github.com/KillianLucas/open-interpreter/pull/695
* fix: clarify that %tokens estimates token usage for next request by ericrallen in https://github.com/KillianLucas/open-interpreter/pull/694
* Proposal: Enforce consistent code style with black, isort, and pre-commit by ericrallen in https://github.com/KillianLucas/open-interpreter/pull/699
* Fix for failing Powershell code execution on Linux by thefazzer in https://github.com/KillianLucas/open-interpreter/pull/729
* Update README.md for sample FastAPI by AndrewNgo-ini in https://github.com/KillianLucas/open-interpreter/pull/727
* Update MACOS.md: fix command by pjpjq in https://github.com/KillianLucas/open-interpreter/pull/725
* update Readme_ZH.md by HashCookie in https://github.com/KillianLucas/open-interpreter/pull/712

New Contributors
* Notnaton made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/676
* Cobular made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/683
* shubhexists made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/687
* Shivam250702 made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/677
* suravshresth made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/658
* shruti222patel made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/674
* cowile made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/522
* thefazzer made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/729
* AndrewNgo-ini made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/727
* pjpjq made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/725
* HashCookie made their first contribution in https://github.com/KillianLucas/open-interpreter/pull/712

**Full Changelog**: https://github.com/KillianLucas/open-interpreter/compare/v0.1.10...v0.1.11

**Great work everyone!**