Autogen

This is a beta release of v0.2.0b2.

Highlights
* **Support for GPT-4V!** Introduced Large Multimodal Models in AgentChat, enhancing capabilities and interactions within the platform. Blogpost: https://microsoft.github.io/autogen/blog/2023/11/06/LMM-Agent
* Improved codebase reliability with updates such as dict copying before modifications (fixing a bug for Azure OpenAI) and various typo fixes.
* Added support for unstructured data in retrieve chat (RAG).
* Expanded functionality with async support for better `get_human_input` handling.
* A new simple Testbed tool for Autogen processes.
* Enhanced developer tools and documentation, including new README and TRANSPARENCY_FAQS updates.

Thanks to all the testers for the v0.2 migration. Thanks to BeibinLi sonichi AkariLan vatsalya-vyas gfggithubleet gagb thinkall hung-ngm afourney AaadityaG jasondotparse bonadio aayushchhabra1999 qingyun-wu eltociear marcgreen and other contributors!

What's Changed
* Added a simple Testbed tool for repeatedly running templated Autogen scenarios with tightly-controlled initial conditions. by afourney in https://github.com/microsoft/autogen/pull/455
* Fix typo import autogen by hung-ngm in https://github.com/microsoft/autogen/pull/549
* Add support to unstructrued by thinkall in https://github.com/microsoft/autogen/pull/501
* Update TRANSPARENCY_FAQS.md by gfggithubleet in https://github.com/microsoft/autogen/pull/492
* Update README.md by vatsalya-vyas in https://github.com/microsoft/autogen/pull/507
* fix wrong 'Langchain Provided Tools as Functions' doc ref by AkariLan in https://github.com/microsoft/autogen/pull/495
* copy dicts before modifying by sonichi in https://github.com/microsoft/autogen/pull/551
* Large Multimodal Models in AgentChat by BeibinLi in https://github.com/microsoft/autogen/pull/554

New Contributors
* hung-ngm made their first contribution in https://github.com/microsoft/autogen/pull/549
* gfggithubleet made their first contribution in https://github.com/microsoft/autogen/pull/492
* vatsalya-vyas made their first contribution in https://github.com/microsoft/autogen/pull/507
* AkariLan made their first contribution in https://github.com/microsoft/autogen/pull/495

**Full Changelog**: https://github.com/microsoft/autogen/compare/v0.2.0b1...v0.2.0b2

This is a beta release of v0.2.0.

Highlights
* Switching to openai v1. Please read the [migration guide](https://microsoft.github.io/autogen/docs/Installation/#migration-guide-to-v02) and report bugs.
* Support async function execution & get_human_input.
* Improvements in documentation and notebooks.

Thanks to all the reviewers for the v0.2 migration. Thanks to aayushchhabra1999 bonadio marcgreen and other contributors!
 
What's Changed
* Update Installation.md by gagb in https://github.com/microsoft/autogen/pull/456
* Update FAQ with workaround for Issue 251 by marcgreen in https://github.com/microsoft/autogen/pull/405
* Fix typo in README.md by eltociear in https://github.com/microsoft/autogen/pull/481
* Fix/async function and tool execution by aayushchhabra1999 in https://github.com/microsoft/autogen/pull/87
* Adding async support to get_human_input by bonadio in https://github.com/microsoft/autogen/pull/466
* Added example .txt file for agentchat_langchain sample notebook by jasondotparse in https://github.com/microsoft/autogen/pull/373
* Fix : Typo by AaadityaG in https://github.com/microsoft/autogen/pull/506
* Dev/v0.2 by sonichi in https://github.com/microsoft/autogen/pull/393

New Contributors
* marcgreen made their first contribution in https://github.com/microsoft/autogen/pull/405
* aayushchhabra1999 made their first contribution in https://github.com/microsoft/autogen/pull/87
* bonadio made their first contribution in https://github.com/microsoft/autogen/pull/466
* jasondotparse made their first contribution in https://github.com/microsoft/autogen/pull/373
* AaadityaG made their first contribution in https://github.com/microsoft/autogen/pull/506

**Full Changelog**: https://github.com/microsoft/autogen/compare/v0.1.14...v0.2.0b1

Highlights

- 👀Give vision to your agent: **multimodal** examples are added at https://github.com/microsoft/autogen/blob/main/notebook/agentchat_lmm_llava.ipynb.
- 📖**TeachableAgent** blogpost: https://microsoft.github.io/autogen/blog/2023/10/26/TeachableAgent.
- 🧵 Run a chat in a different thread/process: using thread safe timeout for code execution.
- 🪶 Qdrant vector store: A QdrantRetrieveUserProxyAgent is added in contrib/.
- 🚦 Support new version of chromadb in retrieve chat.
- 🧮 Token count utils.
- 🐋 Improve vscode extension setup in codespace.
- 📝 Many improvements in documentation, FAQ, useful tips, such as
- how to prevent gpt-3.5 agents' appreciation loop
- fixes in the langchain notebook
- link to the roadmap
- common issues in retrieve chat

Thanks to BeibinLi rickyloynd-microsoft ragyabraham Anush008 thinkall kevin666aa shruti222patel craigomatic AaronWard and all the other contributors!

Headsup

v0.2 release is near the corner, and we'll switch to openai v1 in it. Please check for breaking changes in https://github.com/microsoft/autogen/pull/393. We'll try to add as many features back as possible before the release. If you see any breaking changes that affect your work, please comment in the PR thread.

What's Changed
* Added `Roadmap` to Getting-Started.md by Gourav2609 in https://github.com/microsoft/autogen/pull/324
* Resolves Typo Correction 336 by 2good4hisowngood in https://github.com/microsoft/autogen/pull/338
* Update README.md by IshitaPathak in https://github.com/microsoft/autogen/pull/321
* Updating Examples to follow new categorical structure. 273 by rabbabansh in https://github.com/microsoft/autogen/pull/327
* Fix grammar in agentchat_auto_feedback_from_code_execution.ipynb by shruti222patel in https://github.com/microsoft/autogen/pull/342
* Fix spellings in notebooks by shruti222patel in https://github.com/microsoft/autogen/pull/341
* Fix grammar and spelling in agentchat_chess.ipynb by shruti222patel in https://github.com/microsoft/autogen/pull/346
* Improve readability for agentchat_function_call.ipynb by shruti222patel in https://github.com/microsoft/autogen/pull/347
* Improve readability in agentchat_groupchat_research.ipynb by shruti222patel in https://github.com/microsoft/autogen/pull/350
* fix format issue by qingyun-wu in https://github.com/microsoft/autogen/pull/358
* Improve readability in oai_openai_utils.ipynb by shruti222patel in https://github.com/microsoft/autogen/pull/365
* Improve readability in oai_completion.ipynb by shruti222patel in https://github.com/microsoft/autogen/pull/364
* Fix grammar in agentchat_web_info.ipynb by shruti222patel in https://github.com/microsoft/autogen/pull/362
* Improve readability for agentchat_two_users.ipynb by shruti222patel in https://github.com/microsoft/autogen/pull/361
* Fix the grammar and spelling in agentchat_human_feedback.ipynb by shruti222patel in https://github.com/microsoft/autogen/pull/354
* Fix spelling and grammar in agentchat_langchain.ipynb by shruti222patel in https://github.com/microsoft/autogen/pull/355
* Fix grammar and spelling in agentchat_planning.ipynb by shruti222patel in https://github.com/microsoft/autogen/pull/356
* Fix grammar in agentchat_stream.ipynb by shruti222patel in https://github.com/microsoft/autogen/pull/357
* headsup about dependency change by sonichi in https://github.com/microsoft/autogen/pull/378
* Add link to OptiGuide 371 by smty2018 in https://github.com/microsoft/autogen/pull/376
* Update docs in RetrieveChat notebook and Installation by thinkall in https://github.com/microsoft/autogen/pull/379
* config list for test by sonichi in https://github.com/microsoft/autogen/pull/395
* Supporting MultiModal Models: an example with LLaVA Notebook by BeibinLi in https://github.com/microsoft/autogen/pull/286
* using thread safe timeout to allow code execution to be compatible wi… by ragyabraham in https://github.com/microsoft/autogen/pull/224
* Fix tmp dir not exists by thinkall in https://github.com/microsoft/autogen/pull/401
* feat: Qdrant vector store support by Anush008 in https://github.com/microsoft/autogen/pull/303
* [Blocking Issue] Add tests dependencies for qdrant and fix chromadb errors by thinkall in https://github.com/microsoft/autogen/pull/435
* TeachableAgent blog post by rickyloynd-microsoft in https://github.com/microsoft/autogen/pull/436
* Adds jupyter as a vscode extension, fix validation errors in devcontainer.json by craigomatic in https://github.com/microsoft/autogen/pull/433
* Update FAQ section in documentation by AaronWard in https://github.com/microsoft/autogen/pull/390
* Add token_count_util by kevin666aa in https://github.com/microsoft/autogen/pull/421
* spelling fix for math_user_proxy_agent.py by codingdrone in https://github.com/microsoft/autogen/pull/431
* bump version to 0.1.14 by sonichi in https://github.com/microsoft/autogen/pull/400

New Contributors
* 2good4hisowngood made their first contribution in https://github.com/microsoft/autogen/pull/338
* IshitaPathak made their first contribution in https://github.com/microsoft/autogen/pull/321
* rabbabansh made their first contribution in https://github.com/microsoft/autogen/pull/327
* ragyabraham made their first contribution in https://github.com/microsoft/autogen/pull/224
* Anush008 made their first contribution in https://github.com/microsoft/autogen/pull/303
* craigomatic made their first contribution in https://github.com/microsoft/autogen/pull/433
* codingdrone made their first contribution in https://github.com/microsoft/autogen/pull/431

**Full Changelog**: https://github.com/microsoft/autogen/compare/v0.1.13...v0.1.14

Highlights

A preliminary `TeachableAgent` is added to allow users to teach their assistant facts, preferences, and tasks unrelated to code generation. Example notebook: https://github.com/microsoft/autogen/blob/main/notebook/agentchat_teachability.ipynb

Conversational assistants based on LLMs can remember the current chat with the user, and can even demonstrate in-context learning of things that the user teaches the assistant during the chat. But these memories and learnings are lost once the chat is over, or when a single chat grows too long. In subsequent chats, the user is forced to repeat any necessary instructions over and over.

`TeachableAgent` addresses these limitations by persisting user teachings across chat boundaries in long-term memory (a vector database). Memory is saved to disk at the end of each chat, then loaded from disk at the start of the next. Instead of copying all of memory into the context window, which would eat up valuable space, individual memories (called memos) are retrieved into context as needed. This allows the user to teach frequently used facts, preferences and skills to the agent just once, and have the agent remember them in later chats.

This release also contains an update about openai models and pricing, and restricts the openai package dependency version. In v0.2 we will switch to openai>=1.

Thanks to rickyloynd-microsoft kevin666aa and all the other contributors!

What's Changed
* doc: Update FAQ.md by haseeb-xd in https://github.com/microsoft/autogen/pull/282
* Fix format and links in documentations by thinkall in https://github.com/microsoft/autogen/pull/310
* update openai models and pricing by kevin666aa in https://github.com/microsoft/autogen/pull/316
* guidance for contribution by sonichi in https://github.com/microsoft/autogen/pull/320
* TeachableAgent by rickyloynd-microsoft in https://github.com/microsoft/autogen/pull/278
* add downloads stats in readme by sonichi in https://github.com/microsoft/autogen/pull/334
* bump version to 0.1.13 by sonichi in https://github.com/microsoft/autogen/pull/333

New Contributors
* haseeb-xd made their first contribution in https://github.com/microsoft/autogen/pull/282
* rickyloynd-microsoft made their first contribution in https://github.com/microsoft/autogen/pull/278

**Full Changelog**: https://github.com/microsoft/autogen/compare/v0.1.12...v0.1.13

This release contains a significant improvement to function call in group chat. It decreases the chance of failures for group chat involving function calls. It also contains improvements to RAG agents, including added support for custom text splitter, example [notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_groupchat_RAG.ipynb) for RAG agent in group chat, and a [blogpost](https://microsoft.github.io/autogen/blog/2023/10/18/RetrieveChat). Thanks to thinkall and other contributors!

What's Changed
* Add support to custom text spliter by thinkall in https://github.com/microsoft/autogen/pull/270
* Update FAQ.md, elaborate on how to customise docker image and pick 'python:3' to solve typical errors by maxim-saplin in https://github.com/microsoft/autogen/pull/269
* Add group chat and retrieve agent example by thinkall in https://github.com/microsoft/autogen/pull/227
* docs: added virtual environment setup process by Ayushpanditmoto in https://github.com/microsoft/autogen/pull/249
* Fixing `code execution` broken link at `Getting Started` page by maxim-saplin in https://github.com/microsoft/autogen/pull/275
* Bump babel/traverse from 7.20.1 to 7.23.2 in /website by dependabot in https://github.com/microsoft/autogen/pull/283
* Add a blog for RAG agents by thinkall in https://github.com/microsoft/autogen/pull/284
* function call filter in group chat by sonichi in https://github.com/microsoft/autogen/pull/294
* fix typo in website/blog/2023-05-18-GPT-adaptive-humaneval/index.mdx by suravkshrestha in https://github.com/microsoft/autogen/pull/299
* Organize notebooks into logical groups 273 by victordibia in https://github.com/microsoft/autogen/pull/288
* Update docs for extra dependencies and virtual env creation by thinkall in https://github.com/microsoft/autogen/pull/297
* Update README.md with Roadmap. by gagb in https://github.com/microsoft/autogen/pull/304
* bump version to 0.1.12 by sonichi in https://github.com/microsoft/autogen/pull/301

New Contributors
* maxim-saplin made their first contribution in https://github.com/microsoft/autogen/pull/269
* Ayushpanditmoto made their first contribution in https://github.com/microsoft/autogen/pull/249
* suravkshrestha made their first contribution in https://github.com/microsoft/autogen/pull/299
* victordibia made their first contribution in https://github.com/microsoft/autogen/pull/288

**Full Changelog**: https://github.com/microsoft/autogen/compare/v0.1.11...v0.1.12

This release contains bug fixes, more clear behaviors for docker, and model compatibility improvement. Agents using Langchain tools are demonstrated in https://github.com/microsoft/autogen/blob/main/notebook/agentchat_langchain.ipynb. Thanks to ElliotWood and all the other contributors!

What's Changed
* Fix typo in agentchat_MathChat.ipynb by eltociear in https://github.com/microsoft/autogen/pull/191
* Make getting started a little easier by wayliums in https://github.com/microsoft/autogen/pull/180
* Fix edge cases extracting code when the message's content is None by msaelices in https://github.com/microsoft/autogen/pull/205
* Add md for faqs by gagb in https://github.com/microsoft/autogen/pull/194
* Fix typo in README.md by creator0131 in https://github.com/microsoft/autogen/pull/193
* Icons not centered in the "autogen_agentchat.png" by Steellgold in https://github.com/microsoft/autogen/pull/169
* Addresses issue 199 by afourney in https://github.com/microsoft/autogen/pull/200
* Improving logging in oai.completion to show token_count by kevin666aa in https://github.com/microsoft/autogen/pull/179
* Update Getting-Started.md by javidjamae in https://github.com/microsoft/autogen/pull/213
* Added comment about config_list in the README example 216 by smty2018 in https://github.com/microsoft/autogen/pull/218
* fix: be compatible with customizing model without all fields in the response by jtsang4 in https://github.com/microsoft/autogen/pull/222
* Update Installation.md-with detailed explanation on add a period or newline 219 by 05hiteshbansal in https://github.com/microsoft/autogen/pull/231
* Spelling fixes. by shruti222patel in https://github.com/microsoft/autogen/pull/220
* Typo by qingyun-wu in https://github.com/microsoft/autogen/pull/234
* bump version to 0.1.11 by sonichi in https://github.com/microsoft/autogen/pull/242
* docstr updated for `use_docker` in `execute_code ` by Gourav2609 in https://github.com/microsoft/autogen/pull/233
* document retrieve chat by olaoluwasalami in https://github.com/microsoft/autogen/pull/258
* Add a figure to autogen notebook 215 by smty2018 in https://github.com/microsoft/autogen/pull/246
* Langchain tool bridge (262) by sonichi in https://github.com/microsoft/autogen/pull/263

New Contributors
* wayliums made their first contribution in https://github.com/microsoft/autogen/pull/180
* msaelices made their first contribution in https://github.com/microsoft/autogen/pull/205
* gagb made their first contribution in https://github.com/microsoft/autogen/pull/194
* creator0131 made their first contribution in https://github.com/microsoft/autogen/pull/193
* Steellgold made their first contribution in https://github.com/microsoft/autogen/pull/169
* javidjamae made their first contribution in https://github.com/microsoft/autogen/pull/213
* smty2018 made their first contribution in https://github.com/microsoft/autogen/pull/218
* jtsang4 made their first contribution in https://github.com/microsoft/autogen/pull/222
* 05hiteshbansal made their first contribution in https://github.com/microsoft/autogen/pull/231
* shruti222patel made their first contribution in https://github.com/microsoft/autogen/pull/220
* Gourav2609 made their first contribution in https://github.com/microsoft/autogen/pull/233

**Full Changelog**: https://github.com/microsoft/autogen/compare/v0.1.10...v0.1.11