Gpt-researcher

A lot of improved performance and reliability fixes. Thank you again to the amazing community and welcome to the new contributors!

What's Changed
* fix: replace gpt-4o hardcode model in multi-agent with env var. by galenyip in https://github.com/assafelovic/gpt-researcher/pull/1258
* fix: truncating task file names for long queries by pavlus007 in https://github.com/assafelovic/gpt-researcher/pull/1257
* Blog post by ElishaKay in https://github.com/assafelovic/gpt-researcher/pull/1250
* Add missing imports by rba100 in https://github.com/assafelovic/gpt-researcher/pull/1269
* Fixed issue of my-docs folder being created uncessarily 1268 by gaurav3247 in https://github.com/assafelovic/gpt-researcher/pull/1272
* Streamline reasoning_effort use guide across flows by KennyDizi in https://github.com/assafelovic/gpt-researcher/pull/1270
* Add published date and author to Arxiv context; adjust PDF scraper return; adjust detail report prompt for consistent formating style by akhyarthoriq in https://github.com/assafelovic/gpt-researcher/pull/1265
* Added post and get http endpoints to server and updated npm package to allow sending http requests by gaurav3247 in https://github.com/assafelovic/gpt-researcher/pull/1283
* New provider openrouter.ai added by bjoernh in https://github.com/assafelovic/gpt-researcher/pull/1302
* Add User-Agent: Mozilla when downloading a file by dcieslak19973 in https://github.com/assafelovic/gpt-researcher/pull/1297
* Fix AttributeError in PublisherAgent when processing string values by LavX in https://github.com/assafelovic/gpt-researcher/pull/1285

New Contributors
* galenyip made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1258
* pavlus007 made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1257
* rba100 made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1269
* KennyDizi made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1270
* akhyarthoriq made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1265
* bjoernh made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1302
* dcieslak19973 made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1297

**Full Changelog**: https://github.com/assafelovic/gpt-researcher/compare/v3.2.4...v3.2.5

Many bug fixes and performance improvements. We've finally added a research history sidebar to the research tasks! Thank you and welcome to all new contributors!


What's Changed
* fix: unblock web socket message queue by ewgdg in https://github.com/assafelovic/gpt-researcher/pull/1220
* perf: load balance nodriver browser scraper tabs by ewgdg in https://github.com/assafelovic/gpt-researcher/pull/1219
* Fix: image relevance filtering by czakop in https://github.com/assafelovic/gpt-researcher/pull/1215
* fix: cancel long running task gracefully by ewgdg in https://github.com/assafelovic/gpt-researcher/pull/1221
* polish npm run build while retaining domain filter setting by ElishaKay in https://github.com/assafelovic/gpt-researcher/pull/1224
* fix: add langchain-openai to project dependencies (to be safe on edge cases) by milosz-l in https://github.com/assafelovic/gpt-researcher/pull/1227
* feature: improve JSON parsing in multi agent setting (1137) by czakop in https://github.com/assafelovic/gpt-researcher/pull/1230
* fix: resolve failing test in tests/test_logging_output.py by grapestore in https://github.com/assafelovic/gpt-researcher/pull/1238
* fix: restrict Python version range in pyproject.toml by grapestore in https://github.com/assafelovic/gpt-researcher/pull/1236
* New Sidebar feature of recent Research History by assafelovic in https://github.com/assafelovic/gpt-researcher/pull/1240
* Fix KeyError: 'deep' in cli.py by hd365247 in https://github.com/assafelovic/gpt-researcher/pull/1245

New Contributors
* milosz-l made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1227
* grapestore made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1238
* hd365247 made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1245

**Full Changelog**: https://github.com/assafelovic/gpt-researcher/compare/v3.2.3...v3.2.4

Another exciting week with so much improvements by our amazing community. We're thrilled to announce the latest release of GPT Researcher, now featuring evaluations using the SimpleQA dataset by OpenAI. Our rigorous testing has demonstrated an impressive 93% accuracy rate, surpassing all current leading projects in the market.

This achievement underscores the remarkable capabilities of the open-source community, and we're just getting started! In response to extensive feedback, we've refined our deep research functionalities to be faster, smarter, and more cost-effective, while also addressing previous bugs. Update to the latest version and experience the enhancements firsthand!

Here are results of our latest evals run:

Evaluation Summary
-------------------------
Debug counts:
Total successful: 100
CORRECT: 93
INCORRECT: 7
NOT_ATTEMPTED: 1
{
"correct_rate": 0.93,
"incorrect_rate": 0.07,
"not_attempted_rate": 0.01,
"answer_rate": 0.99,
"accuracy": 0.9292929292929293,
"f1": 0.9246231155778895
}
-------------------------

What's Changed
* Fix `Key Error` while using Deep Research by kongacute in https://github.com/assafelovic/gpt-researcher/pull/1188
* Update requirements.txt with missing langgraph dep by namin in https://github.com/assafelovic/gpt-researcher/pull/1189
* Fix Docker Build Failure: Updated `combined_query` in `DeepRsearchSkill.run()` to Handle Backslashes in F-Strings by monolok in https://github.com/assafelovic/gpt-researcher/pull/1192
* stabilize docker & frontend upgrades by ElishaKay in https://github.com/assafelovic/gpt-researcher/pull/1191
* Improved overall planning and research performance by assafelovic in https://github.com/assafelovic/gpt-researcher/pull/1195
* Added support for base_url param in create_chat_completions for OpenAI Provider by gaurav3247 in https://github.com/assafelovic/gpt-researcher/pull/1198
* Update llm.py by olipayne in https://github.com/assafelovic/gpt-researcher/pull/1200
* Fix WebSocket timeout issues by luislofer89 in https://github.com/assafelovic/gpt-researcher/pull/1203
* fix: Add missing langgraph module to requirements.txt by hurxxxx in https://github.com/assafelovic/gpt-researcher/pull/1207
* Refactor: typing cleanup by czakop in https://github.com/assafelovic/gpt-researcher/pull/1187
* add async nodriver scrapper by ewgdg in https://github.com/assafelovic/gpt-researcher/pull/1170
* Add language requirement to resource report prompt by hurxxxx in https://github.com/assafelovic/gpt-researcher/pull/1208
* Feature:eval metrics by kga245 in https://github.com/assafelovic/gpt-researcher/pull/1183
* README for feat(evals): Add SimpleQA evaluation framework and initial results by kga245 in https://github.com/assafelovic/gpt-researcher/pull/1212
* Polish up loose ends based on feedback by ElishaKay in https://github.com/assafelovic/gpt-researcher/pull/1211

New Contributors
* namin made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1189
* olipayne made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1200
* luislofer89 made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1203
* hurxxxx made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1207
* czakop made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1187

**Full Changelog**: https://github.com/assafelovic/gpt-researcher/compare/v3.2.2...v3.2.3

Wow, what a major release this is! We're so excited to release our very own version of Deep Research! Also, this release has so many performance improvements including a new integration with FireCrawl for production scraping!

🎉 Announcing Deep Research for GPT Researcher

We're thrilled to announce the release of Deep Research - a powerful new capability for GPT Researcher that takes autonomous research to the next level!

What is Deep Research?
Deep Research is an advanced recursive research system that explores topics with unprecedented depth and breadth using a tree-like exploration pattern. Think of it as deploying a team of specialized AI researchers, each diving deep into different aspects of your topic while maintaining a cohesive understanding of the bigger picture.

Key Features
- 🌳 **Tree-like Exploration**: Configurable depth and breadth parameters let you control how wide and deep the research goes
- ⚡️ **Concurrent Processing**: Multiple research paths are explored simultaneously for faster results
- 🤝 **Smart Context Management**: Automatic aggregation and synthesis of findings across all research branches
- 📊 **Real-time Progress Tracking**: Monitor your research progress across both breadth and depth dimensions

Performance & Resources
- ⏱️ Average completion time: ~5 minutes per deep research
- 💰 Cost-effective: ~$0.4 per research using `o3-mini` on "high" reasoning effort
- 🎯 Produces comprehensive reports with multiple perspectives and deeper insights

Getting Started
Deep Research is available now in the latest version of GPT Researcher. You can enable it by:
1. Using the PIP package with `report_type="deep"`
2. Selecting "Deep Research" in the web interface
3. Configuring custom parameters through environment variables or config files

Documentation
For detailed information about Deep Research, including configuration options and best practices, visit our [Deep Research documentation](https://docs.gptr.dev/docs/gpt-researcher/gptr/deep_research).

Try it out today and experience a new level of autonomous research capability!

What's Changed
* Fix: missing temperature parameter ( 1154 ) by DaisukeUra in https://github.com/assafelovic/gpt-researcher/pull/1155
* Update Dependencies to Fix OpenAI API Parameter Error by Jones0073 in https://github.com/assafelovic/gpt-researcher/pull/1161
* Update docker doc to add langchain packages by azertylr in https://github.com/assafelovic/gpt-researcher/pull/1167
* Fixed constuct subtopics by vinayvikram in https://github.com/assafelovic/gpt-researcher/pull/1172
* feat: Add BSHTMLLoader support and enhance error handling for document loading by LavX in https://github.com/assafelovic/gpt-researcher/pull/1166
* Enhanced incorrect json format handling at agent_creator.py by johnmalek312 in https://github.com/assafelovic/gpt-researcher/pull/1168
* Added the Azure-storage option for document sources. by Shivam-19agg in https://github.com/assafelovic/gpt-researcher/pull/1165
* Filter by domain[s] by ElishaKay in https://github.com/assafelovic/gpt-researcher/pull/1157
* Fix: ArxivScraper causing error when scraping the link. by new-player in https://github.com/assafelovic/gpt-researcher/pull/1178
* Deep Research logic to enhance GPT Researcher capabilities by assafelovic in https://github.com/assafelovic/gpt-researcher/pull/1179
* Add FireCrawl scaper by kongacute in https://github.com/assafelovic/gpt-researcher/pull/1177

New Contributors
* DaisukeUra made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1155
* Jones0073 made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1161
* azertylr made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1167
* vinayvikram made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1172
* LavX made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1166
* johnmalek312 made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1168
* Shivam-19agg made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1165
* new-player made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1178
* kongacute made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1177

**Full Changelog**: https://github.com/assafelovic/gpt-researcher/compare/v3.2.1...v3.2.2

---
Join our [Discord community](https://discord.gg/QgZXvJAccX) to share your experience and feedback. :-)

With the latest Deep Research hype - which you all know is actually what GPTR is all about already two years ago :), we've added support for reasoning models across the entire research workflow, including support for more deeper research. You can now easily add the following env vars to GPTR for a Deep Research experience!


What's Changed
* Update README.md for multi-agents by danieldekay in https://github.com/assafelovic/gpt-researcher/pull/1138
* Fix scraper browser returns duplicate texts by ewgdg in https://github.com/assafelovic/gpt-researcher/pull/1134
* refactor: get text from soup by ewgdg in https://github.com/assafelovic/gpt-researcher/pull/1143
* fixed polling param for ubuntu host by kga245 in https://github.com/assafelovic/gpt-researcher/pull/1151
* added helpful optional configs for dockerized hosting by kga245 in https://github.com/assafelovic/gpt-researcher/pull/1150
* Adds support for o3-mini by regismesquita in https://github.com/assafelovic/gpt-researcher/pull/1144

New Contributors
* ewgdg made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1134
* regismesquita made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1144

**Full Changelog**: https://github.com/assafelovic/gpt-researcher/compare/v3.2.0...v3.2.1

This release is focused on many performance improvements and bug fixes, making GPT Researcher more powerful than before. With the release of Deep Research, we've been hands down fixing and improving performance to sustain our position as the leading open deep research. Thanks and welcome to all the new contributors who helped push GPTR further!

What's Changed
* GPTR api url, npm package & other polishes by ElishaKay in https://github.com/assafelovic/gpt-researcher/pull/1093
* fix(1100): apply language config to Introduction and Conclusion sections by DAAE-Na-Yunchae in https://github.com/assafelovic/gpt-researcher/pull/1101
* feature/support GigaChat LLM by Rai220 in https://github.com/assafelovic/gpt-researcher/pull/1095
* Update Poetry to supported Python version by chrishart0 in https://github.com/assafelovic/gpt-researcher/pull/1107
* Update tavily_search.py so TAVILY missing error no longer occurs by cnukaus in https://github.com/assafelovic/gpt-researcher/pull/1113
* Add google_genai:text-embedding-004 by gmh5225 in https://github.com/assafelovic/gpt-researcher/pull/1112
* fix: add language param to generate_outline_report_prompt by fibonacci998 in https://github.com/assafelovic/gpt-researcher/pull/1109
* fix: update broken link in README by fibonacci998 in https://github.com/assafelovic/gpt-researcher/pull/1117
* Fixed human in the loop by electricjimi in https://github.com/assafelovic/gpt-researcher/pull/1116
* Fixed broken configuration link in llms.md by Ajacmac in https://github.com/assafelovic/gpt-researcher/pull/1121
* feat: enhance scraper logging and title handling by kga245 in https://github.com/assafelovic/gpt-researcher/pull/1118
* fix: update directory nextjs example in langgraph.md by fibonacci998 in https://github.com/assafelovic/gpt-researcher/pull/1123

New Contributors
* DAAE-Na-Yunchae made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1101
* Rai220 made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1095
* chrishart0 made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1107
* cnukaus made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1113
* gmh5225 made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1112
* fibonacci998 made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1109
* electricjimi made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1116
* Ajacmac made their first contribution in https://github.com/assafelovic/gpt-researcher/pull/1121

**Full Changelog**: https://github.com/assafelovic/gpt-researcher/compare/v3.1.9...v3.2.0