What's Changed
* Create extraction playground by rlancemartin in https://github.com/langchain-ai/langchain-benchmarks/pull/2
* Remove mention of default message by fpingham in https://github.com/langchain-ai/langchain-benchmarks/pull/6
* Add Criteria Evals by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/5
* add openai instruct benchmarking by hwchase17 in https://github.com/langchain-ai/langchain-benchmarks/pull/9
* Add other datasets by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/10
* Add LangChain Docs Benchmark Evals by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/12
* Add environment 1 for agents by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/14
* Version 2 by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/16
* Reformat entire codebase with ruff by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/17
* Remove accidental commits by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/18
* Add langsmith util to clone dataset by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/19
* Add clone/download dataset, handle web vs. api paths by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/20
* Scaffold for sphinx docs by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/21
* Add helper to Makefile by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/22
* Add datasets notebook by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/23
* Update description by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/24
* Add registry object, add eval notebook by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/25
* Add additional tasks, re-org repo a bit by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/26
* Add extraction task by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/29
* Refactor to remove ID from task, move task definitions out of registry.py by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/30
* Remove ID that doens't exist by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/31
* Restore `tasks` namespace, create agent factory by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/33
* Expand CI to also build sphinx docs by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/34
* Create doc publish workflow by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/35
* Fix typo in workflow to publish docs by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/36
* Update doc build by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/39
* Update langchain, relax requirements for deps by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/40
* Add more extraction code by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/37
* Update notebook for extraction by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/41
* Update lock file by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/42
* Bump dependencies for doc building by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/44
* Add RAG tasks by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/43
* Add filter option by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/45
* Add datasets for tool usage tasks by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/46
* Add multiverse math notebook, update dataset id by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/48
* Switch to api by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/50
* Make the example explicit by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/49
* More tool usage updates by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/51
* Check public datasets exist by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/54
* Move RAG unit tests by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/55
* Update notebooks toc by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/56
* Add Quick Start by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/52
* Update notebooks by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/47
* Another toc update by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/57
* Change schema for semi-structured by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/58
* Add retrieval intro; Add links by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/59
* Add extraction intro by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/60
* Agent Intros by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/61
* Add docs link by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/62
* Update extraction dataset by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/63
* Wfh/update name by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/64
* Update repo structure in readme by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/65
* Add MIT license by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/66
* Add badges to README by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/67
* Relax langchain constraints by eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/68
* Wfh/rerun notebooks by hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/69
New Contributors
* rlancemartin made their first contribution in https://github.com/langchain-ai/langchain-benchmarks/pull/2
* fpingham made their first contribution in https://github.com/langchain-ai/langchain-benchmarks/pull/6
* hwchase17 made their first contribution in https://github.com/langchain-ai/langchain-benchmarks/pull/9
* eyurtsev made their first contribution in https://github.com/langchain-ai/langchain-benchmarks/pull/14
**Full Changelog**: https://github.com/langchain-ai/langchain-benchmarks/commits/v0.0.1