Ragas

What's Changed
* Avoid unnecessary decompose_claims call when mode='precision' in _factual_correctness.py by dfhssilva in https://github.com/explodinggradients/ragas/pull/1669
* fixes: instruction format by shahules786 in https://github.com/explodinggradients/ragas/pull/1672
* docs: updated readme by jjmachan in https://github.com/explodinggradients/ragas/pull/1674
* docs: update readme by jjmachan in https://github.com/explodinggradients/ragas/pull/1675
* fixes: add extraction limit to Extractors by shahules786 in https://github.com/explodinggradients/ragas/pull/1673
* fix: upload for testset by jjmachan in https://github.com/explodinggradients/ragas/pull/1676
* removed MetricWithLLM from SemanticSimilarity by Luka958Pixion in https://github.com/explodinggradients/ragas/pull/1678
* feat: improvements in default test generation by shahules786 in https://github.com/explodinggradients/ragas/pull/1661
* Update rag.md by TimWue in https://github.com/explodinggradients/ragas/pull/1686
* fix: missing embeddings argument in testset and some E2E tests by jjmachan in https://github.com/explodinggradients/ragas/pull/1690
* fixes: handle long context extraction by shahules786 in https://github.com/explodinggradients/ragas/pull/1680
* feat: make general purpose metrics more general by jjmachan in https://github.com/explodinggradients/ragas/pull/1666
* Fixes ToolCallAccuracy raises ZeroDivisionError when called without any arguments. by sahusiddharth in https://github.com/explodinggradients/ragas/pull/1685

New Contributors
* dfhssilva made their first contribution in https://github.com/explodinggradients/ragas/pull/1669
* Luka958Pixion made their first contribution in https://github.com/explodinggradients/ragas/pull/1678
* TimWue made their first contribution in https://github.com/explodinggradients/ragas/pull/1686

**Full Changelog**: https://github.com/explodinggradients/ragas/compare/v0.2.5...v0.2.6

What's Changed
* feat: Unify the use of sentence_segmenter by jasinliu in https://github.com/explodinggradients/ragas/pull/1629
* feat: aspect critic with reference by shahules786 in https://github.com/explodinggradients/ragas/pull/1638
* docs: change setting llm by shahules786 in https://github.com/explodinggradients/ragas/pull/1639
* fixed wrong variable names in starter guide using azure openai by MichaelPerger in https://github.com/explodinggradients/ragas/pull/1641
* feat: improvements in test gen by shahules786 in https://github.com/explodinggradients/ragas/pull/1645
* Add tutorial for evaluating LangGraph agents by sahusiddharth in https://github.com/explodinggradients/ragas/pull/1636
* docs: add cost tracker back by shahules786 in https://github.com/explodinggradients/ragas/pull/1653
* docs: tracing and debugging metrics by shahules786 in https://github.com/explodinggradients/ragas/pull/1652
* feat: upload testset generation upload by jjmachan in https://github.com/explodinggradients/ragas/pull/1647
* docs: reorganise files by shahules786 in https://github.com/explodinggradients/ragas/pull/1662
* docs: fix _arize.md by suekou in https://github.com/explodinggradients/ragas/pull/1643
* docs: persona generator by jjmachan in https://github.com/explodinggradients/ragas/pull/1664
* Bug fixing recall in _factual_correctness.py by GitMarco27 in https://github.com/explodinggradients/ragas/pull/1650

New Contributors
* MichaelPerger made their first contribution in https://github.com/explodinggradients/ragas/pull/1641
* GitMarco27 made their first contribution in https://github.com/explodinggradients/ragas/pull/1650

**Full Changelog**: https://github.com/explodinggradients/ragas/compare/v0.2.4...v0.2.5

What's Changed
* Fix : Filename in the path by satodayo in https://github.com/explodinggradients/ragas/pull/1605
* fix: remove abstract class in Metric by jjmachan in https://github.com/explodinggradients/ragas/pull/1603
* Added pandas as a method for reading datasets by joaorura in https://github.com/explodinggradients/ragas/pull/1595
* fix: treat anthropic-direct API the same as bedrock in llamaindex wrapper by ahgraber in https://github.com/explodinggradients/ragas/pull/1584
* feat: add support for llamaindex by jjmachan in https://github.com/explodinggradients/ragas/pull/1609
* docs: Add embedding_model attribute when creating TestsetGenerator object by Youngrok123 in https://github.com/explodinggradients/ragas/pull/1606
* Fix: Add instance check before casting ChatGeneration object by Youngrok123 in https://github.com/explodinggradients/ragas/pull/1607
* docs: add comment for claude-3-5-sonnet-20241022 by SokiKawashima in https://github.com/explodinggradients/ragas/pull/1611
* docs: add community docs by Yunnglin in https://github.com/explodinggradients/ragas/pull/1612
* Handle embeddings for empty strings in AnswerSimilarity class by baptiste-pasquier in https://github.com/explodinggradients/ragas/pull/994
* Feature: batched execution by ahgraber in https://github.com/explodinggradients/ragas/pull/1589
* docs: how to add custom metrics by jjmachan in https://github.com/explodinggradients/ragas/pull/1616
* docs: added azure openai to default docs by jjmachan in https://github.com/explodinggradients/ragas/pull/1610
* Introduce epsilon in denominators to avoid division by zero by jltham in https://github.com/explodinggradients/ragas/pull/1622
* feat: Add support for llamaIndex in evaluation by suekou in https://github.com/explodinggradients/ragas/pull/1619
* feat: added upload for `EvaluationResult` by jjmachan in https://github.com/explodinggradients/ragas/pull/1625
* feat: automatic persona generation by shahules786 in https://github.com/explodinggradients/ragas/pull/1618
* docs: Refactor Code for Syntax Highlighting and URL Updates by suekou in https://github.com/explodinggradients/ragas/pull/1634
* fix: remove `.` as a split condition in noise_sensitivity.py by jasinliu in https://github.com/explodinggradients/ragas/pull/1627
* feat: improvements in test synthesization by shahules786 in https://github.com/explodinggradients/ragas/pull/1621

New Contributors
* satodayo made their first contribution in https://github.com/explodinggradients/ragas/pull/1605
* joaorura made their first contribution in https://github.com/explodinggradients/ragas/pull/1595
* SokiKawashima made their first contribution in https://github.com/explodinggradients/ragas/pull/1611
* jltham made their first contribution in https://github.com/explodinggradients/ragas/pull/1622
* jasinliu made their first contribution in https://github.com/explodinggradients/ragas/pull/1627

**Full Changelog**: https://github.com/explodinggradients/ragas/compare/v0.2.3...v0.2.4

What's Changed
* feat: measure cost of testset generator by jjmachan in https://github.com/explodinggradients/ragas/pull/1560
* docs: added luka's blogs by jjmachan in https://github.com/explodinggradients/ragas/pull/1554
* Fix: add LLMContextPrecisionWithReference to __init__.py by licux in https://github.com/explodinggradients/ragas/pull/1561
* chore: add verbose option (V=1) to make targets by trevorbowen in https://github.com/explodinggradients/ragas/pull/1556
* add embeddings to TestsetGenerator by hunter-walden2113 in https://github.com/explodinggradients/ragas/pull/1562
* fixed verb agreement available_metrics by gabrielhomsi in https://github.com/explodinggradients/ragas/pull/1574
* Fix: Limit number of retries for parse failures by rskew in https://github.com/explodinggradients/ragas/pull/1569
* Fix: reference key error in LLMContextPrecisionWithoutReference by xizhou-vw in https://github.com/explodinggradients/ragas/pull/1570
* Updated return type description for evaluate function by taihim in https://github.com/explodinggradients/ragas/pull/1579
* Feat: add multimodal eval support by Yunnglin in https://github.com/explodinggradients/ragas/pull/1559
* fix: add `reference_topics` as default required columns in `TopicAdherenceScore` 1564 by luqmansen in https://github.com/explodinggradients/ragas/pull/1566
* fix: add reference tool call to required cols by shahules786 in https://github.com/explodinggradients/ragas/pull/1580
* Improve efficiency in factual correctness for precision mode by Jeff-67 in https://github.com/explodinggradients/ragas/pull/1578
* This commit implements the F-beta score metric by Yuri-Albuquerque in https://github.com/explodinggradients/ragas/pull/1543
* fix: agent goal accuracy by shahules786 in https://github.com/explodinggradients/ragas/pull/1583
* chores: fix pypi rendering by shahules786 in https://github.com/explodinggradients/ragas/pull/1581
* fix: typo: ROUGE is a metric, ROGUE is a scoundrel by ahgraber in https://github.com/explodinggradients/ragas/pull/1585

New Contributors
* trevorbowen made their first contribution in https://github.com/explodinggradients/ragas/pull/1556
* hunter-walden2113 made their first contribution in https://github.com/explodinggradients/ragas/pull/1562
* gabrielhomsi made their first contribution in https://github.com/explodinggradients/ragas/pull/1574
* rskew made their first contribution in https://github.com/explodinggradients/ragas/pull/1569
* xizhou-vw made their first contribution in https://github.com/explodinggradients/ragas/pull/1570
* taihim made their first contribution in https://github.com/explodinggradients/ragas/pull/1579
* luqmansen made their first contribution in https://github.com/explodinggradients/ragas/pull/1566
* Yuri-Albuquerque made their first contribution in https://github.com/explodinggradients/ragas/pull/1543

**Full Changelog**: https://github.com/explodinggradients/ragas/compare/v0.2.2...v0.2.3

What's Changed
* docs: update summarization calculation by jCobbSK in https://github.com/explodinggradients/ragas/pull/1510
* fix: use get_temperature in base LLM generate by sapphire-arches in https://github.com/explodinggradients/ragas/pull/1520
* doc: Update modifying prompts metrics doc by FrankyCTY in https://github.com/explodinggradients/ragas/pull/1525
* fixbug: Expand sentence-ending punctuation check in _create_statements method by Jeff-67 in https://github.com/explodinggradients/ragas/pull/1523
* fix: zero division error by shahules786 in https://github.com/explodinggradients/ragas/pull/1530
* feat: add traces to `EvaluationResult` by jjmachan in https://github.com/explodinggradients/ragas/pull/1531
* feat: translate instruction when adapting prompt by Yunnglin in https://github.com/explodinggradients/ragas/pull/1529
* chore: remove old prompt object by jjmachan in https://github.com/explodinggradients/ragas/pull/1535
* feat: improved the testset generation to_pandas and docs by jjmachan in https://github.com/explodinggradients/ragas/pull/1536
* fixed typo in "single_turn_ascore" by minorun365 in https://github.com/explodinggradients/ragas/pull/1542
* update AspectCritic docs examples by licux in https://github.com/explodinggradients/ragas/pull/1547
* Fix: Resolve Agentic failure loop with improved json parsing by ahgraber in https://github.com/explodinggradients/ragas/pull/1541
* feat: throw error when max_token limit is reached by jjmachan in https://github.com/explodinggradients/ragas/pull/1549
* docs: fix Amazon bedrock info by jjmachan in https://github.com/explodinggradients/ragas/pull/1551
* Added community blog posts in Japanese by minorun365 in https://github.com/explodinggradients/ragas/pull/1550
* docs: make llms and embeddings explicit by jjmachan in https://github.com/explodinggradients/ragas/pull/1553

New Contributors
* jCobbSK made their first contribution in https://github.com/explodinggradients/ragas/pull/1510
* sapphire-arches made their first contribution in https://github.com/explodinggradients/ragas/pull/1520
* FrankyCTY made their first contribution in https://github.com/explodinggradients/ragas/pull/1525
* Jeff-67 made their first contribution in https://github.com/explodinggradients/ragas/pull/1523
* Yunnglin made their first contribution in https://github.com/explodinggradients/ragas/pull/1529
* licux made their first contribution in https://github.com/explodinggradients/ragas/pull/1547
* ahgraber made their first contribution in https://github.com/explodinggradients/ragas/pull/1541

**Full Changelog**: https://github.com/explodinggradients/ragas/compare/v0.2.1...v0.2.2

What's Changed
* Fix Discord link by NirantK in https://github.com/explodinggradients/ragas/pull/1498
* Fix Quickstart link by NirantK in https://github.com/explodinggradients/ragas/pull/1499
* Rewrite Open Analytics by NirantK in https://github.com/explodinggradients/ragas/pull/1500
* Suggestions for Introduction and Key Features by NirantK in https://github.com/explodinggradients/ragas/pull/1501
* docs: fix broken links in testset generation custimisation by jjmachan in https://github.com/explodinggradients/ragas/pull/1502
* Update Bedrock modules for LangChain v0.3.x by minorun365 in https://github.com/explodinggradients/ragas/pull/1487
* Fixes: Quickstart Ragas Metrics by NirantK in https://github.com/explodinggradients/ragas/pull/1504
* Add Contributors by NirantK in https://github.com/explodinggradients/ragas/pull/1505
* docs: Change test_size parameter name to testset_size by Youngrok123 in https://github.com/explodinggradients/ragas/pull/1507
* docs: readme add llm by shahules786 in https://github.com/explodinggradients/ragas/pull/1511
* docs: add faq by shahules786 in https://github.com/explodinggradients/ragas/pull/1503
* fix: propagate callbacks in RagasOutputParser by dlyz in https://github.com/explodinggradients/ragas/pull/1513
* docs: fix usage of eval dataset by shahules786 in https://github.com/explodinggradients/ragas/pull/1514
* feat: use ensure_ascii=False for KnowledgeGraph files by dlyz in https://github.com/explodinggradients/ragas/pull/1518
* fix: import error for TestsetGeneration and small fixes by jjmachan in https://github.com/explodinggradients/ragas/pull/1516

New Contributors
* NirantK made their first contribution in https://github.com/explodinggradients/ragas/pull/1498
* minorun365 made their first contribution in https://github.com/explodinggradients/ragas/pull/1487
* dlyz made their first contribution in https://github.com/explodinggradients/ragas/pull/1513

**Full Changelog**: https://github.com/explodinggradients/ragas/compare/v0.2.0...v0.2.1