Changeset
![bulk-chain-small](https://github.com/user-attachments/assets/9088fa15-7944-4304-9484-21ecaab8473d)
:blue_book: [What's new in 0.25.0](https://github.com/nicolay-r/bulk-chain/issues/37)
π₯ API support
π₯ Optional Batching support with backport to existed models
Main Changes
- β οΈ Non-framework based Native Batching Support [non-caching mode] 9
- π§ Optional Caching / No Caching for API. 43
- Simplified API usage with schema
- π§ Check that added arguments were not mentioned before 47
π§ Bugs fixed
- π§ Prompt limiting should not be a part of inference modes 48
- π₯ Optional prompt logging 28
- csv and tsv separation 29
- β¨ Default target path -- implement replace extention function 30
- π§ BaseLM -- remove naming 31
- Setup LLM adapter via JSON schema 38
- Bash script inference: --output may cause exception in the case when the file type is not SQLite 34
- π delimiter parameter that is not related to model does not supported by OpenAI. 40
- args.limit is expected to be outside of the iter_content call 45
- π₯ π data[c] records and duplicated call on parameters update. [DEBUGING] 42
- π Cache target should not be None for cached inference 50
- π API: no need for name parameter in schema 51
- Make source-iter as an optional package 53
Minor changes
- π₯Switch FlanT5 to Replicate API by default 52
**Full Changelog**: https://github.com/nicolay-r/bulk-chain/compare/0.24.2...0.25.0