Bulk-chain

Changeset


Fixed bugs
* 🔥 🐛 ask in batching mode results in multiple calls for ask / LLM inference 73
* 🐛Shell script: attempts arg may cause a bug 57
* Fix bug with reading arg with no param 72

Changeset


Demo support
> **NOTE:** Demo supports streaming!
bash
python3 -m bulk_chain.demo \
--schema "test/schema/thor_cot_schema.json" \
--adapter "dynamic:replicate_104.py:Replicate" \
%%m \
--model_name "meta/meta-llama-3-70b-instruct" \
--api_token "<REPLICATE-API-TOKEN>" \
--stream


Fixed bugs
🐛 Batching mode -- Using Qwen2 provider results in list output. 58
🔥 Shell: use separated demo.sh 70
✨ Add test dataset for benchmarking 📊 59
🐋 Set DeepSeek-R1 by default hosted by Replicate 62
Repository organization
Use wget for fetching content from nlp-thirdgate.
❌ Drop replicate.py provider in this repository and use the one from nlp-thirdgate 60
🐛 Batching mode -- Using Qwen2 provider results in list output. 58


**Full Changelog**: https://github.com/nicolay-r/bulk-chain/compare/0.25.0...0.25.1

Changeset


:blue_book: [What's new in 0.25.0](https://github.com/nicolay-r/bulk-chain/issues/37)

🔥 API support
🔥 Optional Batching support with backport to existed models
Main Changes
- ⚠️ Non-framework based Native Batching Support [non-caching mode] 9
- 🔧 Optional Caching / No Caching for API. 43
- Simplified API usage with schema
- 🔧 Check that added arguments were not mentioned before 47
🔧 Bugs fixed
- 🔧 Prompt limiting should not be a part of inference modes 48
- 🔥 Optional prompt logging 28
- csv and tsv separation 29
- ✨ Default target path -- implement replace extention function 30
- 🔧 BaseLM -- remove naming 31
- Setup LLM adapter via JSON schema 38
- Bash script inference: --output may cause exception in the case when the file type is not SQLite 34
- 🐛 delimiter parameter that is not related to model does not supported by OpenAI. 40
- args.limit is expected to be outside of the iter_content call 45
- 🔥 🐛 data[c] records and duplicated call on parameters update. [DEBUGING] 42
- 🐛 Cache target should not be None for cached inference 50
- 🐛 API: no need for name parameter in schema 51
- Make source-iter as an optional package 53
Minor changes
- 🔥Switch FlanT5 to Replicate API by default 52


**Full Changelog**: https://github.com/nicolay-r/bulk-chain/compare/0.24.2...0.25.0


:blue_book: The complete list of implemeted issues: 33

* [32 Adapt readers from `source_iter` project](https://github.com/nicolay-r/bulk-chain/issues/32)
* [35 Support re-attempting inference after any raised exception during inference](https://github.com/nicolay-r/bulk-chain/issues/35)
* `chat_with_llm` logger initializes only when we launch the chat mode.

**Full Changelog**: https://github.com/nicolay-r/bulk-chain/compare/0.24.1...0.24.2


This release represent bug fixes from the version 0.24.0

**Details:** https://github.com/nicolay-r/bulk-chain/issues/26

**Full Changelog**: https://github.com/nicolay-r/bulk-chain/compare/0.24.0...0.24.1

See more details: 8