Added:
- Qwen 2 VL 2B / 7B vision models support
- WIP llama-cpp-cffi server - compatible with llama.cpp cli options instead of OpenAI
Changed:
- `llama.cpp` revision `5896c65232c7dc87d78426956b16f63fbf58dcf6`
- Refactored `Options` class into two separate classes: `ModelOptions`, `CompletionsOptions`
Fixed:
- Llava (moondream2, nanoLLaVA-1.5, llava-v1.6-mistral-7b) vision models support
- MiniCPM-V 2.5 / 2.6 vision models support
Removed:
- Removed ambiguous `Options` class