Langport

Commits
- 2b28af1: support sentence transformer (jstzwj)
- 0028262: response error logging (jstzwj)
- 84b3e07: embedding worker batch limit (jstzwj)
- 56e7eb7: AsyncGenerator typing bug fix (jstzwj)
- f9b77f9: update requirements (jstzwj)

Commits
- 23e5db2: import chatproto (jstzwj)
- 0cb8486: remove torch deps (jstzwj)
- 746b878: remove accelerate deps (jstzwj)
- 197a672: update test cases (jstzwj)
- d81c8ba: update embed api (jstzwj)
- 3dd9b27: stop str bug fix (jstzwj)
- 101efc3: update qwen1.5 (jstzwj)
- 69f6e12: log invalid requests (jstzwj)
- 35c1fe5: update embedding api (jstzwj)

What's Changed
===
- llama stop str bug fix
- compression trust_remote_code bug fix
- system prompt bug fix
- topk and randomness bug fix

What's Changed
===
* Llama2 prompt quick fix
* Add prompt test cases

What's Changed
===
* Model mistral support
* Add pydantic version check

What's Changed
===
* GPTQ support
* Bump the versions of deps