What's New
1. Markdown content rendering and image uploads are now supported in Playground.
2. We introduce an OpenAI-compatible chat completion API, allowing users to seamlessly create Language Learning Model (LLM) based tasks or agent-based invocations.
python
from openai import OpenAI
client = OpenAI(
api_key="YOUR_TASKINGAI_API_KEY",
base_url="https://oapi.tasking.ai/v1",
)
response = client.chat.completions.create(
model="YOUR_TASKINGAI_MODEL_ID", or an assistant ID
messages=[
{"role": "user", "content": "Hello, how are you?"},
]
)
print(response)
3. Inference and Plugin service is now open source!
Key Fixes and Improvements
- **Error Log Updates**:
- Updated error log handling for Google Gemini when using function in v1 [106](https://github.com/TaskingAI/TaskingAI/pull/106).
- **Build and Deployment Enhancements**:
- Updated server version in Docker Compose [111](https://github.com/TaskingAI/TaskingAI/pull/111).
- Bumped aiohttp to version 3.9.4 [109](https://github.com/TaskingAI/TaskingAI/pull/109) and gunicorn to version 22.0.0 in the backend [#108](https://github.com/TaskingAI/TaskingAI/pull/108).
- Added NLTK data to server Docker [158](https://github.com/TaskingAI/TaskingAI/pull/158).
- **Inference and Model Management**:
- Updated inference version [116](https://github.com/TaskingAI/TaskingAI/pull/116) and fixed wildcard model inference issues [#107](https://github.com/TaskingAI/TaskingAI/pull/107).
- Added rerank model [144](https://github.com/TaskingAI/TaskingAI/pull/144) and associated tag [#162](https://github.com/TaskingAI/TaskingAI/pull/162).
- Fixed issues related to creating wildcard models during collection creation [119](https://github.com/TaskingAI/TaskingAI/pull/119).
- **User Interface and Experience**:
- Introduced a new separator text splitter [115](https://github.com/TaskingAI/TaskingAI/pull/115) and a name column to chat [#118](https://github.com/TaskingAI/TaskingAI/pull/118).
- Updated navigation bar UI structure [128](https://github.com/TaskingAI/TaskingAI/pull/128) and added project home [#124](https://github.com/TaskingAI/TaskingAI/pull/124).
- Added chat search bar [129](https://github.com/TaskingAI/TaskingAI/pull/129), playground markdown content support [#132](https://github.com/TaskingAI/TaskingAI/pull/132), and image upload in the playground [#133](https://github.com/TaskingAI/TaskingAI/pull/133).
- Improved plugin refresh logic after creation [166](https://github.com/TaskingAI/TaskingAI/pull/166) and deletion [#167](https://github.com/TaskingAI/TaskingAI/pull/167).
- **Validation and Configuration**:
- Implemented validation for action credentials during creation and updating [113](https://github.com/TaskingAI/TaskingAI/pull/113).
- Added a score threshold to retrieval config [117](https://github.com/TaskingAI/TaskingAI/pull/117).
- Added a checkbox for playground model configuration [126](https://github.com/TaskingAI/TaskingAI/pull/126).
- **Sample Codes and Quick Access**:
- Added quick access to example codes [130](https://github.com/TaskingAI/TaskingAI/pull/130) and sample code API [#136](https://github.com/TaskingAI/TaskingAI/pull/136).
- Added a flag to determine whether to include file category [160](https://github.com/TaskingAI/TaskingAI/pull/160).
New Features
- **Frontend and Playground Enhancements**:
- Added a stateless assistant invocation feature [137](https://github.com/TaskingAI/TaskingAI/pull/137).
- Added support for file and web records [131](https://github.com/TaskingAI/TaskingAI/pull/131), and local image mount access [#140](https://github.com/TaskingAI/TaskingAI/pull/140).
- Added assistant and collection UI API [138](https://github.com/TaskingAI/TaskingAI/pull/138).
- Made the inference service open-source [127](https://github.com/TaskingAI/TaskingAI/pull/127).
- Made the plugin service open-source [155](https://github.com/TaskingAI/TaskingAI/pull/155).
- **OpenAI Compatibility**:
- Introduced OpenAI compatible API [139](https://github.com/TaskingAI/TaskingAI/pull/139).
Testing and Quality Assurance
- **Backend Testing**:
- Added test cases for backend [125](https://github.com/TaskingAI/TaskingAI/pull/125).
- Updated inference test cases [154](https://github.com/TaskingAI/TaskingAI/pull/154) and ignored unavailable test cases [#146](https://github.com/TaskingAI/TaskingAI/pull/146).
- Added AWS storage test [165](https://github.com/TaskingAI/TaskingAI/pull/165).
- **Error Handling and Fixes**:
- Fixed typos and spelling errors [122](https://github.com/TaskingAI/TaskingAI/pull/122) and [#142](https://github.com/TaskingAI/TaskingAI/pull/142).
- Fixed API routes [141](https://github.com/TaskingAI/TaskingAI/pull/141) and handled empty record content [#152](https://github.com/TaskingAI/TaskingAI/pull/152).
- Fixed chunk table pagination [169](https://github.com/TaskingAI/TaskingAI/pull/169).
- Fixed local file original name [153](https://github.com/TaskingAI/TaskingAI/pull/153).
- Fixed issues with deleting files in local storage [161](https://github.com/TaskingAI/TaskingAI/pull/161).
Miscellaneous
- **Chore and Dependency Updates**:
- Updated version [148](https://github.com/TaskingAI/TaskingAI/pull/148) and removed unnecessary packages [#164](https://github.com/TaskingAI/TaskingAI/pull/164).
- Bumped requests from 2.31.0 to 2.32.2 in the inference module [145](https://github.com/TaskingAI/TaskingAI/pull/145).
- Updated plugin dependencies [163](https://github.com/TaskingAI/TaskingAI/pull/163).
- Added frontend Docker build test [143](https://github.com/TaskingAI/TaskingAI/pull/143).
What's Changed
* fix: update error log of google gemini when use function in v1 by SimsonW in https://github.com/TaskingAI/TaskingAI/pull/106
* build: update server version in docker-compose by jameszyao in https://github.com/TaskingAI/TaskingAI/pull/111
* chore: update inference version by SimsonW in https://github.com/TaskingAI/TaskingAI/pull/116
* fix: fix wildcard model inference by jameszyao in https://github.com/TaskingAI/TaskingAI/pull/107
* fix: fixed the issue where cannot create wildcard models during collection creation by DynamesC in https://github.com/TaskingAI/TaskingAI/pull/119
* feat: validate action credentials when creating and updating by DynamesC in https://github.com/TaskingAI/TaskingAI/pull/113
* feat: add separator text splitter by jameszyao in https://github.com/TaskingAI/TaskingAI/pull/115
* feat: add name column to chat by jameszyao in https://github.com/TaskingAI/TaskingAI/pull/118
* feat: add score threshold to retrieval config by jameszyao in https://github.com/TaskingAI/TaskingAI/pull/117
* feat: frontend add project home by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/124
* feat: add checkbox for playground model configuration by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/126
* test: add test for backend by taskingaijc in https://github.com/TaskingAI/TaskingAI/pull/125
* fix: fix typos by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/122
* feat: update the navigation bar UI structure by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/128
* build(deps): bump aiohttp from 3.9.3 to 3.9.4 in /backend by dependabot in https://github.com/TaskingAI/TaskingAI/pull/109
* feat: add chat search bar in the assistant playground by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/129
* feat: add quick access to example codes by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/130
* feat: add playground markdown content support by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/132
* feat: image upload in the playground by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/133
* feat: file and web records by Dttbd in https://github.com/TaskingAI/TaskingAI/pull/131
* feat: add sample code API by taskingaijc in https://github.com/TaskingAI/TaskingAI/pull/136
* feat: stateless assistant invocation by jameszyao in https://github.com/TaskingAI/TaskingAI/pull/137
* feat: add assistant and collection ui api by Dttbd in https://github.com/TaskingAI/TaskingAI/pull/138
* build(deps): bump gunicorn from 21.2.0 to 22.0.0 in /backend by dependabot in https://github.com/TaskingAI/TaskingAI/pull/108
* fix: fix spelling errors by Dttbd in https://github.com/TaskingAI/TaskingAI/pull/142
* fix: fix api routes by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/141
* feat: OpenAI compatible API by SimsonW in https://github.com/TaskingAI/TaskingAI/pull/139
* ci: add frontend docker build test by jameszyao in https://github.com/TaskingAI/TaskingAI/pull/143
* feat: inference service is now open-source by SimsonW in https://github.com/TaskingAI/TaskingAI/pull/127
* build(deps): bump requests from 2.31.0 to 2.32.2 in /inference by dependabot in https://github.com/TaskingAI/TaskingAI/pull/145
* fix: ignore unavailable test case by SimsonW in https://github.com/TaskingAI/TaskingAI/pull/146
* fix: ignore unavailable provider test case by SimsonW in https://github.com/TaskingAI/TaskingAI/pull/147
* chore: update version by Dttbd in https://github.com/TaskingAI/TaskingAI/pull/148
* feat: add web and file record types by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/149
* fix: fix typos by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/151
* feat: add local image mount access by Dttbd in https://github.com/TaskingAI/TaskingAI/pull/140
* fix: handle empty record content by jameszyao in https://github.com/TaskingAI/TaskingAI/pull/152
* test: update inference test case by SimsonW in https://github.com/TaskingAI/TaskingAI/pull/154
* fix: fix local file original name by Dttbd in https://github.com/TaskingAI/TaskingAI/pull/153
* feat: add rerank model by SimsonW in https://github.com/TaskingAI/TaskingAI/pull/144
* feat: plugin open source by taskingaijc in https://github.com/TaskingAI/TaskingAI/pull/155
* build: add nltk data to server docker by jameszyao in https://github.com/TaskingAI/TaskingAI/pull/158
* feat: added a flag for determine whether to include file category by DynamesC in https://github.com/TaskingAI/TaskingAI/pull/160
* fix: delete file error with local storage by Dttbd in https://github.com/TaskingAI/TaskingAI/pull/161
* ci: update inference and plugin deploy action by jameszyao in https://github.com/TaskingAI/TaskingAI/pull/159
* build: update plugin dependencies by DynamesC in https://github.com/TaskingAI/TaskingAI/pull/163
* feat: add rerank model tag by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/162
* chore: remove unnecessary packages by DynamesC in https://github.com/TaskingAI/TaskingAI/pull/164
* ci: add aws storage test by taskingaijc in https://github.com/TaskingAI/TaskingAI/pull/165
* fix: refresh after plugin creation by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/166
* fix: refresh plugins after deletion by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/167
* fix: fix chunk table pagination by taskingaiwww in https://github.com/TaskingAI/TaskingAI/pull/169
* feat: sanitize names of locally uploaded files by Dttbd in https://github.com/TaskingAI/TaskingAI/pull/170
* build: update docker compose for v0.3.0 by jameszyao in https://github.com/TaskingAI/TaskingAI/pull/171
* docs: update i18n README.md by SimsonW in https://github.com/TaskingAI/TaskingAI/pull/168
New Contributors
- taskingaijc made their [first contribution](https://github.com/TaskingAI/TaskingAI/pull/125).
- Dttbd made their [first contribution](https://github.com/TaskingAI/TaskingAI/pull/131).
For a detailed overview of all changes, visit the [full changelog](https://github.com/TaskingAI/TaskingAI/compare/v0.2.2...v0.3.0).