Langchain-chatchat

------

新增功能

* 所有配置项改成 yaml 配置文件，改为命令行执行 chatchat init 初始化项目配置，需要本地文件中修改配置，配置项修改后即时生效，无需重启项目 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/4421
* chatchat init 可以直接指定 Xinference API 地址、LLM 模型、Embedding 模型，一步完成知识库初始 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/4425
* 新增 RAG 对话页面，包含知识库对话、文件对话、搜索引擎对话 by liunux4odoo imClumsyPanda in https://github.com/chatchat-space/Langchain-Chatchat/pull/4471
* 调整对话界面按钮布局，对话输入框左右分别设置"模型配置"与"清空对话"按钮 by imClumsyPanda liunux4odoo
* 支持 searx 搜索引擎 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/4476
* 支持 GLM-4V、Qwen-VL 等 Vision 模型接入进行图片对话 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/4421
* 使用 Xinference 接入本地模型时，支持自动检测已启动模型，无需手动填写模型名称 by imClumsyPanda liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/4421
* Agent 可调用工具中增加了维基百科搜索、高德地图天气查询、高德地图POI搜索 by yhfgyyf in https://github.com/chatchat-space/Langchain-Chatchat/pull/4419
* Agent 工具新增 text2promql by yuehua-s in https://github.com/chatchat-space/Langchain-Chatchat/pull/4399
* 增加 dockerfile 并更新 README 中关于 docker 部署的操作介绍 by yuehua-s in https://github.com/chatchat-space/Langchain-Chatchat/pull/4271 and https://github.com/chatchat-space/Langchain-Chatchat/pull/4274
* 新增 Agent 添加工具操作说明 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/4484
* 新增数据库对话配置说明 by srszzw in https://github.com/chatchat-space/Langchain-Chatchat/pull/4475
* 添加 Agent & Chat API 接口调用的说明，修正知识库检索bug by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/4341
* 增加知识库初始化时对 Ctrl+C 中止操作的支持 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/4352
* 增加 Pypi 发布自动化操作 by glide-the in https://github.com/chatchat-space/Langchain-Chatchat/pull/4260
* 增加不同系统部署环境测试 by glide-the in https://github.com/chatchat-space/Langchain-Chatchat/pull/4480


问题修复
* 在 readme 中增加对 windows 下创建知识库卡住的说明与解决办法 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/4330
* 统一搜索引擎与本地知识库返回格式，修改 WEBUI 渲染上下文方式 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/4344
* 修复文生图工具 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/4349
* 修复 Milvus 作为知识库时可能发生的错误 by kwunhang in https://github.com/chatchat-space/Langchain-Chatchat/pull/4319
* 修复 max_tokens 问题 by yuehua-s in https://github.com/chatchat-space/Langchain-Chatchat/pull/4355
* 修改api文档中手动输入工具参数的说明 by srszzw in https://github.com/chatchat-space/Langchain-Chatchat/pull/4367
* 解决text2sql对GLM的兼容，即temperature不能设置为0 by srszzw in https://github.com/chatchat-space/Langchain-Chatchat/pull/4370
* 解决es数据库删除时只能删除50条数据的BUG by YangSuoze in https://github.com/chatchat-space/Langchain-Chatchat/pull/4351
* 解决天气、text2Sql Agent 运行报错的BUG by 21Janur in https://github.com/chatchat-space/Langchain-Chatchat/pull/4336
* 修复知识库对话中的bug by srszzw in https://github.com/chatchat-space/Langchain-Chatchat/pull/4468
* fix: action model initialize error by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/4347

New Contributors
* kwunhang made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/4319
* YangSuoze made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/4351
* 21Janur made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/4336

**Full Changelog**: https://github.com/chatchat-space/Langchain-Chatchat/compare/v0.3.0...v0.3.1

新增功能
- 优化 PDF 文件的 OCR，过滤无意义的小图片 by liunux4odoo 2525
- 支持 Gemini 在线模型 by yhfgyyf 2630
- 支持 GLM4 在线模型 by zRzRzRzRzRzRzR
- elasticsearch更新https连接 by xldistance 2390
- 增强对PPT、DOC知识库文件的OCR识别 by 596192804 2013
- 更新 Agent 对话功能 by zRzRzRzRzRzRzR
- 每次创建对象时从连接池获取连接，避免每次执行方法时都新建连接 by Lijia0 2480
- 实现 ChatOpenAI 判断token有没有超过模型的context上下文长度 by glide-the
- 更新运行数据库报错和项目里程碑 by zRzRzRzRzRzRzR 2659
- 更新配置文件/文档/依赖 by imClumsyPanda zRzRzRzRzRzRzR
- 添加日文版 readme by eltociear 2787

问题修复
- ApiRequest.agent_chat 返回 dict 而非 str by liunux4odoo 2520
- 修复milvus_kwargs问题 by hzg0601 2540
- 纠正 make_text_splitter 中 chunk_* parameters 参数的使用 by liunux4odoo 2564
- 过滤 sse_starlette 返回的 ping 包，避免 JSON Decoder error : ping -... by liunux4odoo 2585
- langchain 更新后，PGVector 向量库连接错误 by HALIndex 2591
- 删除重复的引入和纠正拼写错误 by tiandiweizun 2599
- Minimax's model worker 错误 by xyhshen
- ES库无法向量检索.添加mappings创建向量索引 by MSZheng20 2688
- KBService 中几处拼写错误 by hzg0601 2640
- pytorch 自动检测设备 by chatgpt-1, Drincann, zRzRzRzRzRzRzR 2514 2570

新晋贡献者
* Drincann made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/2514
* chatgpt-1 made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/2570
* tiandiweizun made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/2599


**Full Changelog**: https://github.com/chatchat-space/Langchain-Chatchat/compare/v0.2.9...v0.2.10

本次更新中依赖 Python 包与其版本发生了**大量更新**，请使用`pip install -r requirements.txt`进行更新。

此外，v0.2.9 版本中知识库相关信息的数据库表发生了变化，如果继续使用之前版本的配置，可使用 ` python init_database.py --create-tables` 仅更新数据库表，不重建知识库。

本次更新中依赖 Python 包与其版本发生了**大量更新**，请使用`pip install -r requirements.txt`进行更新。

新增功能
* 文件对话和知识库对话 API 接口实现全异步操作，防止阻塞 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2256
* 更新默认模型下载链接 by YQisme in https://github.com/chatchat-space/Langchain-Chatchat/pull/2259
* OCR 支持 GPU 加速（需要手动安装 rapidocr_paddle[gpu])；知识库支持 MHTML 和 Evernote 文件。 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2265
* 使用Reranker模型对召回语句进行重排 by hzg0601 in https://github.com/chatchat-space/Langchain-Chatchat/pull/2435
* 知识库管理界面支持查看、编辑、删除向量库文档 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2471

问题修复
* 修改 duckduckgo 依赖错误 by zRzRzRzRzRzRzR hzg0601 in https://github.com/chatchat-space/Langchain-Chatchat/pull/2251 and https://github.com/chatchat-space/Langchain-Chatchat/pull/2252
* 修复Azure 不设置Max token的bug by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/2254
* fix: prompt template name error in file_chat by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2366
* 优化EventSource回包 by lookou in https://github.com/chatchat-space/Langchain-Chatchat/pull/1200
* fix: 文档错误 by jaluik in https://github.com/chatchat-space/Langchain-Chatchat/pull/2384
* 更新 self.dims_length 赋值错误 by xldistance in https://github.com/chatchat-space/Langchain-Chatchat/pull/2380
* 修复knowledge_base_chat_iterator 传参错误 by xldistance in https://github.com/chatchat-space/Langchain-Chatchat/pull/2386
* fixed 迭代器参数传递错误，知识库问答报错TypeError: unhashable type: 'list' by Astlvk in https://github.com/chatchat-space/Langchain-Chatchat/pull/2383
* fix:使用在线embedding模型时 报错 There is no current event loop in thread 'Any… by Funkeke in https://github.com/chatchat-space/Langchain-Chatchat/pull/2393
* fix Yi-34b model config error(close 2491) by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2492
* remove /chat/fastchat API endpoint by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2506

新晋贡献者
* YQisme made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/2259
* lookou made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/1200
* jaluik made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/2384
* xldistance made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/2380
* Astlvk made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/2383
* Funkeke made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/2393

**Full Changelog**: https://github.com/chatchat-space/Langchain-Chatchat/compare/v0.2.8...v0.2.9

此外，v0.2.8 版本中知识库相关信息的数据库表发生了变化，且默认 embedding 模型修改为`bge-large-zh`，如保持默认设置，请按需重建知识库。如果继续使用之前版本的配置，可使用 ` python init_database.py --create-tables` 仅更新数据库表，不重建知识库。

本次更新中依赖 Python 包与其版本发生了**大量更新**，请使用`pip install -r requirements.txt`进行更新。

新增功能
* 添加文件对话模式 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2071
* 知识库支持 .jsonl, .epub, .xlsx, .xlsd, .ipynb, .odt, .py, .srt, .toml, .doc, .ppt 文件 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2079
* 支持昆仑万维天工大模型 by nathubs in https://github.com/chatchat-space/Langchain-Chatchat/pull/2166
* 完善对 ChatGLM3-6B 的支持 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/2021 and https://github.com/chatchat-space/Langchain-Chatchat/pull/2058
* 增加聊天记录在数据库中的存储 by qiankunli in https://github.com/chatchat-space/Langchain-Chatchat/pull/2046
* 完善 WebUI 模型列表中对在线模型和本地模型的支持 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2060
* 支持软连接的知识库 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/2167
* 给 ApiModelWorker 添加 logger 成员变量，API请求出错时输出有意义的错误信息。 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2169
* 提供文档 summary_chunk ，支持单文件总结业务实现使用 MapReduceDocumentsChain 生成摘要 by glide-the in https://github.com/chatchat-space/Langchain-Chatchat/pull/2175
* 单个知识库根据 doc_ids 摘要 by glide-the in https://github.com/chatchat-space/Langchain-Chatchat/pull/2176
* 添加自定义命令用于管理多会话 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2229
* 优化知识库文档加载 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2091
* 统一在线模型异常报文、增加详细日志 by glide-the in https://github.com/chatchat-space/Langchain-Chatchat/pull/2130
* 更新 ChatGLM3-6B agent的文档，提示词 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/2041
* 更新 requirements by liunux4odoo hzg0601 zRzRzRzRzRzRzR imClumsyPanda in https://github.com/chatchat-space/Langchain-Chatchat/pull/2033 , https://github.com/chatchat-space/Langchain-Chatchat/pull/2170 , https://github.com/chatchat-space/Langchain-Chatchat/pull/2213 and https://github.com/chatchat-space/Langchain-Chatchat/pull/2246
* 更新 README.md by VignetteApril weartist in https://github.com/chatchat-space/Langchain-Chatchat/pull/2034 and https://github.com/chatchat-space/Langchain-Chatchat/pull/2049
* 更新 config 模版 by hzg0601 zRzRzRzRzRzRzR imClumsyPanda in https://github.com/chatchat-space/Langchain-Chatchat/pull/2110 and https://github.com/chatchat-space/Langchain-Chatchat/pull/2171
* 数据库和向量库中文档 metadata["source"] 改为相对路径，便于向量库迁移 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2153

问题修复
* 修复：知识库json文件的中文被转为 unicode 码，导致无法匹配 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2128
* 将 MiniMax 和 千帆 在线 Embedding 改为 10 个文本一批，防止接口数量限制 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2161
* 修复 startup.py by hzg0601 in https://github.com/chatchat-space/Langchain-Chatchat/pull/2162 and https://github.com/chatchat-space/Langchain-Chatchat/pull/2173
* bug 修复和提示词修改 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/2230
* 一些细节更新 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/2235
* 修复: MiniMax 和千帆在线 embedding 模型分批请求的 bug by alanlaye617 in https://github.com/chatchat-space/Langchain-Chatchat/pull/2208
* 修复: chat 接口默认使用 memory 获取 10 条历史消息，导致最终拼接的 prompt 出错 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2247

新晋贡献者
* VignetteApril made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/2034
* weartist made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/2049
* nathubs made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/2166
* alanlaye617 made their first contribution in https://github.com/chatchat-space/Langchain-Chatchat/pull/2208

**Full Changelog**: https://github.com/chatchat-space/Langchain-Chatchat/compare/v0.2.7...v0.2.8

本次更新中依赖 Python 包与其版本发生了更新，请使用 pip install -r requirements.txt 进行更新。

新增功能
* 发布 `0.2.7` 版本 Docker 镜像 by inksong
* 发布 `0.2.7` 版本 AutoDL 镜像 by glide-the
* 支持通过配置项同时启动多个模型，将 Wiki 内容纳入 samples 知识库 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/2002
* 支持 ChatGLM3-6B、AgentLM 模型 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1896 and https://github.com/chatchat-space/Langchain-Chatchat/pull/1821
* Azure 的 fastchat 支持，弃用 Langchain-MODEL by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1873
* 支持Lite模式：无需安装torch等重依赖，通过在线API实现对话和知识库功能（请注意token消耗） by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/1860
* 支持在线 Embeddings：zhipu-api, qwen-api, minimax-api, qianfan-api by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/1907
* 新增支持在 Embedding 模型 tokenizer 中增加关键词 by charlesyju in https://github.com/chatchat-space/Langchain-Chatchat/pull/1622
* 增加基于 Elasticsearch 进行向量匹配 by TommyTang930 hzg0601 in https://github.com/chatchat-space/Langchain-Chatchat/pull/1473/ and https://github.com/chatchat-space/Langchain-Chatchat/pull/2011
* 在使用 32k 模型时，加长了历史记录 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1629
* 实现 API 和 WebUI 的前后端分离 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/1772
* 支持 metaphor 搜索引擎（无需代理，key申请简单，目前不支持中文） by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/1792
* 支持加载 p-tuning，详细步骤见 `docs/chatchat加载ptuing.md` by hzg0601 in https://github.com/chatchat-space/Langchain-Chatchat/pull/1810
* 根据系统自动指定 binding_host by hzg0601 in https://github.com/chatchat-space/Langchain-Chatchat/pull/1810
* 增加一些 Langchain 的 Agent 工具 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1836
* 增加 completion 功能的 API 接口，注意暂不支持 online_api 模型 by qiankunli in https://github.com/chatchat-space/Langchain-Chatchat/pull/1828
* 优化在线 API ，支持 completion 和 embedding，简化在线 API 开发方式 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/1886
* 知识库支持子目录（不包括 temp 和 tmp 开头的目录），文件相对路径总长度不可超过255 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/1928
* init_database.py 增加 --import-db 参数，支持在版本升级时尽可能重用向量库 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/1951
* 支持在数据库中保存对话记录 by qiankunli in https://github.com/chatchat-space/Langchain-Chatchat/pull/1940
* 更新依赖和配置文件中的Agent模型 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1984
* 配置文件中新增 SUPPORT_AGENT_MODEL 用于设置可用 agent 模型列表，不在列表中的模型运行时会进行警告和特殊处理 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1891
* 优化知识库和Agent的返回 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1891
* 新增 CSV 文件按照指定列读入的方式 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1891



问题修复
* Chat API 中参数 `max_tokens` 默认值改为 1024 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/1744
* 修复了若干 typo bug by hzg0601 in https://github.com/chatchat-space/Langchain-Chatchat/pull/2011
* 更新上 agent 提示词代码 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1626
* 修改部分错误的文档 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1629
* 修复 Windows 下。bind_host 设为 0.0.0.0 时，将 fschat_xx_address 指向 127.0.0.1，避免请求错误 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/1651
* Agent 大更新合并 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1666
* Agent 提示词更改，增加图片 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1667
* Wiki 完善和 Agent 完善计划 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1680
* 修复切换 Embedding model 时，FAISS 向量库未正确释放，导致`d == self.d assert error` 的bug by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/1766
* 更新 langchain、fastchat 依赖, 修复 max_tokens 限制，修复历史消息错误 by liunux4odoo in https://github.com/chatchat-space/Langchain-Chatchat/pull/1801
* 修复了 migrate 兼容性错误，python 3.8 正常使用 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1837
* 修改了部分 Agent Prompt 修改了一些适配问题 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1839
* Zilliz 修复 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1874
* 修复科大讯飞 token 问题和 Azure 的 token 问题 by zRzRzRzRzRzRzR in https://github.com/chatchat-space/Langchain-Chatchat/pull/1894
* 修复 dev 分支创建知识库必然失败的 bug by WilliamChen-luckbob in https://github.com/chatchat-space/Langchain-Chatchat/pull/1980


新晋贡献者
* charlesyju 在 https://github.com/chatchat-space/Langchain-Chatchat/pull/1622 中完成首次贡献
* TommyTang930 在 https://github.com/chatchat-space/Langchain-Chatchat/pull/1473/ 中完成首次贡献

**Full Changelog**: https://github.com/chatchat-space/Langchain-Chatchat/compare/v0.2.6...v0.2.7