Pensiev

✨ Features

- Enhanced screenshot functionality with larger display size
- Improved UI design
- Added gradient background
- Enhanced text rendering

🐛 Bug Fixes

- Fixed database migration issues from SQLite to PostgreSQL

This release focuses on enhancing the visual experience through larger screenshot displays and modernized interface design, while also addressing database migration concerns.

---

✨ 新功能

- 优化了截图功能，增大了截图显示尺寸
- 改进了 UI 设计
- 添加了渐变背景
- 优化了文本渲染效果

🐛 修复

- 修复了从 SQLite 迁移到 PostgreSQL 的问题

这个版本主要改进了用户界面的视觉体验，通过增大截图尺寸和优化背景设计使界面更加现代化，同时解决了数据库迁移方面的问题。

**Full Changelog**: https://github.com/arkohut/pensieve/compare/v0.25.2...v0.25.4

✨ Major Features

- Added comprehensive PostgreSQL database support as an alternative to SQLite
- Enhanced search capabilities with advanced indexing and filtering
- Improved Chinese language support with jieba tokenization
- Implemented caching and hashing for embedding generation

💻 Installation

For basic installation:
bash
pip install memos


For PostgreSQL support:
bash
pip install memos[postgresql]


📝 Detailed Changes

💾 Database Enhancements

- Added full PostgreSQL database support with migration tools
- Implemented SQLite to PostgreSQL database migration command
- Added persistent volume support for PostgreSQL data storage
- Enhanced database queries with sorting and eager loading optimizations
- Improved timestamp filtering for cross-database compatibility

🔍 Search Improvements

- Implemented advanced PostgreSQL full-text search with jieba tokenization
- Enhanced vector search capabilities with advanced indexing and filtering
- Optimized full-text search with improved prefix matching
- Added caching and hashing mechanisms for embedding generation

---

✨ 主要特性

- 新增了全面的 PostgreSQL 数据库支持，作为 SQLite 的替代方案
- 通过高级索引和过滤功能增强了搜索能力
- 使用 jieba 分词改进了中文语言支持
- 实现了嵌入生成的缓存和哈希机制

💻 安装

基本安装：
bash
pip install memos


支持 PostgreSQL 的安装：
bash
pip install memos[postgresql]


📝 详细变更

💾 数据库增强

- 新增了完整的 PostgreSQL 数据库支持，并提供了迁移工具
- 实现了 SQLite 到 PostgreSQL 数据库的迁移命令
- 新增了对 PostgreSQL 数据存储的持久卷支持
- 通过排序和预加载优化增强了数据库查询
- 改进了时间戳过滤功能，确保跨数据库兼容性

🔍 搜索改进

- 使用 jieba 分词实现了高级的 PostgreSQL 全文搜索
- 通过高级索引和过滤功能增强了向量搜索能力
- 优化了全文搜索的前缀匹配功能
- 新增了嵌入生成的缓存和哈希机制

🔍 搜索功能增强 (55, 57, 60)

- 引入类 Typesense 的 facet 搜索功能
- 优化混合搜索性能
- 移除自动搜索，优化防抖逻辑

📊 数据结构改进

- 支持 facet 功能
- 从标签系统迁移到应用名称的 facet 支持
- 为 embedding 表添加文件创建时间戳
- 优化实体索引

🛠 基础设施更新

- 引入 Alembic 进行数据库迁移管理
- 添加插件处理状态跟踪
- 增强 webhook 处理
- 集成 Logfire 日志系统
- 改进 SQLAlchemy 和 FastAPI 支持

💅 界面改进

- 新增加载状态骨架屏
- 修复搜索时按回车键重置选中应用名称的问题

🐛 问题修复

- 修复向量表重建相关问题
- 改进版本导入的容错处理
- 添加实体表安全索引创建

⚠️ 重要提示

升级后，必须执行 `memos reindex --force` 命令以重建新向量表结构的搜索索引

What's Changed

Pensieve dynamically adjusts the image processing interval based on the frequency of screenshot generation and the speed of processing individual images. In environments without NVIDIA GPUs, it may be challenging to ensure that image processing keeps up with the rate of screenshot generation. To address this, Pensieve processes images on a sampled basis.

To prevent excessive system load, Pensieve’s default sampling strategy is intentionally conservative. However, this conservative approach might limit the performance of devices with higher computational capacity. To provide more flexibility, additional control options have been introduced in `~/.memos/config.yaml`, allowing users to configure the system for either more conservative or more aggressive processing strategies.

yaml
watch:
number of recent events to consider when calculating processing rates
rate_window_size: 10
sparsity factor for file processing
a higher value means less frequent processing
1.0 means process every file, can not be less than 1.0
sparsity_factor: 3.0
initial processing interval for file processing, means process one file with plugins for every N files
but will be adjusted automatically based on the processing rate
1 means process the first file at the beginning
processing_interval: 12


If you want every screenshot file to be processed, you can configure the settings as follows:

yaml
A watch config like this means process every file with plugins at the beginning
but if the processing rate is slower than file generated, the processing interval
will be increased automatically
watch:
rate_window_size: 10
sparsity_factor: 1.0
processing_interval: 1


Remember to do `memos stop && memos start` to make the new config work.

* Refact processing rate by arkohut in https://github.com/arkohut/pensieve/pull/46
* fix(indexing): refetch full entity before indexing by arkohut in https://github.com/arkohut/pensieve/pull/47
* chore: improve SQLite extension loading error message by arkohut in https://github.com/arkohut/pensieve/pull/48
* chore: add pypi readme with absolute link by arkohut in https://github.com/arkohut/pensieve/pull/49


**Full Changelog**: https://github.com/arkohut/pensieve/compare/v0.23.1...v0.23.2

What's Changed

* BUG: The vlm token should be decoded. by xiyuan-lee in https://github.com/arkohut/pensieve/pull/39
* fix(ocr): the ocr token should be decoded by xiyuan-lee in https://github.com/arkohut/pensieve/pull/43

New Contributors

* xiyuan-lee made their first contribution in https://github.com/arkohut/pensieve/pull/39

**Full Changelog**: https://github.com/arkohut/pensieve/compare/v0.23.0...v0.23.1

What's Changed

* Update logs for the server plugins
* Bug fix for `scan` and `sync` command

**Full Changelog**: https://github.com/arkohut/pensieve/compare/v0.22.0...v0.23.0