Pebblo



Key Highlights

* Dedicated `Safe Retriever` Local UI page for Visualization of AI apps using `PebbloRetrievalChain`
* Visualize top users using LLM inference, including their `authorization groups`
* Visualize top documents retrieved from Vector DB to facilitate data governance and compliance
* Kubernetes deployment of pebblo server docker image
* Updated samples with upstreamed `langchain-google` pkg for authorization enabled `GoogleDriveLoader`
* Extended metadata support for `GoogleDriveLoader` - document paths, names, and sizes
* Initial Pebblo support for LlamaIndex
* Topic and Entity name enhancements in pebblo-schema


What's Changed
* Log and print statement were not working in topic classfiier by gr8nishan in https://github.com/daxa-ai/pebblo/pull/309
* Changes for showing pebblo server and client version on DAXA UI. by dristysrivastava in https://github.com/daxa-ai/pebblo/pull/319
* Entity Classifier Fix by shreyas-damle in https://github.com/daxa-ai/pebblo/pull/325
* Removed text capitalize on file name in local UI by rutujaac in https://github.com/daxa-ai/pebblo/pull/327
* Updating entities and Topics names from human readable format to programming format by dristysrivastava in https://github.com/daxa-ai/pebblo/pull/306
* Added keyword to string mapping in reports and ui by rutujaac in https://github.com/daxa-ai/pebblo/pull/326
* Example for Llama PebbloSafeReader by yograjopcito in https://github.com/daxa-ai/pebblo/pull/313
* Docker repo fix by siddheshwar-more in https://github.com/daxa-ai/pebblo/pull/328
* Use GoogleDriveLoader from langchain_google_community by Raj725 in https://github.com/daxa-ai/pebblo/pull/337
* Added make command to format all/changed files by Raj725 in https://github.com/daxa-ai/pebblo/pull/340
* Update rag.md for pebblo environment variable by rahul-trip in https://github.com/daxa-ai/pebblo/pull/348
* Update Identity and Semantic enforcement samples (PebbloRetrievalQA) by Raj725 in https://github.com/daxa-ai/pebblo/pull/335
* Docs and version updates by srics in https://github.com/daxa-ai/pebblo/pull/357
* Remove spell check in CI lint pipeline by srics in https://github.com/daxa-ai/pebblo/pull/367
* Unit test trigger on tests by siddheshwar-more in https://github.com/daxa-ai/pebblo/pull/366
* Pebblo k8s deployment by siddheshwar-more in https://github.com/daxa-ai/pebblo/pull/362
* Topic classifier fixes - Normal text in findings, Lint errors by Raj725 in https://github.com/daxa-ai/pebblo/pull/370
* Pebblo redirection and download report URL fix by rutujaac in https://github.com/daxa-ai/pebblo/pull/354
* Pebblo Safe Retriever details in Local UI by shreyas-damle in https://github.com/daxa-ai/pebblo/pull/353
* Adding python dateutil package by dristysrivastava in https://github.com/daxa-ai/pebblo/pull/374
* Fix Local UI issues by rutujaac in https://github.com/daxa-ai/pebblo/pull/375
* Update samples: Import PebbloRetrievalQA from langchain_community by Raj725 in https://github.com/daxa-ai/pebblo/pull/364
* Capitalize app names for local UI by rutujaac in https://github.com/daxa-ai/pebblo/pull/376
* source_aggr_size renamed to source_aggregate_size in loader/doc API. by shreyas-damle in https://github.com/daxa-ai/pebblo/pull/378
* Add sort by date recent for active users and docs by rutujaac in https://github.com/daxa-ai/pebblo/pull/377

New Contributors
* gr8nishan made their first contribution in https://github.com/daxa-ai/pebblo/pull/309
* yograjopcito made their first contribution in https://github.com/daxa-ai/pebblo/pull/313

**Full Changelog**: https://github.com/daxa-ai/pebblo/compare/v0.1.14...v0.1.15

<p align="center">
<img src="https://github.com/daxa-ai/pebblo/assets/1734012/3c314f58-379e-4a83-9c10-b319015ad6fe" width=450>
</p>

Key highlights

* [Local UI / Reporting] Display authorized identities in ingested documents
* [Local UI / Reporting] Display RAG document snippet authorized identities
* Bubble chart of top semantic topics ingested into Vector DB
* Add support for Pebblo Cloud API - to display Gen-AI apps in Daxa UI
* Docker support for pebblo-server installation and deployment
* Add SafeRetriever sample with Identity and Semantic Topic enforcement

What's Changed
* Add Pebblo SafeLoader and SafeRetriever by srics in https://github.com/daxa-ai/pebblo/pull/273
* MyPy Config Changes by siddheshwar-more in https://github.com/daxa-ai/pebblo/pull/274
* Update SafeLoader and SafeRetriever by srics in https://github.com/daxa-ai/pebblo/pull/276
* Fix spelling errors by rutujaac in https://github.com/daxa-ai/pebblo/pull/284
* Pebblo Docs - Add different reports examples in Config tab by rutujaac in https://github.com/daxa-ai/pebblo/pull/283
* Add timezone to local UI dates by rutujaac in https://github.com/daxa-ai/pebblo/pull/287
* Updated Snippet tab in Pebblo UI by rutujaac in https://github.com/daxa-ai/pebblo/pull/270
* Add UT for reports module by rutujaac in https://github.com/daxa-ai/pebblo/pull/258
* Pebblo identity rag demo by Raj725 in https://github.com/daxa-ai/pebblo/pull/290
* Added Pebblo Cloud Sample App by shreyas-damle in https://github.com/daxa-ai/pebblo/pull/292
* Added Empty state for Reports by rutujaac in https://github.com/daxa-ai/pebblo/pull/285
* Pebblo UI - Handle null states for objects by rutujaac in https://github.com/daxa-ai/pebblo/pull/294
* Added readme and requirements file for pebblo cloud sample by shreyas-damle in https://github.com/daxa-ai/pebblo/pull/295
* Update download url for pip install by siddheshwar-more in https://github.com/daxa-ai/pebblo/pull/298
* Added changes for Docker image by siddheshwar-more in https://github.com/daxa-ai/pebblo/pull/277
* Pebblo Docker README and Installation guide changes by siddheshwar-more in https://github.com/daxa-ai/pebblo/pull/299
* Loader doc response changes for Pebblo Cloud initial work by shreyas-damle in https://github.com/daxa-ai/pebblo/pull/297
* Docker config pebblo by siddheshwar-more in https://github.com/daxa-ai/pebblo/pull/301
* Pebblo install using *.whl file download by siddheshwar-more in https://github.com/daxa-ai/pebblo/pull/300
* Allow CORS by dristysrivastava in https://github.com/daxa-ai/pebblo/pull/302
* Adding pebblo client as well as server version for local UI and reports by dristysrivastava in https://github.com/daxa-ai/pebblo/pull/303
* Added pebblo version on reports and local UI by rutujaac in https://github.com/daxa-ai/pebblo/pull/304
* Added bubble chart for findings by rutujaac in https://github.com/daxa-ai/pebblo/pull/305
* Fixed breaking Local UI by shreyas-damle in https://github.com/daxa-ai/pebblo/pull/310
* Fixed bubble chart render by rutujaac in https://github.com/daxa-ai/pebblo/pull/311
* Add samples for retrieval with Identity & Semantic Enforcement by Raj725 in https://github.com/daxa-ai/pebblo/pull/307
* Authorized Identity - backend changes to show authorized identities by shreyas-damle in https://github.com/daxa-ai/pebblo/pull/308
* Identity UI added for local ui and reports by rutujaac in https://github.com/daxa-ai/pebblo/pull/312
* Update bubble chart UI by rutujaac in https://github.com/daxa-ai/pebblo/pull/317
* Updated Pebblo client version UI by rutujaac in https://github.com/daxa-ai/pebblo/pull/316
* Upversion to 0.1.14 by srics in https://github.com/daxa-ai/pebblo/pull/321
* Update Tooltip UI and truncate long file names in table in Local UI by rutujaac in https://github.com/daxa-ai/pebblo/pull/320
* Docker: Update logging level to Info by siddheshwar-more in https://github.com/daxa-ai/pebblo/pull/314
* Update bubble chart height to be dynamic by rutujaac in https://github.com/daxa-ai/pebblo/pull/322
* Fix: single finding in bubble chart by rutujaac in https://github.com/daxa-ai/pebblo/pull/324


**Full Changelog**: https://github.com/daxa-ai/pebblo/compare/v0.1.13...v0.1.14

* Updating config value anonymizeAllEntities to anonymizeSnippets by dristysrivastava in https://github.com/daxa-ai/pebblo/pull/269
* Remove pango dependency by shreyas-damle in https://github.com/daxa-ai/pebblo/pull/271
* Update README - remove reference to pango by srics in https://github.com/daxa-ai/pebblo/pull/272


**Full Changelog**: https://github.com/daxa-ai/pebblo/compare/v0.1.12...v0.1.13

Key highlights

* New Local-UI to browse the reports at `http//localhost:8000/pebblo`
* Enhanced Entity Classifier with context matching for improved accuracy
* PDF Report generation using xhtml2pdf (removes `pango` dependency)
* Documentation updates



What's Changed
* Update Pebblo diagrams by srics in https://github.com/daxa-ai/pebblo/pull/182
* Resolve ruff lint errors by shreyas-damle in https://github.com/daxa-ai/pebblo/pull/171
* Config Documentation for Pebblo by KunalJadhav5 in https://github.com/daxa-ai/pebblo/pull/166
* Update load history template by rutujaac in https://github.com/daxa-ai/pebblo/pull/174
* Changes for mypy ruff linting by siddheshwar-more in https://github.com/daxa-ai/pebblo/pull/190
* Added details for Load History section in report. by shreyas-damle in https://github.com/daxa-ai/pebblo/pull/181
* Adding documentation for Pebblo Topic and Entity Classifier by rohiniNN in https://github.com/daxa-ai/pebblo/pull/186
* Update xhtml2pdf report template by rutujaac in https://github.com/daxa-ai/pebblo/pull/188
* Rename files to documents in weasyprintTemplate.html by rutujaac in https://github.com/daxa-ai/pebblo/pull/193
* Changing Pebblo Daemon to Pebblo server and fixing previous PR bug by rohiniNN in https://github.com/daxa-ai/pebblo/pull/197
* fixing report link in document pages by rohiniNN in https://github.com/daxa-ai/pebblo/pull/201
* Added config documentation in sidebar. by KunalJadhav5 in https://github.com/daxa-ai/pebblo/pull/198
* Pebblo Docs - Remove unused md files by rutujaac in https://github.com/daxa-ai/pebblo/pull/194
* Pebblo CI tests by siddheshwar-more in https://github.com/daxa-ai/pebblo/pull/202
* [Entity Classifier] Enhance Entity Classifier using words context (Presidio) by dristysrivastava in https://github.com/daxa-ai/pebblo/pull/204
* Updating scores for entity classifier for context matching by dristysrivastava in https://github.com/daxa-ai/pebblo/pull/210
* Update field in xhtml2pdf template for findings by rutujaac in https://github.com/daxa-ai/pebblo/pull/211
* Feature local UI by shreyas-damle in https://github.com/daxa-ai/pebblo/pull/222
* Fixed swapped findings entities and findings topics counts. by shreyas-damle in https://github.com/daxa-ai/pebblo/pull/238
* [Fix] data source label value fixed by KumarNitin19 in https://github.com/daxa-ai/pebblo/pull/239
* [Fix] local ui app details page snippet count fixed by KumarNitin19 in https://github.com/daxa-ai/pebblo/pull/240
* [Fix] search fixed for table local ui by KumarNitin19 in https://github.com/daxa-ai/pebblo/pull/241
* Upversion to 0.1.12 by srics in https://github.com/daxa-ai/pebblo/pull/246

New Contributors
* rohiniNN made their first contribution in https://github.com/daxa-ai/pebblo/pull/186

**Full Changelog**: https://github.com/daxa-ai/pebblo/compare/v0.1.11...v0.1.12

New features

* Revert "Pebblo config.yaml support" by Raj725 in https://github.com/daxa-ai/pebblo/pull/117
* Update Pebblo Docs to Docusaurus v3 by rutujaac in https://github.com/daxa-ai/pebblo/pull/118
* Fixing entity classifier initialization issue. by shreyas-damle in https://github.com/daxa-ai/pebblo/pull/116

New Contributors
* KunalJadhav5 made their first contribution in https://github.com/daxa-ai/pebblo/pull/108

**Full Changelog**: https://github.com/daxa-ai/pebblo/compare/v0.1.9...v0.1.10