Onprem

new:
- Support for using self-ask prompt strategy with RAG (120)
- Improved table understanding when invoking `LLm.ask`. (124)
- helpers for document metadata (121)

changed
- Added `k` and `score_threshold` arguments to `LLM.ask` (122)
- Added `n_proc` paramter to control the number of CPUs used
by `LLM.ingest` (ee09807)
- Upgrade version of `chromadb` (125)

fixed:
- Ensure table-processing is sequential and not parallelized (123)
- Fixes to support newer version of `langchain_community`. (125)

new:
- Added `HFClassifier` to `pipelines.classifier` module (119)
- Added `SKClassifier` to `pipelines.classifier` module (118)
- `sk` "helper" module to fit simple scikit-learn text models (117)

changed
- Added `process_documents` function (117)

fixed:
- Pass `autodetect_encoding` argument to `TextLoader` (116)

new:
- N/A

changed
- N/A

fixed:
- Fix for HF chat template issue (113/114)

new:
- Support for structured outputs (110)
- Support for table extraction (106, 107)
- Facilitate identifying tables extracted as HTML (112)

changed
- Remove dependnency on deprecated RetrievalQA (108)
- Refactored code base (109)
- Use new JSON-safe formatting of prompt templates (109)

fixed:
- Added `utils.format_string` function to help format template strings
with embedded JSON (105)
- support stop strings with transformers (111)

new:
- N/A

changed
- Changed `pdf_use_unstructured` to `pdf_unstructured` and
`pdf2md` to `pdf_markdown` (102)

fixed:
- N/A

new:
- Improved PDF text extraction including optional markdown
conversion, table inference, and OCR (100)

changed
- N/A

fixed:
- Add support for HF training (98)
- Default to localhost in Web app (99)