- Adds a remote embeddings server for sentence transformer embeds, using grpc for remote procedure calls, allowing running langroid and generating local embeddings on different machines; currently, this functionality is not handled by tools such as ollama and litellm.
- If possible, uses data parallelism for local embeds; adds configurable batch sizes for all embeddings.
- Additionally, improves imports for parsing and vector stores.