Fed-rag

Post

- Test Zenodo

Added

- [Feature] Add utils.data module for building RAG Fine-tuning datasets given a RAGSystem and Sequence of examples (98)
- [Feature] Adds BaseTokenizer and HFPretrainedTokenizer subclass (99)
- [Feature] Enable BaseGenerator and BaseRetriever used in RAGSystem to access the rag system (95)

Changed

- Small fixes to problems found while running the quick start example (93)

Other

- Update LICENSE (92)

Added

- [Feature] Added HFPeftModelGenerator for efficient fine-tuning (84)
- [Feature] Added HuggingFace's peft.PeftModel as an acceptable model type for decoration (76)
- Added vector compute submodule (70)
- [Example] Added RA-DIT implementation using HFPeftModelGenerator for llama-2-7b (86)
- [Example] Added mock generator training loop; federated for a 350M model (67)

Changed

- [Example] RA-DIT default generator model to load with device map auto (88)
- [Example] RA-DIT re-factor example for better organization (87)
- [Feature] Updated set_weights and get_weights for HuggingFaceFlowerClient to include logic for PeftModel (82)
- Re-organized RA-DIT example app (69)

Added

- [EXAMPLE] Adds RA-DIT retriever train loop using HuggingFace integrations (64)
- Added HuggingFaceFLTask for federated learning with HuggingFace models (61)
- Added federate.tester.huggingface and associated inspectors (59)
- Added federate.trainer.huggingface decorators (56)
- Added ability to specify device on load for HF Models (55)

Added

- Build RAG system implementation (50)
- Added RAGSystem class (45)
- Implemented InMemoryKnowledgeStore (43)
- Added BaseKnowledgeStore and KnowledgeNode models (41)
- Added HFSentenceTransformerRetriever (38)
- Added BaseRetriever class (35)
- Added HFPreTrainedGenerator class for generative models (34)
- Implemented BaseGenerator and HFPretrainedModelGenerator classes (33)
- Added support for llama3 models (30)
- Added example Retrieval-Augmented Generation with LLM integration (28)
- Implemented DragonRetriever for example RAG system (26)

Changed

- Updated to use HFSentenceTransformerRetriever in examples (48)

Changed

- Quickstart as a workspace member, smaller package builds (24)

Added

- Working QuickStart! (20)
- Implementation PyTorchFLTask.server() (17)
- PyTorchFLTask and PyTorchFlowerClient (16)
- Inspection of tester callable for pytorch.tester decorator (14)
- federate.trainer.pytorch decorate inspects trainer loop to extract spec (12)
- BaseTaskModel and PyTorchTaskModel (5)