Livekit-agents

Patch Changes

- Fix split_paragraphs and simple-rag example - [896](https://github.com/livekit/agents/pull/896) ([davidzhao](https://github.com/davidzhao))

- Fix bug where if the tts_source was a string but before_tts_cb returned AsyncIterable[str], the transcript would not be synthesized. - [906](https://github.com/livekit/agents/pull/906) ([martin-purplefish](https://github.com/martin-purplefish))

- Allow forcing interruptions of incomplete audio - [891](https://github.com/livekit/agents/pull/891) ([martin-purplefish](https://github.com/martin-purplefish))

- Include chat context on collected tool calls - [897](https://github.com/livekit/agents/pull/897) ([martin-purplefish](https://github.com/martin-purplefish))


livekit-plugins-openai0.10.3
Patch Changes

- fix: handle when STT does not return any speech - [854](https://github.com/livekit/agents/pull/854) ([davidzhao](https://github.com/davidzhao))

- Support for Realtime API with Azure OpenAI - [848](https://github.com/livekit/agents/pull/848) ([davidzhao](https://github.com/davidzhao))


livekit-plugins-llama-index0.1.1
Patch Changes

- livekit-plugins-llama-index - [696](https://github.com/livekit/agents/pull/696) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-deepgram0.6.8
Patch Changes

- accepts parameter profanity_filter - [811](https://github.com/livekit/agents/pull/811) ([jebjebs](https://github.com/jebjebs))

Patch Changes

- use rtc.combine_audio_frames - [841](https://github.com/livekit/agents/pull/841) ([theomonnom](https://github.com/theomonnom))

- Fix agent state to not change to listening when user speaks - [857](https://github.com/livekit/agents/pull/857) ([martin-purplefish](https://github.com/martin-purplefish))
Fixed canceling uncancelable speech
Fixed bug where agent would get stuck with uninterruptable speech.

- Fix bug where empty audio would cause agent to get stuck. - [836](https://github.com/livekit/agents/pull/836) ([martin-purplefish](https://github.com/martin-purplefish))

- fix: handle when STT does not return any speech - [854](https://github.com/livekit/agents/pull/854) ([davidzhao](https://github.com/davidzhao))

- Fix watcher reloaded processes double connecting to rooms - [822](https://github.com/livekit/agents/pull/822) ([keepingitneil](https://github.com/keepingitneil))

- voice-pipeline: avoid stacked replies when interruptions is disallowed - [869](https://github.com/livekit/agents/pull/869) ([theomonnom](https://github.com/theomonnom))

- disable preemptive_synthesis by default - [867](https://github.com/livekit/agents/pull/867) ([theomonnom](https://github.com/theomonnom))

- Fixed bug where agent would get stuck on non-interruptable speech - [850](https://github.com/livekit/agents/pull/850) ([martin-purplefish](https://github.com/martin-purplefish))

- use EventEmitter from rtc - [879](https://github.com/livekit/agents/pull/879) ([theomonnom](https://github.com/theomonnom))

- AudioByteStream: avoid empty frames on flush - [840](https://github.com/livekit/agents/pull/840) ([theomonnom](https://github.com/theomonnom))

- improve worker logs - [878](https://github.com/livekit/agents/pull/878) ([theomonnom](https://github.com/theomonnom))

- voice-pipeline: fix tts_forwarder not always being closed - [871](https://github.com/livekit/agents/pull/871) ([theomonnom](https://github.com/theomonnom))

- bump livekit-rtc to v0.17.5 - [880](https://github.com/livekit/agents/pull/880) ([theomonnom](https://github.com/theomonnom))

- Fixed bug where agent would freeze if before_llm_cb returned false - [865](https://github.com/livekit/agents/pull/865) ([martin-purplefish](https://github.com/martin-purplefish))


livekit-plugins-openai0.10.2
Patch Changes

- oai-realtime: fix function calls - [826](https://github.com/livekit/agents/pull/826) ([KillianLucas](https://github.com/KillianLucas))


livekit-plugins-silero0.7.1
Patch Changes

- Fix CI x LFS issue for silero plugin - [818](https://github.com/livekit/agents/pull/818) ([keepingitneil](https://github.com/keepingitneil))


livekit-plugins-silero0.7.0
Minor Changes

- silero: support any sample rate - [805](https://github.com/livekit/agents/pull/805) ([theomonnom](https://github.com/theomonnom))

Patch Changes

- silero: add prefix_padding_duration 801 - [805](https://github.com/livekit/agents/pull/805) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-openai0.10.1
Patch Changes

- oai-realtime: log response errors - [819](https://github.com/livekit/agents/pull/819) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-openai0.10.0
Minor Changes

- OpenAI Realtime API support - [814](https://github.com/livekit/agents/pull/814) ([theomonnom](https://github.com/theomonnom))

Patch Changes

- Add Telnyx integration for LLM - [803](https://github.com/livekit/agents/pull/803) ([jamestwhedbee](https://github.com/jamestwhedbee))

✨ [NEW] OpenAI Realtime API support

We're partnering with OpenAI on a new `MultimodalAgent` API in the Agents framework. This class completely wraps OpenAI’s Realtime API, abstract away the raw wire protocol, and provide an ultra-low latency WebRTC transport between GPT-4o and your users’ devices. This same stack powers Advanced Voice in the ChatGPT app.

- Try the Realtime API in our [playground](https://playground.livekit.io/) [[code](https://github.com/livekit-examples/realtime-playground)]
- Check out our [guide](https://docs.livekit.io/agents/openai) to building your first app with this new API

Patch Changes

- bump livekit to v0.17.2 - [815](https://github.com/livekit/agents/pull/815) ([theomonnom](https://github.com/theomonnom))

- silero: support any sample rate - [805](https://github.com/livekit/agents/pull/805) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-openai0.8.5
Patch Changes

- Fix function for OpenAI Assistants - [784](https://github.com/livekit/agents/pull/784) ([keepingitneil](https://github.com/keepingitneil))

Minor Changes

- rename voice_assistant.state to lk.agent.state - [772](https://github.com/livekit/agents/pull/772) ([bcherry](https://github.com/bcherry))

Patch Changes

- bump rtc - [782](https://github.com/livekit/agents/pull/782) ([nbsp](https://github.com/nbsp))

- improve graceful shutdown - [756](https://github.com/livekit/agents/pull/756) ([theomonnom](https://github.com/theomonnom))

- avoid returning tiny frames from TTS - [747](https://github.com/livekit/agents/pull/747) ([theomonnom](https://github.com/theomonnom))

- windows: default to threaded executor & fix dev mode - [755](https://github.com/livekit/agents/pull/755) ([theomonnom](https://github.com/theomonnom))

- 11labs: send phoneme in one entire xml chunk - [766](https://github.com/livekit/agents/pull/766) ([theomonnom](https://github.com/theomonnom))

- fix: process not starting if num_idle_processes is zero - [763](https://github.com/livekit/agents/pull/763) ([theomonnom](https://github.com/theomonnom))

- voiceassistant: avoid tiny frames on playout - [750](https://github.com/livekit/agents/pull/750) ([theomonnom](https://github.com/theomonnom))

- voiceassistant: expose turn_completion_delay - [752](https://github.com/livekit/agents/pull/752) ([theomonnom](https://github.com/theomonnom))

- limit concurrent process init to 1 - [751](https://github.com/livekit/agents/pull/751) ([theomonnom](https://github.com/theomonnom))

- Add typing-extensions as a dependency - [778](https://github.com/livekit/agents/pull/778) ([keepingitneil](https://github.com/keepingitneil))

- Allow setting LLM temperature with VoiceAssistant - [741](https://github.com/livekit/agents/pull/741) ([davidzhao](https://github.com/davidzhao))

- better dev defaults - [762](https://github.com/livekit/agents/pull/762) ([theomonnom](https://github.com/theomonnom))

- voiceassistant: allow to cancel llm generation inside before_llm_cb - [753](https://github.com/livekit/agents/pull/753) ([theomonnom](https://github.com/theomonnom))

- use os.exit to exit forcefully - [770](https://github.com/livekit/agents/pull/770) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-openai0.8.3
Patch Changes

- Introduce function calling to OpenAI Assistants - [710](https://github.com/livekit/agents/pull/710) ([keepingitneil](https://github.com/keepingitneil))

- Add Cerebras to OpenAI Plugin - [731](https://github.com/livekit/agents/pull/731) ([henrytwo](https://github.com/henrytwo))


livekit-plugins-deepgram0.6.7
Patch Changes

- Only send actual audio to Deepgram using a basic audio RMS filter - [738](https://github.com/livekit/agents/pull/738) ([keepingitneil](https://github.com/keepingitneil))

- defaults to nova-2-general model - [726](https://github.com/livekit/agents/pull/726) ([davidzhao](https://github.com/davidzhao))


livekit-plugins-cartesia0.4.2
Patch Changes

- Add support for cartesia voice control - [740](https://github.com/livekit/agents/pull/740) ([bcherry](https://github.com/bcherry))


livekit-plugins-anthropic0.2.1
Patch Changes

- Fixes to Anthropic Function Calling - [708](https://github.com/livekit/agents/pull/708) ([keepingitneil](https://github.com/keepingitneil))

Patch Changes

- tts_forwarder: don't raise inside mark_{audio,text}\_segment_end when nothing was pushed - [730](https://github.com/livekit/agents/pull/730) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-openai0.8.2
Patch Changes

- Add deepseek LLMs at OpenAI plugin - [714](https://github.com/livekit/agents/pull/714) ([lenage](https://github.com/lenage))

- skip processing of choice.delta when it is None - [705](https://github.com/livekit/agents/pull/705) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-google0.7.0
Minor Changes

- Enable use of Google STT with Application Default Credentials. - [721](https://github.com/livekit/agents/pull/721) ([rsinnet](https://github.com/rsinnet))

Patch Changes

- google-tts: ignore wav header - [703](https://github.com/livekit/agents/pull/703) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-elevenlabs0.7.4
Patch Changes

- elevenlabs: expose enable_ssml_parsing - [723](https://github.com/livekit/agents/pull/723) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-anthropic0.2.0
Minor Changes

- bump anthropic for release - [724](https://github.com/livekit/agents/pull/724) ([theomonnom](https://github.com/theomonnom))