Livekit-agents

Patch Changes

- fix release - [1176](https://github.com/livekit/agents/pull/1176) ([theomonnom](https://github.com/theomonnom))

Minor Changes

- add nested speech handles, now agent.say works during a function call - [1130](https://github.com/livekit/agents/pull/1130) ([longcw](https://github.com/longcw))

Patch Changes

- feat: stt retry & stt.FallbackAdapter - [1114](https://github.com/livekit/agents/pull/1114) ([theomonnom](https://github.com/theomonnom))

- expose LiveKitAPI from the a JobContext - [1159](https://github.com/livekit/agents/pull/1159) ([theomonnom](https://github.com/theomonnom))

- add extra chat messages to the end of the function call outputs - [1165](https://github.com/livekit/agents/pull/1165) ([longcw](https://github.com/longcw))

- Add retries to recover from text mode to audio model for realtime API - [1121](https://github.com/livekit/agents/pull/1121) ([longcw](https://github.com/longcw))

- prepare for release - [1160](https://github.com/livekit/agents/pull/1160) ([theomonnom](https://github.com/theomonnom))

- add max_job_memory_usage and will kill the job if it exceeds the limit - [1136](https://github.com/livekit/agents/pull/1136) ([longcw](https://github.com/longcw))

- support for custom tool use in LLMs - [1102](https://github.com/livekit/agents/pull/1102) ([jayeshp19](https://github.com/jayeshp19))

- feat: tts retry & tts.FallbackAdapter - [1074](https://github.com/livekit/agents/pull/1074) ([theomonnom](https://github.com/theomonnom))

- Expose multimodal agent metrics - [1080](https://github.com/livekit/agents/pull/1080) ([longcw](https://github.com/longcw))

- preload mp3 decoder for TTS plugins - [1129](https://github.com/livekit/agents/pull/1129) ([jayeshp19](https://github.com/jayeshp19))

- feat: llm retry & llm.FallbackAdapter - [1132](https://github.com/livekit/agents/pull/1132) ([theomonnom](https://github.com/theomonnom))

- feat: inference process & end of utterance plugin - [1133](https://github.com/livekit/agents/pull/1133) ([theomonnom](https://github.com/theomonnom))

- vertex ai support with openai library - [1084](https://github.com/livekit/agents/pull/1084) ([jayeshp19](https://github.com/jayeshp19))


livekit-plugins-openai0.10.7
Patch Changes

- fix realtime API audio format values - [1092](https://github.com/livekit/agents/pull/1092) ([longcw](https://github.com/longcw))

- make ConversationItem.create and delete return a Future in Realtime model - [1085](https://github.com/livekit/agents/pull/1085) ([longcw](https://github.com/longcw))


livekit-plugins-fal0.2.0
Minor Changes

- initial version - [991](https://github.com/livekit/agents/pull/991) ([jayeshp19](https://github.com/jayeshp19))


livekit-plugins-deepgram0.6.11
Patch Changes

- add PeriodicCollector utility for metrics - [1094](https://github.com/livekit/agents/pull/1094) ([davidzhao](https://github.com/davidzhao))


livekit-plugins-deepgram0.6.10
Patch Changes

- fix Deepgram missing first word, disabled energy filter by default - [1090](https://github.com/livekit/agents/pull/1090) ([davidzhao](https://github.com/davidzhao))

Patch Changes

- add PeriodicCollector utility for metrics - [1094](https://github.com/livekit/agents/pull/1094) ([davidzhao](https://github.com/davidzhao))


livekit-plugins-openai0.10.6
Patch Changes

- Expose usage metrics for Realtime model - [1036](https://github.com/livekit/agents/pull/1036) ([yuyuma](https://github.com/yuyuma))

- sync the Realtime API converstation items and add set_chat_ctx - [1015](https://github.com/livekit/agents/pull/1015) ([longcw](https://github.com/longcw))


livekit-plugins-google0.7.3
Patch Changes

- added catch for aborted speech - [1055](https://github.com/livekit/agents/pull/1055) ([jayeshp19](https://github.com/jayeshp19))

- Make Google STT keywords match Deepgram - [1067](https://github.com/livekit/agents/pull/1067) ([martin-purplefish](https://github.com/martin-purplefish))

- Add support for boosting phrases in Google STT - [1066](https://github.com/livekit/agents/pull/1066) ([martin-purplefish](https://github.com/martin-purplefish))


livekit-plugins-azure0.4.2
Patch Changes

- add support for azure speech containers - [1043](https://github.com/livekit/agents/pull/1043) ([longcw](https://github.com/longcw))

- fix azure sample_rate parameter - [1072](https://github.com/livekit/agents/pull/1072) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-assemblyai0.1.0
Minor Changes

- Introduce assembly.ai plugin - [1082](https://github.com/livekit/agents/pull/1082) ([davidzhao](https://github.com/davidzhao))


livekit-plugins-anthropic0.2.4
Patch Changes

- anthropic tool fix - [1051](https://github.com/livekit/agents/pull/1051) ([jayeshp19](https://github.com/jayeshp19))

Patch Changes

- Fix interrupt_min_words handling - [1062](https://github.com/livekit/agents/pull/1062) ([davidzhao](https://github.com/davidzhao))

- pipelineagent: fix speech_committed never called - [1078](https://github.com/livekit/agents/pull/1078) ([theomonnom](https://github.com/theomonnom))

- Allow setting agent attributes when accepting job - [1076](https://github.com/livekit/agents/pull/1076) ([davidzhao](https://github.com/davidzhao))

- handles error in function calls - [1057](https://github.com/livekit/agents/pull/1057) ([jayeshp19](https://github.com/jayeshp19))

- Include job count in WorkerStatus and pass in worker for load_fnc - [1046](https://github.com/livekit/agents/pull/1046) ([keepingitneil](https://github.com/keepingitneil))

- Fix delay calculation - [1081](https://github.com/livekit/agents/pull/1081) ([martin-purplefish](https://github.com/martin-purplefish))

- sync the Realtime API converstation items and add set_chat_ctx - [1015](https://github.com/livekit/agents/pull/1015) ([longcw](https://github.com/longcw))

- added metrics for idle time - [1064](https://github.com/livekit/agents/pull/1064) ([jayeshp19](https://github.com/jayeshp19))


livekit-plugins-elevenlabs0.7.7
Patch Changes

- support language code in ElevenLabs TTS (985) - [1029](https://github.com/livekit/agents/pull/1029) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-anthropic0.2.3
Patch Changes

- fix: invalid request on anthropic - [1018](https://github.com/livekit/agents/pull/1018) ([theomonnom](https://github.com/theomonnom))

Patch Changes

- Fix stack dump on closed stream - [1023](https://github.com/livekit/agents/pull/1023) ([martin-purplefish](https://github.com/martin-purplefish))

- fix: invalid request on anthropic - [1018](https://github.com/livekit/agents/pull/1018) ([theomonnom](https://github.com/theomonnom))

- fix: IndexError on tts metrics - [1028](https://github.com/livekit/agents/pull/1028) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-silero0.7.3
Patch Changes

- pipelineagent: expose timing metrics & api errors wip - [957](https://github.com/livekit/agents/pull/957) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-playht1.0.1
Patch Changes

- pipelineagent: expose timing metrics & api errors wip - [957](https://github.com/livekit/agents/pull/957) ([theomonnom](https://github.com/theomonnom))

- expose usage metrics - [984](https://github.com/livekit/agents/pull/984) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-openai0.10.5
Patch Changes

- fix: Azure realtime model does not accept null for max_response_output_tokens - [927](https://github.com/livekit/agents/pull/927) ([davidzhao](https://github.com/davidzhao))

- add update_options to TTS - [922](https://github.com/livekit/agents/pull/922) ([theomonnom](https://github.com/theomonnom))

- Groq integration with Whisper-compatible STT endpoints - [986](https://github.com/livekit/agents/pull/986) ([jayeshp19](https://github.com/jayeshp19))

- pipelineagent: expose timing metrics & api errors wip - [957](https://github.com/livekit/agents/pull/957) ([theomonnom](https://github.com/theomonnom))

- openai: fix low timeouts - [926](https://github.com/livekit/agents/pull/926) ([theomonnom](https://github.com/theomonnom))

- expose usage metrics - [984](https://github.com/livekit/agents/pull/984) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-llama-index0.2.0
Minor Changes

- prepare for release - [1007](https://github.com/livekit/agents/pull/1007) ([theomonnom](https://github.com/theomonnom))

Patch Changes

- Publish llama-index plugin - [924](https://github.com/livekit/agents/pull/924) ([davidzhao](https://github.com/davidzhao))


livekit-plugins-google0.7.2
Patch Changes

- add update_options to TTS - [922](https://github.com/livekit/agents/pull/922) ([theomonnom](https://github.com/theomonnom))

- Additional options enabled on Google TTS - [945](https://github.com/livekit/agents/pull/945) ([hari-truviz](https://github.com/hari-truviz))

- pipelineagent: expose timing metrics & api errors wip - [957](https://github.com/livekit/agents/pull/957) ([theomonnom](https://github.com/theomonnom))

- expose usage metrics - [984](https://github.com/livekit/agents/pull/984) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-elevenlabs0.7.6
Patch Changes

- add update_options to TTS - [922](https://github.com/livekit/agents/pull/922) ([theomonnom](https://github.com/theomonnom))

- pipelineagent: expose timing metrics & api errors wip - [957](https://github.com/livekit/agents/pull/957) ([theomonnom](https://github.com/theomonnom))

- expose usage metrics - [984](https://github.com/livekit/agents/pull/984) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-deepgram0.6.9
Patch Changes

- stt: reduce bandwidth usage by reducing sample_rate to 16khz - [920](https://github.com/livekit/agents/pull/920) ([theomonnom](https://github.com/theomonnom))

- deepgram: send finalize each time we stop sending audio - [1004](https://github.com/livekit/agents/pull/1004) ([theomonnom](https://github.com/theomonnom))

- pipelineagent: expose timing metrics & api errors wip - [957](https://github.com/livekit/agents/pull/957) ([theomonnom](https://github.com/theomonnom))

- expose usage metrics - [984](https://github.com/livekit/agents/pull/984) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-cartesia0.4.3
Patch Changes

- add update_options to TTS - [922](https://github.com/livekit/agents/pull/922) ([theomonnom](https://github.com/theomonnom))

- pipelineagent: expose timing metrics & api errors wip - [957](https://github.com/livekit/agents/pull/957) ([theomonnom](https://github.com/theomonnom))

- expose usage metrics - [984](https://github.com/livekit/agents/pull/984) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-browser0.0.3
Patch Changes

- pipelineagent: expose timing metrics & api errors wip - [957](https://github.com/livekit/agents/pull/957) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-azure0.4.1
Patch Changes

- add update_options to TTS - [922](https://github.com/livekit/agents/pull/922) ([theomonnom](https://github.com/theomonnom))

- pipelineagent: expose timing metrics & api errors wip - [957](https://github.com/livekit/agents/pull/957) ([theomonnom](https://github.com/theomonnom))

- azure tts: fix SSML Implementation by Adding <voice> Tag - [929](https://github.com/livekit/agents/pull/929) ([samirsalman](https://github.com/samirsalman))

- azure tts: fix Prosody Config Validation - [918](https://github.com/livekit/agents/pull/918) ([samirsalman](https://github.com/samirsalman))

- expose usage metrics - [984](https://github.com/livekit/agents/pull/984) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-anthropic0.2.2
Patch Changes

- pipelineagent: expose timing metrics & api errors wip - [957](https://github.com/livekit/agents/pull/957) ([theomonnom](https://github.com/theomonnom))

Minor Changes

- prepare for release - [1007](https://github.com/livekit/agents/pull/1007) ([theomonnom](https://github.com/theomonnom))

Patch Changes

- Fix race in load calc initialization - [969](https://github.com/livekit/agents/pull/969) ([martin-purplefish](https://github.com/martin-purplefish))

- Fix incorrect load computation on docker instances - [972](https://github.com/livekit/agents/pull/972) ([martin-purplefish](https://github.com/martin-purplefish))

- stt: reduce bandwidth usage by reducing sample_rate to 16khz - [920](https://github.com/livekit/agents/pull/920) ([theomonnom](https://github.com/theomonnom))

- Reorganized metrics, added create_metrics_logger - [1009](https://github.com/livekit/agents/pull/1009) ([davidzhao](https://github.com/davidzhao))

- pipelineagent: expose timing metrics & api errors wip - [957](https://github.com/livekit/agents/pull/957) ([theomonnom](https://github.com/theomonnom))

- Allow kind to be list or single value - [1006](https://github.com/livekit/agents/pull/1006) ([keepingitneil](https://github.com/keepingitneil))

- fix before_llm_cb not handling coroutines returning False - [961](https://github.com/livekit/agents/pull/961) ([Tanesan](https://github.com/Tanesan))

- expose transcriptions for multimodal agents - [1001](https://github.com/livekit/agents/pull/1001) ([longcw](https://github.com/longcw))

- Fix stack dump on room shutdown - [989](https://github.com/livekit/agents/pull/989) ([martin-purplefish](https://github.com/martin-purplefish))

- Add exception logging for tool calls - [923](https://github.com/livekit/agents/pull/923) ([martin-purplefish](https://github.com/martin-purplefish))

- Skip egress by default in participant-related utilities on JobContext - [1005](https://github.com/livekit/agents/pull/1005) ([keepingitneil](https://github.com/keepingitneil))

- pipeline-agent: avoid nested function calls - [935](https://github.com/livekit/agents/pull/935) ([theomonnom](https://github.com/theomonnom))

- expose usage metrics - [984](https://github.com/livekit/agents/pull/984) ([theomonnom](https://github.com/theomonnom))

- fix jobs never reloading - [934](https://github.com/livekit/agents/pull/934) ([theomonnom](https://github.com/theomonnom))

- voicepipeline: support recursive/chained function calls - [970](https://github.com/livekit/agents/pull/970) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-silero0.7.2
Patch Changes

- silero: add update_options - [899](https://github.com/livekit/agents/pull/899) ([theomonnom](https://github.com/theomonnom))

- silero: fix speech_buffer for END_OF_SPEECH - [898](https://github.com/livekit/agents/pull/898) ([theomonnom](https://github.com/theomonnom))


livekit-plugins-openai0.10.4
Patch Changes

- add x.ai support - [907](https://github.com/livekit/agents/pull/907) ([theomonnom](https://github.com/theomonnom))

- Fix functions to include content - [897](https://github.com/livekit/agents/pull/897) ([martin-purplefish](https://github.com/martin-purplefish))


livekit-plugins-azure0.4.0
Minor Changes

- Azure TTS Prosody SSML support 912 - [914](https://github.com/livekit/agents/pull/914) ([theomonnom](https://github.com/theomonnom))