Pipecat-ai

Added

- Allow stopping pipeline tasks with new `StopTaskFrame`.

Changed

- TTS, STT and image generation service now use `AsyncGenerator`.

Fixed

- `DailyTransport`: allow registering for participant transcriptions even if
input transport is not initialized yet.

Other

- Updated `storytelling-chatbot`.

Added

- Added Intel GPU support to `MoondreamService`.

- Added support for sending transport messages (e.g. to communicate with an app
at the other end of the transport).

- Added `FrameProcessor.push_error()` to easily send an `ErrorFrame` upstream.

Fixed

- Fixed Azure services (TTS and image generation).

Other

- Updated `simple-chatbot`, `moondream-chatbot` and `translation-chatbot`
examples.

Changed

Many things have changed in this version. Many of the main ideas such as frames,
processors, services and transports are still there but some things have changed
a bit.

- `Frame`s describe the basic units for processing. For example, text, image or
audio frames. Or control frames to indicate a user has started or stopped
speaking.

- `FrameProcessor`s process frames (e.g. they convert a `TextFrame` to an
`ImageRawFrame`) and push new frames downstream or upstream to their linked
peers.

- `FrameProcessor`s can be linked together. The easiest wait is to use the
`Pipeline` which is a container for processors. Linking processors allow
frames to travel upstream or downstream easily.

- `Transport`s are a way to send or receive frames. There can be local
transports (e.g. local audio or native apps), network transports
(e.g. websocket) or service transports (e.g. https://daily.co).

- `Pipeline`s are just a processor container for other processors.

- A `PipelineTask` know how to run a pipeline.

- A `PipelineRunner` can run one or more tasks and it is also used, for example,
to capture Ctrl-C from the user.

Added

- Added `FireworksLLMService`.

- Added `InterimTranscriptionFrame` and enable interim results in
`DailyTransport` transcriptions.

Changed

- `FalImageGenService` now uses new `fal_client` package.

Fixed

- `FalImageGenService`: use `asyncio.to_thread` to not block main loop when
generating images.

- Allow `TranscriptionFrame` after an end frame (transcriptions can be delayed
and received after `UserStoppedSpeakingFrame`).

Added

- Add `use_cpu` argument to `MoondreamService`.

Added

- Added `FalImageGenService.InputParams`.

- Added `URLImageFrame` and `UserImageFrame`.

- Added `UserImageRequestFrame` and allow requesting an image from a participant.

- Added base `VisionService` and `MoondreamService`

Changed

- Don't pass `image_size` to `ImageGenService`, images should have their own size.

- `ImageFrame` now receives a tuple`(width,height)` to specify the size.

- `on_first_other_participant_joined` now gets a participant argument.

Fixed

- Check if camera, speaker and microphone are enabled before writing to them.

Performance

- `DailyTransport` only subscribe to desired participant video track.