Griptape

Fixed

- `ToolkitTask`'s user subtask prompt occasionally causing the Task to end prematurely.

Fixed

- `ToolkitTask`'s user subtask prompt occasionally causing a loop with Chain of Thought.

Security

- Updated stale dependencies [CVE-2023-50447, CVE-2024-22195, and CVE-2023-36464]

Fixed

- Action Subtasks incorrectly outputting the Task input after failing to follow the ReAct prompt.

Added

- `PromptImageGenerationEngine` for generating images from text prompts.

- `VariationImageGenerationEngine` for generating variations of an input image according to a text prompt.

- `InpaintingImageGenerationEngine` for modifying an input image according to a text prompt within the bounds of a mask defined by a mask image.

- `OutpaintingImageGenerationEngine` for modifying an input image according to a text prompt outside the bounds of a mask defined by a mask image.

- `PromptImageGenerationClient` for enabling an LLM to use the `PromptImageGenerationEngine`.

- `VariationImageGenerationClient` for enabling an LLM to use the `VariationImageGenerationEngine`.

- `InpaintingImageGenerationClient` for enabling an LLM to use the `InpaintingImageGenerationEngine`.

- `OutpaintingImageGenerationClient` for enabling an LLM to use the `OutpaintingImageGenerationEngine`.

- `OpenAiImageGenerationDriver` for use with OpenAI's image generation models.

- `LeonardoImageGenerationDriver` for use with Leonoaro AI's image generation models.

- `AmazonBedrockImageGenerationDriver` for use with Amazon Bedrock's image generation models; requires a Image Generation Model Driver.

- `BedrockTitanImageGenerationModelDriver` for use with Amazon Bedrock's Titan image generation.

- `ImageArtifact` for storing image data; used heavily by the image Engines, Tasks, and Drivers.

- `ImageLoader` for loading images files into `ImageArtifact`s.

- Support for all Tokenizers in `OpenAiChatPromptDriver`, enabling OpenAI drop-in clients such as Together AI.

- `AmazonSageMakerJumpstartEmbeddingDriver` for using Amazon SageMaker to generate embeddings. Thanks KaushikIyer16!

- Claude 2.1 support in `AnthropicPromptDriver` and `AmazonBedrockPromptDriver` via `BedrockClaudePromptModelDriver`.

- `CodeExecutionTask` for executing code as a Task without the need for an LLM.

- `BedrockLlamaPromptModelDriver` for using Llama models on Amazon Bedrock.

Fixed

- `MongoDbAtlasVectorStore` namespace not being used properly when querying.
- Miscellaneous type errors throughout the codebase.
- Remove unused section from `ToolTask` system prompt template.
- Structure execution args being cleared after run, preventing inspection of the Structure's `input_task`'s `input`.
- Unhandled `SqlClient` exception. Thanks michal-repo!

Changed

- **BREAKING**: Rename `input_template` field to `input` in Tasks that take a text input.
- **BREAKING**: Rename `BedrockTitanEmbeddingDriver` to `AmazonBedrockTitanEmbeddingDriver`.
- **BREAKING**: Rename `AmazonBedrockStableDiffusionImageGenerationModelDriver` to `BedrockStableDiffusionImageGenerationModelDriver`.
- **BREAKING**: Rename `AmazonBedrockTitanImageGenerationModelDriver` to `BedrockTitanImageGenerationModelDriver`.
- **BREAKING**: Rename `ImageGenerationTask` to `PromptImageGenerationTask`.
- **BREAKING**: Rename `ImageGenerationEngine` to `PromptImageGenerationEngine`.
- **BREAKING**: Rename `ImageGenerationTool` to `PromptImageGenerationClient`.
- Improve system prompt generation with Claude 2.0.
- Improve integration test coverage.
- `BaseTextInputTask` to accept a `str`, `TextArtifact` or callable returning a `TextArtifact`.