Changelog

​

Testing

• Added Mock Tool Use for testing longer interactions without executing actual tools.

​

Collaboration

• Added support for inviting project members for team collaboration.

​

Workbench

• Revamped Prompt Workbench interface with improved layout and streamlined workflow for prompt development.

​

Validation

• Add support for JSON Schema in structured prompt outputs for better validation and parsing.

​

Organization

• Add Projects feature to organize prompts into separate projects for better management.

​

Provider

• Add support for Google’s Gemini models.

​

Visualization

• Add LLM Prompt Architecture Diagram to visualize system architecture of LLM prompts.

​

Test

• Add support for computations in assertions (characher-count and similarity).

​

Visualization

• Added Confusion Matrix visualization

​

Provider

• Added support for custom LLM providers (ollama API)

​

Test

• Unified handling of tool-use in test cases

​

API

• /prompts → List all prompts
• /prompts/{slug} → Get prompt by slug
• See API Reference for full documentation

​

Prompt

• Export prompts in JSON format
• Version diff viewer

​

Test

• Display detailed LLM usage and cost breakdowns

​

Prompt

• Prompt builder with template and versioning

​

Tool

• Tool use definition support

​

Playground

• Interactive prompt testing in playground

​

Test

• Test case definition with assertion support
• Automated web test runner, with session history