Prompt playground
Overview
Iterating, evaluating, and versioning prompts as a team.
Use cases
- Management: Create a source of truth for all the prompts in your application;
- Iterate prompts with version controls: Iterating and evaluating prompt templates, never lose a good prompt.
- Collaboration: Jam on prompts together with your team, share templates and good practices, and streamline your workflow.
Key features
- Version controls
- Copy prompt with inputs from Monitoring
- OpenAI Tool calls
- Chat mode
- Compare prompt versions
- Bulk testing & evaluation in UI (Coming soon)
Instruction
You can navigate to the Prompt Playground through the left sidebar. By default, you can see all the prompts created by all users in the shared workspaces, sorted by date. You can toggle between grid and list views or search for and filter prompts by name or user.
Creating a playground session
1
Click the 'New Session' button at the top right, or duplicate an existing session.
2
Enter the session name
Then, you will be redirected to the edit view.The left side is the editor panel, where you can edit the prompts. On the right side is the test panel, where you can create multiple test cases to test the prompt. Baserun will automatically save all session versions and tests. You can access past versions through the “Version History” button on the top right and restore any previous versions.
3
Select the model you want to use
Baserun support OpenAI, Anthropic, Llama, and Gemini by default.You can also add custom models by clicking the “Add custom model” button.
4
Optional to insert dynamic input variables into your prompt template using curly brackets {{ and }}.
You will use these variables to track LLM requests inputs, conduct evaluations, and compile datasets for future fine-tuning.
5
Start testing
Type a user and press ‘Enter’ or click the ‘Run’ button to submit.
6
Rerun a thread
You can edit a previous message in a thread. Clicking ‘Rerun’ will create a new thread, allowing you to preserve the history of your previous conversation.
Version management
Baserun automatically creates a new version of the session as you edit the prompt template and run tests. A new version is created when you click “Run Tests.” You can view a previous version by clicking on a past version inside the version history panel; all past versions are read-only. To restore an earlier version, hover over the version name, open the dropdown menu, and click the “Restore” button. This action will duplicate the past version and add it to the top.