Baserun helps AI teams build, monitor and iterate their LLM applications.

At a high level, the LLM application development lifecycle can be broken down into three phases: build, monitor, and improve. Each phase has its unique challenges, as shown in the following image:

LLM application development lifecycle

Baserun provides a suite of tools, accessible through both UI and SDK, for AI teams to collaborate throughout the product development cycle.

Here is the guide on how to navigate different features within Baserun:

TasksFeature name
Configure ModelPrompt Playground (UI)
Compare Prompt Feature (UI)
Monitoring > Log LLM requests (SDK + UI)
Prototype workflowMonitoring > Trace multi-step workflow (SDK + UI)
Monitor App PerformanceMonitoring > Log LLM requests (SDK + UI)
Monitor User ExperienceMonitoring Features (SDK + UI)
- Log LLM Requests
- Trace Multi-Step Workflow
- Users and User Sessions
- Collect User Feedback
Annotation > Checks (SDK + UI)
Debug workflowsMonitoring Features (SDK + UI)
- Log LLM Requests
- Trace Multi-Step Workflow
- Users and User Sessions
Create datasetsComing soon
Prompt EngineeringMonitoring > Trace multi-step workflow (SDK + UI)
Prompt playground (UI)
Compare prompt feature (UI)
Context Engineering (RAG)Coming soon
Fine-tuningComing soon
Workflow OptimizationMonitoring > Trace multi-step workflow (SDK + UI)

​
Getting Started

Prompt playground overview

Iterating, versioning, and testing prompts.

Logging LLM requests

Start logging your LLM requests with 2 lines of code changes.

Tracing End-to-end LLM Pipelines

Debugging and analyzing complex LLM pipelines.

Workspace