> ## Documentation Index
> Fetch the complete documentation index at: https://docs.baserun.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Human evaluators

<Frame>
  <img src="https://mintcdn.com/baserun/sfThaUjl8v9XCswy/images/human-evaluation.gif?s=6369c9e4699c9fff355dc913460fecac" alt="Human evaluation" width="1220" height="720" data-path="images/human-evaluation.gif" />
</Frame>

One major challenge in building products to automate more complex, nuanced tasks is that defining “good” and “bad” performance becomes a major bottleneck. While you may be able to define a few examples of “bad” behavior (e.g. AVs should try and avoid collisions, customer service chatbots should not reference stale information, medical chatbots should not misdiagnose patients), most of the interactions users will have with the system will be much more subjective.

Human evaluation enable AI teams to define their own evaluation criteria and collect feedback from human annotators.

Human evaluator has 3 types:

* **Boolean**: True or False result.
* **Number**: 1-5 scale.
* **Enum**: Multiple options.

### Create a new evaluator

<Steps>
  <Step title="Navigate to the Evaluators tab and click on the 'New evaluator' button">
    You will be prompted to select an evaluator type. Select the Human
    Evaluator.

    <Frame>
      <img src="https://mintcdn.com/baserun/sfThaUjl8v9XCswy/images/evaluation-list.png?fit=max&auto=format&n=sfThaUjl8v9XCswy&q=85&s=137a9785c11d32f9f827091db9cdf8a4" alt="New evaluator" width="2880" height="1800" data-path="images/evaluation-list.png" />
    </Frame>
  </Step>

  <Step title="Name the evaluator and select the evaluator type">
    <Frame>
      <img src="https://mintcdn.com/baserun/sfThaUjl8v9XCswy/images/evaluation-new-evaluator-model.png?fit=max&auto=format&n=sfThaUjl8v9XCswy&q=85&s=9f8b3ae28864a7072d95611e64e322cf" alt="Evaluation type" width="2880" height="1800" data-path="images/evaluation-new-evaluator-model.png" />
    </Frame>
  </Step>

  <Step title="Click on the 'Create' button" />

  <Frame>
    <img src="https://mintcdn.com/baserun/sfThaUjl8v9XCswy/images/evaluation-new-evaluator.png?fit=max&auto=format&n=sfThaUjl8v9XCswy&q=85&s=dbceabde8ed529a79e64073df8fdf872" alt="Evaluation type" width="2880" height="1800" data-path="images/evaluation-new-evaluator.png" />
  </Frame>
</Steps>

### Apply a evaluator

Navigate to a trace or a LLM request, click on the "Evaluate" button on the top right. Fill the form and click on the "Submit" button.

### View evaluation results

Now you can see the result inside the monitoring tabs and you can aggregate the results by the evaluation result.
