Skip to content

Test Guardrails

After adding and configuring the necessary scanners, you can verify that they adhere to the specified standards. Test the effectiveness of an individual scanner or a group of scanners and then tweak the scanner's settings if required.

Steps to test the Guardrails or Scanners:

  1. On the Guardrails page, click Test.
    Test Guardrails

  2. On the Test Guardrails page, in the Prompt input box, enter a prompt or select Input template to choose a template.
    Prompt to Test a Scanner

  3. Select Test. Under Scores and Results, review the following results:
    Guardrails Test Results

    • Validity: Indicates whether the prompt is valid based on the scanner's criteria. (For example, if Toxicity is not found in the prompt, the prompt is valid, and the Validity is set to True.)

    • Risk Score: Indicates the prompt's risk level, calculated using the scanner's threshold and score.

    • Duration: Displays the time taken by the scanner to process the prompt.

    Note

    • The Risk Score is calculated using the following formula: (Threshold - Scanner Score) / Threshold.

    • For the Relevance Scanner, if the similarity between the prompt and generated answer is below the user-defined threshold, the Risk Score is 1; otherwise, it's 0.

  4. Based on the results, you can adjust the Scanner's settings and test them again if required.