Skip to main content

Run details

Open a run to see how the asset scored against industry standards, which categories it failed, and the findings to fix.

To see the results of a run, select the arrow (>) on its row in the Recent runs table. The details page has three parts, from top to bottom: standards and framework coverage, categories, and findings.

Run summary and coverage​

The top of the page identifies the run and shows how it scored against industry standards.

  • Left: the name of the asset that was tested, such as claude-fable-5-1, with its mode and risk grade below it, such as Model · Risk grade C.
  • Right: Tests passed, the number of attacks the asset withstood out of the total, such as 12/14.

Figure 1. The run summary and Standards & Framework Coverage.

Standards & Framework Coverage maps the run's attacks to industry standards and best practices. Each card is one framework:

  • The donut is the pass rate for the attacks mapped to that framework.
  • The count, such as 8 / 19 techniques tested, shows how many of the framework's items this run's attacks covered.

The large donut on the left is the average pass rate across all the frameworks.

FrameworkCoversCounted in
MITRE ATLASAI threat techniquesTechniques
NIST AI RMFAI risk managementSubcategories
OWASPLLM and agentic application risksCategories
ISO/IEC 42001AI management systemsControls
EU AI ActRegulatory requirementsArticles
CIS Controls v8Critical security controlsSafeguards
ISO/IEC 27001Information securityControls
SOC 2Trust Services CriteriaCriteria

Buttons across the top right let you act on the run:

  • All assessments: go back to the landing page.
  • Open full report: open the complete report for this run.
  • Replay failed: replay every failed attack.
  • Forward summary: send the run's summary to Slack or email. See Share results.
  • Re-run: run the whole assessment again.

Categories​

Scroll down to see how the run's attacks map to the categories of one standard. Categories are sorted by failures, so the weakest areas appear first.

ColumnWhat it shows
CategoryThe category ID and name in the selected standard. For OWASP, LLM IDs come from the Top 10 for LLM Applications and ASI IDs from the Top 10 for Agentic Applications.
MappedHow many of the run's attacks map to this category.
PassAttacks the asset withstood.
FailAttacks that succeeded against the asset.
ReviewResults that need a person to review them.
Pass ratePass as a share of mapped attacks.

The Other row, Synthesized and other objectives, holds attacks generated specifically for this target and attacks that do not map to the selected standard.

Figure 2. Categories mapped to OWASP, sorted by failures.

To view another standard, open the list at the top right of the table and select it. The options are OWASP, MITRE ATLAS, CWE, NIST AI RMF, EU AI Act, ISO/IEC 42001, ISO/IEC 27001, and SOC 2.

Figure 3. Choose the standard to map categories to.

Findings​

At the bottom of the page, Findings lists the weaknesses this run found.

ColumnWhat it shows
FindingWhat the attack made the asset do, with its severity and category below it, such as Medium · LLM09. The colored bar on the left matches the severity.
AssetThe asset the attack ran against, and its mode.
StatusThe finding's status, such as Confirmed.
Suggested fixA recommended change to stop the attack, such as adding explicit scope constraints to the system prompt.

Figure 4. Findings for a run.

Replay a finding after you fix it​

After the development team applies a fix, replay the finding to check that the attack no longer works.

  1. In Findings, select the check box next to each finding you fixed.
  2. Select Replay selected. The button shows how many findings you selected.

Result: Quilr replays the attacks behind each selected finding against the asset and evaluates them again.

Figure 5. Select fixed findings, then select Replay selected.

tip

To replay every failed attack in the run at once, select Replay failed at the top of the page.