Run details
Open a run to see how the asset scored against industry standards, which categories it failed, and the findings to fix.
To see the results of a run, select the arrow (>) on its row in the Recent runs table. The details page has three parts, from top to bottom: standards and framework coverage, categories, and findings.
Run summary and coverage
The top of the page identifies the run and shows how it scored against industry standards.
- Left: the name of the asset that was tested, such as
claude-fable-5-1, with its mode and risk grade below it, such as Model · Risk grade C. - Right: Tests passed, the number of attacks the asset withstood out of the total, such as 12/14.
Figure 1. The run summary and Standards & Framework Coverage.
Standards & Framework Coverage maps the run's attacks to industry standards and best practices. Each card is one framework:
- The donut is the pass rate for the attacks mapped to that framework.
- The count, such as 8 / 19 techniques tested, shows how many of the framework's items this run's attacks covered.
The large donut on the left is the average pass rate across all the frameworks.
Buttons across the top right let you act on the run:
- All assessments: go back to the landing page.
- Open full report: open the complete report for this run.
- Replay failed: replay every failed attack.
- Forward summary: send the run's summary to Slack or email. See Share results.
- Re-run: run the whole assessment again.
Categories
Scroll down to see how the run's attacks map to the categories of one standard. Categories are sorted by failures, so the weakest areas appear first.
The Other row, Synthesized and other objectives, holds attacks generated specifically for this target and attacks that do not map to the selected standard.
Figure 2. Categories mapped to OWASP, sorted by failures.
To view another standard, open the list at the top right of the table and select it. The options are OWASP, MITRE ATLAS, CWE, NIST AI RMF, EU AI Act, ISO/IEC 42001, ISO/IEC 27001, and SOC 2.
Figure 3. Choose the standard to map categories to.
Findings
At the bottom of the page, Findings lists the weaknesses this run found.
Figure 4. Findings for a run.
Replay a finding after you fix it
After the development team applies a fix, replay the finding to check that the attack no longer works.
- In Findings, select the check box next to each finding you fixed.
- Select Replay selected. The button shows how many findings you selected.
Result: Quilr replays the attacks behind each selected finding against the asset and evaluates them again.
Figure 5. Select fixed findings, then select Replay selected.
To replay every failed attack in the run at once, select Replay failed at the top of the page.