Skip to main content

Glossary

Terms used in Quilr Red Teaming and in these docs.

TermDefinition
AssessmentA configured test of one target: its mode, coverage, custom attacks, and schedule.
RunOne execution of an assessment. Runs are listed under Recent runs.
ModeThe kind of target being tested: AI App / Agent, AI Workflow, or Model.
ObjectiveOne attack goal, such as System Prompt Extraction. The attack library holds the built-in objectives.
Quick scanAbout 8 core objectives, for a fast check.
Full libraryEvery objective in the attack library.
Custom objectiveAn objective you write for your own target, reported under a Custom category.
SynthesizedAn objective generated for this specific target, often to test its tools.
FindingA weakness a run found, with severity, evidence, a recommended fix, and framework mappings.
Breached / Partial / Held / InconclusiveThe outcome of an attack. See Risk grade and severity.
Pass rateThe share of attacks the target withstood.
Risk grade and risk scoreA letter grade from A to F and a score out of 100 for a run. Lower risk is better.
Evaluation modeHow results are judged. Hybrid combines deterministic evidence with model judges; Deterministic uses evidence detectors only; Judge uses model judges only.
Judge consensusHow strongly the model judges agreed on a result.
Replay-safeA target where repeating an attack cannot cause a harmful or duplicate side effect. Confirmation replays run only on replay-safe targets.
ReplaySending a finding's attacks again, usually after a fix, to check whether it still works.
Authorized scopeThe record of what you are approved to test: the target, a ticket or reference, and the testing boundary.
DetectAutomatic discovery of how a target is reached and what request and response format it uses.
Via DirectThe attack technique that succeeded, shown on each finding in the Full report.