Two recorded runs of Sybqa’s own engine against Trailhead Supply, a store that exists only for demos. The first finds the checkout bug planted in it. The second runs the same plan against the fixed copy. Every state, summary and screenshot below is copied from the run, not written for this page.
A recorded Sybqa run on a fictional store with one planted checkout bug: the checkout journey failed at desktop and 320 px widths and the order confirmation stage was not reached. Synthetic data, AI review off.
The same goal, plan, browser and screen sizes on the fixed copy of the fictional demo store: the checkout journey passed at both widths and the order confirmation appeared. Synthetic data, AI review off.
Buy a product and check out · narrow: Passed
Buy a product and check out · desktop: Passed
281 checks and 9 run notes recorded
How to read the results
Each check ends in one of the first five states, and only Passed counts as passed. Dropped describes an AI flag and Recheck required describes a fix; neither is a check result.
Evidence statesScroll sideways for more columns.
State
What it means
Passed
The check ran in a real browser and the expected result was observed. Only passed checks count as passed.
Failed
A real browser tried the check and it broke: the expected result was not observed. The report keeps the route, screen size and evidence.
Blocked
The check could not run, for example because access or a test fixture was unavailable, so no browser conclusion was recorded. Blocked never means passed.
Needs review
A possible problem for a person to judge. It stays open and is not counted as passed.
Not run
The check was skipped because of scope, time or a missing prerequisite. Not run never means passed.
Dropped
An AI flag that a browser measurement contradicted, or that a second review step rated unlikely. It is listed so you can see what was checked, and it is never counted.
Recheck required
A fix was proposed, but no matching assertion and captured evidence have confirmed it yet. A fix is never resolved by declaration.
What these examples are not
Not a customer result: Trailhead Supply is fictional and served by Sybqa for demos.
Not an accuracy or speed claim: one planted bug on one store says nothing about how often Sybqa finds bugs elsewhere.
Not AI review: both runs had AI review off.
Not a console run: the recordings used WebKit at 1280 and 320 px. Runs started from the console use Chromium at 1440, 390 and 320 px, so browser-specific checks such as slow-network throttling and page timing metrics can differ.
Run it yourself
The console can plan a check of the same demo store, or of a site you own or may test. Add your link here; it waits in the console after you create an account. The free plan gives 10 runs a month without AI review. Nothing runs until you review the plan.