Sybqa

Example runs · synthetic

Example runs on a fictional demo store

Two recorded runs of Sybqa’s own engine against Trailhead Supply, a store that exists only for demos. The first finds the checkout bug planted in it. The second runs the same plan against the fixed copy. Every state, summary and screenshot below is copied from the run, not written for this page.

On this page

The recorded runs

Example run: a planted checkout bug on a demo store

Issues found

A recorded Sybqa run on a fictional store with one planted checkout bug: the checkout journey failed at desktop and 320 px widths and the order confirmation stage was not reached. Synthetic data, AI review off.

  • Buy a product and check out · narrow: Failed
  • Buy a product and check out · desktop: Failed
  • 271 checks and 8 run notes recorded

Example retest: the same checkout after the fix

Selected checks passed

The same goal, plan, browser and screen sizes on the fixed copy of the fictional demo store: the checkout journey passed at both widths and the order confirmation appeared. Synthetic data, AI review off.

  • Buy a product and check out · narrow: Passed
  • Buy a product and check out · desktop: Passed
  • 281 checks and 9 run notes recorded

How to read the results

Each check ends in one of the first five states, and only Passed counts as passed. Dropped describes an AI flag and Recheck required describes a fix; neither is a check result.

Evidence statesScroll sideways for more columns.
StateWhat it means
PassedThe check ran in a real browser and the expected result was observed. Only passed checks count as passed.
FailedA real browser tried the check and it broke: the expected result was not observed. The report keeps the route, screen size and evidence.
BlockedThe check could not run, for example because access or a test fixture was unavailable, so no browser conclusion was recorded. Blocked never means passed.
Needs reviewA possible problem for a person to judge. It stays open and is not counted as passed.
Not runThe check was skipped because of scope, time or a missing prerequisite. Not run never means passed.
DroppedAn AI flag that a browser measurement contradicted, or that a second review step rated unlikely. It is listed so you can see what was checked, and it is never counted.
Recheck requiredA fix was proposed, but no matching assertion and captured evidence have confirmed it yet. A fix is never resolved by declaration.

What these examples are not

Run it yourself

The console can plan a check of the same demo store, or of a site you own or may test. Add your link here; it waits in the console after you create an account. The free plan gives 10 runs a month without AI review. Nothing runs until you review the plan.

Use a site you own or may test. Nothing runs until you review the plan.