All nine tested scenarios passed with zero application defects identified across the demo workflows.
Testing covered core features on the OpenUI demos platform, including generating UI from presets, custom prompt submission, model selection, prompt validation handling, output inspection through tabs and fullscreen views, documentation search, benchmark comparisons, and general navigation integrity.
All scenarios passed their verification checks without breaking application state or raising defects. During custom generation testing in scenario S2, a domain resolution failure occurred due to test environment sandbox network restrictions, preventing full access to an external resource without impacting application logic.
With no application issues identified and all standard demo interactions functioning properly, the tested surface area remains stable.
| Metric | Count |
|---|---|
| Scenarios executed | 9 |
| Passed | 9 |
| Failed | 0 |
| Blocked | 0 |
| Findings raised | 0 |
| Issues after the audit | 0 |
| Withdrawn by the audit | 0 |
| Critical / high / medium / low | 0 / 0 / 0 / 0 |
Target: https://www.openui.com/demos · Testing level: deep_feature · Stack: unknown
No issues survived the audit.
These failures came from the test environment, not from the application: a credential the sandbox does not hold, a demo nobody may write to, a resource it cannot reach. They are not counted as issues. They record what this run could not exercise.
- S2 could not exercise this: Resource fails to resolve during custom generation. A network error occurs because a domain name cannot be resolved. The audit recorded the test environment as the cause, so it is not counted as an issue.
| Scenario | Priority | Result | Issues |
|---|---|---|---|
| S1 Generate UI from built-in preset | high | pass | none |
| S2 Generate UI from custom prompt and model selection | high | pass | none |
| S3 Empty prompt validation | high | pass | none |
| S4 Inspect generated outputs via tabs and fullscreen | high | pass | none |
| S5 Whitespace-only prompt validation | medium | pass | none |
| S6 Documentation search functionality | medium | pass | none |
| S7 Benchmark format comparison tab switching | medium | pass | none |
| S8 Page load and React hydration integrity | low | pass | none |
| S9 Navigation and link integrity for product pages | low | pass | none |
The Critic reviewed 0 findings and re-verified 0 of them live in the browser, replaying the reported steps on a fresh page.
- A console error regarding a failed domain resolution in S2 points to a test environment restriction where the sandbox could not reach a required external asset.
In scope: Generative UI prompt submission and validation on /demos; Preset UI generation flows; Output viewing tabs (Raw, Parsed, Fullscreen preview); Documentation search modal functionality; Benchmark page tab switching; Page load integrity and console error monitoring across mapped routes.
Not covered: External links to GitHub and thesys.dev (origin boundary constraints); Account creation or saving functionality (if any exist, out of scope for unauthenticated hosted run).
- UI generation may involve network latency; assuming standard timeouts or observable loading states apply during generation.
- Form validation for required fields uses standard HTML5 constraints or visual error indicators on the page.
| Metric | Value |
|---|---|
| Scenarios | 9 passed, 0 failed, 0 blocked of 9 (34 planned steps) |
| Browser actions | 136 (20 clicks, 11 inputs, 26 navigations, 79 snapshots) |
| Screenshots | 32 (4 explore, 28 scenario, 0 critic), 28 captioned |
| Coverage | 10 pages, 2 forms, 3 flows, 1 console errors |
| Audit | 0 findings, 0 re-verified live, 0 confirmed, 0 promoted, 0 withdrawn |
| Model calls | 140 |
| Tokens | 885,579 input, 7,098 output, 8,995 thinking |
| Time | 7 min |
| Stage | Calls | Input | Output | Thinking | Seconds |
|---|---|---|---|---|---|
| explore | 26 | 203,713 | 2,217 | 1,193 | 75 |
| plan | 1 | 4,216 | 1,556 | 2,127 | 29 |
| test | 111 | 672,217 | 2,937 | 4,021 | 294 |
| critique | 1 | 4,116 | 224 | 1,280 | 12 |
| report | 1 | 1,317 | 164 | 374 | 5 |
