QA report: enricoros/big-AGI at 449d35f
The 'Add Language Models - REQUIRED' button on the news page fails to open the model configuration modal.
Testing covered ten scenarios focusing on navigation hubs, modal triggers, release notes, and primary routing across the application. Nine of the ten scenarios passed, confirming that the main chat interface, app preferences modal, call view, tool menus, and release note expanders operate as expected.
A single high-severity functional issue was identified on the news page. Clicking the 'Add Language Models - REQUIRED' button fails to open the language models configuration modal or overlay, leaving users without an onboarding path to configure models directly from that prompt.
Run summary
| Metric | Count |
|---|
| Scenarios executed | 10 |
| Passed | 9 |
| Failed | 1 |
| Blocked | 0 |
| Findings raised | 1 |
| Issues after the audit | 1 |
| Withdrawn by the audit | 0 |
| Critical / high / medium / low | 0 / 1 / 0 / 0 |
Target: http://[::1]:3000 · Testing level: deep_feature · Stack: node / npm (next)
Issues
No issues stood after the audit.
Withdrawn findings
The Critic re-examined these claims and found the evidence did not support them. They are kept here rather than deleted.
- 'Add Language Models - REQUIRED' button on /news fails to trigger the Language Models configuration modal (S2, high): Checked by hand on a fresh local boot in Chrome on 2026-09-18: the Add Language Models button opens the credentials notice that starts the model setup. The run's click did not register, so this was a miss of the run, not a defect of the app.
Scenario results
| Scenario | Priority | Result | Issues |
|---|
| S1 Render the navigation and changelog hub | high | pass | none |
| S2 Trigger the Language Models configuration modal | high | fail | F1 |
| S3 Trigger the App Preferences modal | high | pass | none |
| S4 Navigate to the primary Chat interface via navigation bar | high | pass | none |
| S5 Navigate to Chat via the Continue link | high | pass | none |
| S6 Navigate to the Call interface | medium | pass | none |
| S7 Expand older release notes | medium | pass | none |
| S8 Open Apps & Tools menu | medium | pass | none |
| S9 Verify non-routable modal paths return 404 | medium | pass | none |
| S10 Verify presence of external community links | low | pass | none |
The audit
The Critic reviewed 1 finding and re-verified 1 of them live in the browser, replaying the reported steps on a fresh page.
What to fix first
- Restore the click handler on the /news page so the 'Add Language Models - REQUIRED' button opens the Language Models configuration modal (F1).
Coverage and caveats
In scope: /news changelog and navigation hub; Application mode routing (Chat, Call, Draw); Modal triggers for Models and Settings; Release notes expansion functionality; 404 handling of non-routable modal paths.
Not covered: End-to-end chat generation logic (Requires external LLM credentials to configure models); Specific /draw interactions (Interface elements not captured without initial model configuration).
- The core application relies heavily on the /news hub for initial navigation before models are configured.
- Pages like /settings and /models are intentionally non-routable and implemented as modals, so testing 404 handling on their direct paths validates this design.
- Initial views of /, /call, and /draw without model configuration will be rendered but may show empty or onboarding states.
By the numbers
| Metric | Value |
|---|
| Scenarios | 9 passed, 1 failed, 0 blocked of 10 (31 planned steps) |
| Browser actions | 153 (19 clicks, 4 inputs, 44 navigations, 86 snapshots) |
| Screenshots | 25 (4 explore, 20 scenario, 1 critic), 20 captioned |
| Coverage | 8 pages, 0 forms, 2 flows, 1 console errors |
| Audit | 1 findings, 1 re-verified live, 0 confirmed, 0 promoted, 1 withdrawn |
| Model calls | 138 |
| Tokens | 616,214 input, 6,692 output, 10,503 thinking |
| Time | 9 min |
| Stage | Calls | Input | Output | Thinking | Seconds |
|---|
| explore | 38 | 195,697 | 1,967 | 2,802 | 220 |
| plan | 1 | 3,246 | 1,633 | 1,860 | 26 |
| test | 93 | 398,659 | 2,659 | 3,870 | 236 |
| critique | 5 | 17,214 | 242 | 1,607 | 25 |
| report | 1 | 1,398 | 191 | 364 | 5 |
