QA report: external/open.maic.chat at hosted
Core AI classroom generation and navigation function properly, but the Discover course search panel fails to render search results or an empty state message.
Testing exercised classroom generation workflows, form validation for empty and long inputs, preview launches, cancellation flows, documentation access, home page integrity, and course discovery search across eight scenarios.
Seven scenarios passed successfully, but searching for discoverable courses failed. Specifically, the Discover tabpanel remains completely blank upon searching, without displaying matching course items or any fallback empty state message to inform the user.
The primary generation engine and UI controls operate reliably, but the discoverability flow lacks essential user feedback when users attempt to search for courses.
Run summary
| Metric | Count |
|---|
| Scenarios executed | 8 |
| Passed | 7 |
| Failed | 1 |
| Blocked | 0 |
| Findings raised | 1 |
| Issues after the audit | 1 |
| Withdrawn by the audit | 0 |
| Critical / high / medium / low | 0 / 0 / 1 / 0 |
Target: https://open.maic.chat · Testing level: deep_feature · Stack: unknown
Issues
Medium severity
F1 · Discover course search does not render course results or an empty state message
Severity: medium · Type: ux · Verdict: confirmed · Scenario: S5
The observations in S5 confirm that executing a search leaves the Discover tabpanel completely blank, failing to provide either results or a user-facing empty state message.
Expected: The page updates to render matching course results or explicitly displays an empty state message informing the user that no matching courses were found.
Actual: The Discover tabpanel remains completely blank without rendering any matching course items or any explicit empty state message (e.g. 'No courses found').
Steps to reproduce:
- Navigate to https://open.maic.chat/
- Click the 'Search courses' button in the Discover section.
- Type 'Biology' into the 'Search courses' input.
- Press the Enter key.
Evidence: screenshots/S5-6.png, screenshots/S5-11.png
Scenario results
| Scenario | Priority | Result | Issues |
|---|
| S1 Generate a new AI classroom session | high | pass | none |
| S2 Launch classroom from Generation Preview | high | pass | none |
| S3 Empty submission on Course Topic Generator Form | high | pass | none |
| S4 Cancel generation and return home | medium | pass | none |
| S5 Search discoverable courses | medium | fail | F1 |
| S6 Access Documentation page | medium | pass | none |
| S7 Long string submission on Course Topic Generator Form | medium | pass | none |
| S8 Page load integrity on home page | low | pass | none |
The audit
The Critic reviewed 1 finding and re-verified 0 of them live in the browser, replaying the reported steps on a fresh page.
- The scenarios were executed consistently with clear observations and no contradictions.
What to fix first
- Ensure the Discover course search view renders matching course cards or an explicit empty state message when queries return no results (F1).
Coverage and caveats
In scope: Course topic generation flow; Generation preview and continuation; Input validation on the topic form; Discoverable course search; Documentation link navigation.
Not covered: Pro mode switch (needs an account, out of scope for a hosted run); Login button (needs an account, out of scope for a hosted run); Arena navigation link (needs an account, out of scope for a hosted run).
- The actual classroom launched after clicking Continue on the Generation Preview is accessible without authentication.
- The live streaming on the generation preview resolves in a reasonable timeframe, making the Continue button interactive.
- The search courses functionality updates the UI directly without requiring a page reload or authentication.
By the numbers
| Metric | Value |
|---|
| Scenarios | 7 passed, 1 failed, 0 blocked of 8 (25 planned steps) |
| Browser actions | 151 (23 clicks, 13 inputs, 22 navigations, 93 snapshots) |
| Screenshots | 29 (4 explore, 25 scenario, 0 critic), 25 captioned |
| Coverage | 4 pages, 1 forms, 2 flows, 1 console errors |
| Audit | 1 findings, 0 re-verified live, 1 confirmed, 0 promoted, 0 withdrawn |
| Model calls | 164 |
| Tokens | 776,176 input, 6,902 output, 10,749 thinking |
| Time | 9 min |
| Stage | Calls | Input | Output | Thinking | Seconds |
|---|
| explore | 41 | 212,574 | 1,883 | 1,396 | 150 |
| plan | 1 | 3,145 | 1,492 | 3,071 | 31 |
| test | 120 | 555,110 | 3,197 | 5,019 | 340 |
| critique | 1 | 4,028 | 135 | 1,017 | 11 |
| report | 1 | 1,319 | 195 | 246 | 4 |
