QA report: external/research.u14.app at hosted
The application is mostly stable, but submitting an empty research topic fails silently without validation feedback.
A deep feature evaluation of the application was conducted across eleven scenarios, covering initial page loading, quick-start templates, topic reset controls, resource attachments, application settings configuration, local knowledge base management, research history views, keyboard shortcut dialogs, and navigation links.
Ten of the eleven scenarios passed cleanly, but one functional issue was confirmed: attempting to start research with an empty topic suppresses the workflow initiation without presenting any visual highlight, error message, or feedback to explain why the action was ignored.
Full backend research execution could not be verified because the test environment lacked valid API credentials, leading to 403 Forbidden responses during workflow initiation.
Run summary
| Metric | Count |
|---|
| Scenarios executed | 11 |
| Passed | 10 |
| Failed | 1 |
| Blocked | 0 |
| Findings raised | 1 |
| Issues after the audit | 1 |
| Withdrawn by the audit | 0 |
| Critical / high / medium / low | 0 / 0 / 1 / 0 |
Target: https://research.u14.app · Testing level: deep_feature · Stack: unknown
Issues
Medium severity
F1 · Empty research topic submission fails silently without validation feedback
Severity: medium · Type: functional · Verdict: confirmed · Scenario: S4
I navigated to the application, left the '1.1 Research topics' textbox empty, and clicked the 'Start Thinking' button. The page did not update, and no validation error or feedback was displayed.
Expected: The application should display a validation error or visible indication that the research topic is required before proceeding.
Actual: The application suppresses the research workflow start but provides no error message, visual highlight, or feedback to the user explaining why submission was ignored.
Steps to reproduce:
- Navigate to https://research.u14.app/.
- Ensure the '1.1 Research topics' textarea is blank.
- Click the 'Start Thinking' button.
Evidence: screenshots/S4-4.png, screenshots/S4-7.png
Environment limitations
These failures came from the test environment, not from the application: a credential the sandbox does not hold, a demo nobody may write to, a resource it cannot reach. They are not counted as issues. They record what this run could not exercise.
- S5 could not exercise this: API responds with 403 Forbidden during workflow initiation without configured keys. The server responds with a 403 status due to missing or invalid credentials. The audit recorded the test environment as the cause, so it is not counted as an issue.
Scenario results
| Scenario | Priority | Result | Issues |
|---|
| S1 Page load and console error check | high | pass | none |
| S2 Apply quick start templates | high | pass | none |
| S3 Reset research topic | high | pass | none |
| S4 Empty topic submission validation | high | fail | F1 |
| S5 Workflow initiation prompts for unconfigured API keys | high | pass | none |
| S6 Attach resource dropdown options | medium | pass | none |
| S7 Navigate and save Application Settings | medium | pass | none |
| S8 Manage Local Knowledge Base modal | medium | pass | none |
| S9 View and dismiss Research History | medium | pass | none |
| S10 Keyboard shortcuts dialog behavior | low | pass | none |
| S11 GitHub repository link integrity | low | pass | none |
The audit
The Critic reviewed 1 finding and re-verified 1 of them live in the browser, replaying the reported steps on a fresh page.
- Scenario S4 and S5 contradict each other regarding the behavior of the 'Start Thinking' control when used with an empty topic; S4 claims silent failure, while S5 reports the Settings modal opening.
What to fix first
- Add explicit validation feedback or visual error cues when submitting an empty research topic to explain why the workflow did not start (F1).
Coverage and caveats
In scope: Research topic configuration and quick start templates; Empty and unconfigured submission flows; Application settings and local knowledge base UI; History and shortcut modals.
Not covered: Full execution of the multi-stage research pipeline (requires real API keys, out of scope for a hosted run).
- Assumes testing without real API credentials, so we can only test the workflow up to the settings prompt.
- Draft topic persistence is not explicitly tested across reloads as client-side storage of unsaved input is unverified.
By the numbers
| Metric | Value |
|---|
| Scenarios | 10 passed, 1 failed, 0 blocked of 11 (37 planned steps) |
| Browser actions | 186 (46 clicks, 11 inputs, 13 navigations, 116 snapshots) |
| Screenshots | 37 (4 explore, 32 scenario, 1 critic), 32 captioned |
| Coverage | 1 pages, 2 forms, 6 flows, 1 console errors |
| Audit | 1 findings, 1 re-verified live, 1 confirmed, 0 promoted, 0 withdrawn |
| Model calls | 155 |
| Tokens | 639,899 input, 7,380 output, 12,815 thinking |
| Time | 7 min |
| Stage | Calls | Input | Output | Thinking | Seconds |
|---|
| explore | 40 | 169,740 | 1,829 | 1,484 | 76 |
| plan | 1 | 3,458 | 1,789 | 2,984 | 35 |
| test | 109 | 454,606 | 3,114 | 5,417 | 252 |
| critique | 4 | 10,587 | 437 | 2,582 | 32 |
| report | 1 | 1,508 | 211 | 348 | 5 |