Hosted appRepository visualizerHosted, in placesucceeded

Open-source tool that turns a GitHub repository into an interactive architecture diagram with an LLM. Tested in place on its hosted instance.

Tested in place byDeepQA Teamatgitdiagram.comonSep 20, 2026

Run #1model gemini-balanced (vertex)took 7m

All 12 scenarios passed, no issues after the audit.

Share on X
GitDiagram in the browser during the run

By the numbers

12 of 12
scenarios passed
136
browser actions
36
screenshots
127
model calls
6.8
minutes
12
scenarios
12
passed
0
failed
0
blocked
0
issues

Walkthrough

Every scenario DeepQA drove in the browser, in plan order, with the 30 screenshots it captured along the way. A passing scenario is evidence too.

  1. S1
    Generate diagram from GitHub repository input

    3 steps, 3 screenshots

    pass
    S1-1.png
    S1 · Generate diagram from GitHub repository input
    S1-4.png
    S1 · Generate diagram from GitHub repository input
    S1-6.png
    S1 · Generate diagram from GitHub repository input
    • Navigated to GitDiagram homepage with repository input form ready.
    • Entered pallets/flask into GitHub repository input.
    • Navigated to /pallets/flask and rendered the diagram visualization with status Diagram ready.
    • Navigating to GitDiagram home page, entering 'pallets/flask' into the repository input, and clicking 'Diagram' navigated to '/pallets/flask'.
    • The diagram visualization rendered successfully with 'Diagram ready' status and architectural components.
  2. S2
    Validate empty repository input

    3 steps, 2 screenshots

    pass
    S2-1.png
    S2 · Validate empty repository input
    S2-3.png
    S2 · Validate empty repository input
    • Loaded GitDiagram home page with empty GitHub repository input field having the required attribute.
    • Clicked Diagram submit button with empty input; HTML5 required validation prevented form submission and stayed on the home page without navigation or errors.
    • The GitHub repository input has the HTML5 'required' attribute.
    • Clicking the Diagram submit button while the repository textbox is empty does not trigger form navigation or page crashes, preventing empty repository submissions.
  3. S3
    Search and filter public diagrams

    3 steps, 3 screenshots

    pass
    S3-2.png
    S3 · Search and filter public diagrams
    S3-5.png
    S3 · Search and filter public diagrams
    S3-8.png
    S3 · Search and filter public diagrams
    • Navigated to the browse page displaying the full list of public diagrams.
    • Entered search query 'react' and the repository list dynamically updated to matching repositories.
    • Selected '100' minimum stars filter and verified the public diagram list updated to show only matching repositories with at least 100 stars.
    • Navigating to /browse loaded the diagrams table with sort and star filtering controls.
    • Typing 'react' into the search input dynamically filtered the repository table to 1,178 diagrams containing 'react' in real-time.
    • Selecting '100' in the 'Minimum Stars' combobox filtered the results down to 339 diagrams, and every visible repository had at least 100 stars.
  4. S4
    Export diagram functionality

    2 steps, 2 screenshots

    pass
    S4-2.png
    S4 · Export diagram functionality
    S4-5.png
    S4 · Export diagram functionality
    • Navigated directly to /pallets/flask and observed the rendered architecture diagram with the Export button available.
    • Clicked Export button and observed the export options menu appearing with 'Download PNG' and 'Copy Mermaid' buttons.
    • Navigated to /pallets/flask where the architecture diagram loaded successfully.
    • Clicked the 'Export' button, which revealed the export options ('Download PNG' and 'Copy Mermaid').
  5. S5
    Configure and clear OpenAI API key

    6 steps, 4 screenshots

    pass
    S5-1.png
    S5 · Configure and clear OpenAI API key
    S5-3.png
    S5 · Configure and clear OpenAI API key
    S5-6.png
    S5 · Configure and clear OpenAI API key
    S5-9.png
    S5 · Configure and clear OpenAI API key
    • Navigated to the GitDiagram home page.
    • Opened the OpenAI API key modal dialog.
    • Entered dummy OpenAI API key into the input field.
    • Saved the API key and verified modal closed successfully.
    • Re-opened the API Key modal and observed 'Key saved. Paste a new one to replace it.' with a 'Clear key' button.
    • Clicked 'Clear key', observed 'Clearing...', and verified the modal returned to the initial unsaved state without any errors.
    • The OpenAI API key modal opens properly from the navbar button.
    • Entering a test API key enables the 'Save key' button.
    • Saving the API key stores the key, closes the modal, and updating the state to 'Key saved. Paste a new one to replace it.' upon reopening.
    • Clicking 'Clear key' clears the stored key and restores the modal to its initial unsaved state without errors.
  6. S6
    Load diagram via example repository button

    2 steps, 2 screenshots

    pass
    S6-1.png
    S6 · Load diagram via example repository button
    S6-3.png
    S6 · Load diagram via example repository button
    • Loaded the GitDiagram home page showing the example repository buttons including Flask.
    • Clicked the Flask example button and successfully navigated to /pallets/flask where the interactive diagram rendered with 'Diagram ready' status.
    • The Flask example repository button on the home page correctly navigates to /pallets/flask.
    • The diagram view loaded completely with interactive diagram nodes and 'Diagram ready' status indicator.
  7. S7
    Sort diagrams by Most Stars

    2 steps, 2 screenshots

    pass
    S7-2.png
    S7 · Sort diagrams by Most Stars
    S7-5.png
    S7 · Sort diagrams by Most Stars
    • Navigated to the Browse page showing recent public diagrams sorted by newest.
    • Selected 'Most Stars' in the Sort combobox and verified the repository catalog reorders with highest star count items (e.g. 547,836 stars) displayed at the top.
    • The Browse page loads with default sorting by newest.
    • Selecting 'Most Stars' updates the URL to '/browse?sort=stars_desc' and reorders the list descending by star count starting with 'codecrafters-io / build-your-own-x' (547,836 stars).
  8. S8
    Navigate browse pagination

    3 steps, 2 screenshots

    pass
    S8-2.png
    S8 · Navigate browse pagination
    S8-5.png
    S8 · Navigate browse pagination
    • Navigated to /browse; initial page displays 'Page 1 of 5740' with first repository 'funnyfta / newswervetestflux'.
    • Clicked Next button; URL updated to /browse?page=2, display updated to 'Page 2 of 5740', range '21 – 40 of 114,791', and first item changed to 'alharthali / workout-tracker'.
    • Navigated to /browse. First item on page 1 was 'funnyfta / newswervetestflux' with pagination showing 'Page 1 of 5740'.
    • Clicked the Next button. The page navigated to /browse?page=2, displaying 'Page 2 of 5740' and updating the list with a new first item ('alharthali / workout-tracker').
  9. S9
    Toggle dark and light theme

    2 steps, 3 screenshots

    pass
    S9-1.png
    S9 · Toggle dark and light theme
    S9-3.png
    S9 · Toggle dark and light theme
    S9-5.png
    S9 · Toggle dark and light theme
    • The home page is loaded in light mode with a 'Switch to dark mode' button visible in the navigation bar.
    • Clicked 'Switch to dark mode'; the theme changed to dark mode and the button updated to 'Switch to light mode'.
    • Clicked 'Switch to light mode'; the theme reverted back to light mode and the button updated to 'Switch to dark mode'.
    • Navigated to home page and observed theme toggle button labeled 'Switch to dark mode'.
    • Clicking the toggle switched the UI theme to dark mode and updated the button label to 'Switch to light mode'.
    • Clicking the toggle again switched the UI theme back to light mode and updated the button label to 'Switch to dark mode'.
  10. S10
    View diagram activity statistics

    2 steps, 2 screenshots

    pass
    S10-2.png
    S10 · View diagram activity statistics
    S10-4.png
    S10 · View diagram activity statistics
    • Navigated to /pallets/flask diagram view where the Activity button is visible above the diagram canvas.
    • Clicked the Activity button, which expanded a section showing architecture analysis metrics (21 components, 25 connections, cost, generation timestamp, and overview).
    • Navigated to '/pallets/flask' and observed the diagram view with the 'Activity' button visible in the header controls.
    • Clicked the 'Activity' button and verified that the activity statistics panel displayed successfully, showing component and connection counts (21 components · 25 connections), generation date, actual cost ($0.118 USD), and architecture analysis details.
  11. S11
    Enable diagram zoom controls

    2 steps, 2 screenshots

    pass
    S11-2.png
    S11 · Enable diagram zoom controls
    S11-4.png
    S11 · Enable diagram zoom controls
    • Navigated to /pallets/flask diagram view, where the diagram is loaded and 'Enable zoom' button is present.
    • Clicked 'Enable zoom', which transformed the button into 'Exit zoom' and activated the 'Interactive diagram viewer' canvas.
    • Successfully navigated to /pallets/flask diagram view.
    • Clicked 'Enable zoom', which updated the button state to 'Exit zoom' and enabled the interactive diagram viewer canvas.
  12. S12
    Copy advertisement email address

    2 steps, 3 screenshots

    pass
    S12-2.png
    S12 · Copy advertisement email address
    S12-5.png
    S12 · Copy advertisement email address
    S12-8.png
    S12 · Copy advertisement email address
    • Navigated to the Advertise page at /advertise.
    • Clicked 'Copy email' button on the Advertise page, triggering visual update copying the email address to clipboard.
    • Navigated to /advertise and clicked the 'Copy email' button.
    • The application reacted immediately upon clicking the button, copying the email address and updating state without errors.

Issues

No finding survived the audit. Nothing to fix from this run.

Critic audit

An adversarial second pass over every finding before it reaches the report.

0
findings reviewed
2
re-verified live
0
withdrawn
    • Several passed scenarios (S10, S11, S12) captured React hydration mismatch errors in the console that the Tester failed to report as defects.
    • A possible defect in S10 ("React hydration mismatch error on diagram view") was not promoted: the live replay came back not-reproduced.
    • A possible defect in S12 ("React hydration mismatch error on advertise page") was not promoted: the live replay came back not-reproduced.

    Report

    QA report: external/gitdiagram.com at hosted

    All twelve evaluated scenarios passed successfully with zero confirmed defects detected across the application.

    The test run evaluated key application workflows on gitdiagram.com, covering diagram generation from GitHub repository inputs, example diagram loading, searching and filtering public diagrams, sorting and pagination controls, diagram exporting, zoom controls, and theme toggling.

    All twelve scenarios passed without functional failures. Two potential hydration mismatch observations were audited through live re-verification and could not be reproduced as confirmed defects, leaving zero open issues at the end of the run.

    The tested diagram viewing, repository configuration, and navigation features operated reliably without regressions or blocking bugs.

    Run summary
    MetricCount
    Scenarios executed12
    Passed12
    Failed0
    Blocked0
    Findings raised0
    Issues after the audit0
    Withdrawn by the audit0
    Critical / high / medium / low0 / 0 / 0 / 0

    Target: https://gitdiagram.com · Testing level: deep_feature · Stack: unknown

    Issues

    No issues survived the audit.

    Scenario results
    ScenarioPriorityResultIssues
    S1 Generate diagram from GitHub repository inputhighpassnone
    S2 Validate empty repository inputhighpassnone
    S3 Search and filter public diagramshighpassnone
    S4 Export diagram functionalityhighpassnone
    S5 Configure and clear OpenAI API keyhighpassnone
    S6 Load diagram via example repository buttonmediumpassnone
    S7 Sort diagrams by Most Starsmediumpassnone
    S8 Navigate browse paginationmediumpassnone
    S9 Toggle dark and light thememediumpassnone
    S10 View diagram activity statisticsmediumpassnone
    S11 Enable diagram zoom controlslowpassnone
    S12 Copy advertisement email addresslowpassnone
    The audit

    The Critic reviewed 0 findings and re-verified 2 of them live in the browser, replaying the reported steps on a fresh page.

    • Several passed scenarios (S10, S11, S12) captured React hydration mismatch errors in the console that the Tester failed to report as defects.
    • A possible defect in S10 ("React hydration mismatch error on diagram view") was not promoted: the live replay came back not-reproduced.
    • A possible defect in S12 ("React hydration mismatch error on advertise page") was not promoted: the live replay came back not-reproduced.
    Coverage and caveats

    In scope: Repository diagram generation flow via input and example buttons; Diagram interactive controls (zoom, export, activity); Diagram catalog browsing, searching, filtering, sorting, and pagination; Local configuration (API Key modal); Global UI features (Theme toggling); Advertisement information page.

    Not covered: Diagram generation utilizing actual paid OpenAI quota (tested with mocked or public cached repos to avoid burning real quota).

    • The /pallets/flask repository diagram is cached or generates reliably without requiring a valid OpenAI key.
    • Export actions (PNG/SVG/Mermaid) trigger browser downloads or clipboard events that may be partially constrained by the automated browser environment, but the options menu itself is observable.
    By the numbers
    MetricValue
    Scenarios12 passed, 0 failed, 0 blocked of 12 (32 planned steps)
    Browser actions136 (29 clicks, 5 inputs, 25 navigations, 77 snapshots)
    Screenshots36 (4 explore, 30 scenario, 2 critic), 30 captioned
    Coverage4 pages, 3 forms, 4 flows, 0 console errors
    Audit0 findings, 2 re-verified live, 0 confirmed, 0 promoted, 0 withdrawn
    Model calls127
    Tokens684,120 input, 7,959 output, 15,321 thinking
    Time7 min
    StageCallsInputOutputThinkingSeconds
    explore22117,8712,0071,34980
    plan13,9411,8861,51227
    test95533,5553,2154,697216
    critique827,3236967,31080
    report11,4301554535

    Run log

    stagecallstokenstime
    Explore22121.2k1m 20s
    Plan17.3k27s
    Test95541.5k3m 36s
    Critique835.3k1m 20s
    Report12k5s
    Total127707.4k6m 48s
    Intake
    Explore
    Plan
    Test
    Critique
    Report
    • 00:54:24Zexploreexplore started
    • 01:01:12ZexploreExplored / (16 controls, 1 forms)
    • 01:01:12ZexploreExplored /pallets/flask (14 controls, 0 forms)
    • 01:01:12ZexploreExplored /browse (54 controls, 0 forms)
    • 01:01:12ZexploreExplored /advertise (17 controls, 0 forms)
    • 01:01:12ZexploreMapped 4 pages, 3 forms, 4 flows in 22 turns.
    • 01:01:12Zexploreexplore completed in 80s.
    • 01:01:12Zplanplan started
    • 01:01:12ZplanPlanned 12 scenarios (5 high, 5 medium, 2 low).
    • 01:01:12Zplanplan completed in 27s.
    • 01:01:12Ztesttest started
    • 01:01:12ZtestS1 executed (pass)
    • 01:01:12ZtestS2 executed (pass)
    • 01:01:12ZtestS3 executed (pass)
    • 01:01:12ZtestS4 executed (pass)
    • 01:01:12ZtestS5 executed (pass)
    • 01:01:12ZtestS6 executed (pass)
    • 01:01:12ZtestS7 executed (pass)
    • 01:01:12ZtestS8 executed (pass)
    • 01:01:12ZtestS9 executed (pass)
    • 01:01:12ZtestS10 executed (pass)
    • 01:01:12ZtestS11 executed (pass)
    • 01:01:12ZtestS12 executed (pass)
    • 01:01:12ZtestExecuted 12 scenarios: 12 passed, 0 failed, 0 blocked, 0 findings.
    • 01:01:12Ztesttest completed in 216s.
    • 01:01:12Zcritiquecritique started
    • 01:01:12ZcritiqueReviewed 0 findings; 2 possible defects spotted in passed scenarios.
    • 01:01:12ZcritiqueRe-verified a possible defect in S10: not-reproduced.
    • 01:01:12ZcritiqueRe-verified a possible defect in S12: not-reproduced.
    • 01:01:12ZcritiqueAudit complete: 0 confirmed, 0 withdrawn, 0 promoted, 2 re-verified live.
    • 01:01:12Zcritiquecritique completed in 80s.
    • 01:01:12Zreportreport started
    • 01:01:12ZreportReported 0 issues (0 critical, 0 high, 0 medium, 0 low) from 0 findings.
    • 01:01:12Zreportreport completed in 5s.

    Put an agent team on your next pull request.

    Connect a repo, dispatch a Run, and read an audited, evidence-backed report the same day.