firecrawl/open-lovable

Every scenario DeepQA drove in the browser, in plan order, with the 27 screenshots it captured along the way. A passing scenario is evidence too.

1. S1

   Basic generation flow navigation

   3 steps, 3 screenshots

   high✓ pass

   

   

   

   • Opened home page and prepared to enter the target URL.
   • Entered https://example.com into the URL input and revealed the Scrape Site button and options.
   • Clicked Scrape Site and successfully navigated to http://127.0.0.1:3000/generation.
   • Navigated to http://127.0.0.1:3000/, typed https://example.com into the URL input, clicked 'Scrape Site', and successfully navigated to http://127.0.0.1:3000/generation.
2. S2

   Advanced configuration generation flow

   7 steps, 2 screenshots

   high✓ pass

   

   

   • Entered URL 'https://example.com' which revealed the advanced generation configuration options including brand styles toggle, style presets, model selector, and additional instructions.
   • Navigated to http://127.0.0.1:3000/ and verified initial state.
   • Entering a URL reveals the advanced configuration options including the 'Extend brand styles' toggle switch, style preset buttons ('Glassmorphism', 'Neumorphism', 'Brutalism', 'Minimalist', 'Dark Mode', 'Gradient Rich', '3D Depth', 'Retro Wave'), LLM Model Combobox, and Additional Instructions textarea.
   • Interacted with the 'Extend brand styles' toggle, selected the 'Glassmorphism' style preset, and filled in 'Make the hero section full height' into the additional instructions textarea without any application errors or crashes.
3. S3

   Validation of required URL/Search input

   3 steps, 2 screenshots

   high✓ pass

   

   

   • Loaded home page with an empty 'Enter URL or search term...' input and submit button.
   • Clicking the scrape/search button with empty and whitespace inputs prevented navigation to the generation page and remained on the home page.
   • Verified on http://127.0.0.1:3000/ that clicking the scrape button with an empty input prevents form submission and stays on the home page.
   • Verified that submitting whitespace-only input via button click or Enter key also prevents navigation to /generation.
4. S4

   Iterative generation prompt submission

   3 steps, 3 screenshots

   medium✓ pass

   

   

   

   • Navigated to /generation page where the workspace prompt input is available.
   • Typed 'Add a dark mode toggle' into the workspace prompt textarea and clicked the submission button.
   • Prompt textarea cleared immediately, added user message to the feed, showed generation indicators, and rendered sandbox authorization error gracefully.
   • Navigated to http://127.0.0.1:3000/generation and entered 'Add a dark mode toggle' in the workspace prompt textarea.
   • Submitted the prompt using the 'Re-imagine Site' button.
   • The prompt input cleared immediately, user prompt was added to the chat history, progress indicators ('Creating sandbox while I plan your app...', 'Starting AI generation...') were displayed, and missing credential error ('Failed to create sandbox: Unauthorized, please check your credentials. - authorization header is missing') was handled and displayed gracefully without application crash.
5. S5

   Workspace tab toggling

   4 steps, 3 screenshots

   medium✓ pass

   

   

   

   • Navigated to /generation page where Code and View tab buttons are present and sandbox preview shows initial prompt.
   • Clicked the Code tab button; the preview placeholder was hidden and the code workspace view was displayed.
   • Clicked the View tab button; the main panel switched back to the sandbox preview view showing 'Start chatting to create your first app'.
   • The Code tab and View tab toggle smoothly between code workspace view and sandbox preview view without crashing or freezing.
6. S6

   LLM model selection in workspace

   3 steps, 2 screenshots

   medium✕ fail

   

   

   • Navigated to /generation page where the LLM model combobox defaults to google/gemini-3-pro-preview.
   • Navigated to /generation page where the LLM model selection combobox is present with default value google/gemini-3-pro-preview.
   • Attempted to interact with the LLM model combobox to change the AI model to anthropic/claude-sonnet-4-2025 or openai/gpt-5.
   • The combobox does not open and selection cannot be registered because elements are continuously remounting in a rapid re-render loop.
7. S7

   Create new sandbox action

   2 steps, 2 screenshots

   medium✓ pass

   

   

   • Navigated to /generation page where the 'Create new sandbox' button is visible.
   • Clicked 'Create new sandbox' and observed an explicit credentials error message in the chat/log UI ('Failed to create sandbox: Unauthorized, please check your credentials. - authorization header is missing').
   • The 'Create new sandbox' button is active and responsive on /generation.
   • Clicking 'Create new sandbox' triggered the sandbox creation request and explicitly displayed the expected unauthorized/credentials error in the UI without crashing.
8. S8

   Download Vite app action

   2 steps, 2 screenshots

   medium✓ pass

   

   

   • Navigated to /generation page where 'Download your Vite app as ZIP' button is visible in disabled state when no files/sandbox exist.
   • Observed 'Download your Vite app as ZIP' button has disabled attribute, correctly preventing download actions when no sandbox files exist without crashing the page.
   • The /generation page renders the 'Download your Vite app as ZIP' button in a disabled state when no sandbox/files are available.
   • The button cleanly prevents interaction via standard HTML disabled attribute without causing page crashes or unexpected errors.
9. S9

   Navigate back to landing page

   2 steps, 2 screenshots

   low✓ pass

   

   

   • Navigated to /generation page and observed 'Generate a new website' link pointing to root '/'.
   • Clicked 'Generate a new website' link and successfully returned to the landing page at http://127.0.0.1:3000/.
   • The 'Generate a new website' link on /generation successfully navigated back to the landing page at http://127.0.0.1:3000/.
10. S10

    Style preset mutual exclusivity

    3 steps, 4 screenshots

    low✓ pass

    

    

    

    

    • Clicked Brutalism style preset to select it.
    • Clicked Dark Mode style preset, deselecting Brutalism and selecting Dark Mode.
    • Navigated to http://127.0.0.1:3000/ and entered a URL to reveal the style preset options.
    • Clicked 'Style Preset: Brutalism', which became selected.
    • Clicked 'Style Preset: Dark Mode', which became actively selected while Brutalism was deselected.
    • Confirmed that style presets maintain mutual exclusivity as only one preset is active at a time.
11. S11

    Re-apply last generation action

    2 steps, 2 screenshots

    low✓ pass

    

    

    • Navigated to /generation; 'Re-apply last generation' button is present but initially disabled when no generation has occurred.
    • Submitted prompt 'Create a simple counter app'; generation failed with 'Failed to create sandbox: Unauthorized', and 'Re-apply last generation' button remained disabled.
    • Navigated to /generation; 'Re-apply last generation' button is rendered in disabled state as expected when no prior generation output exists.
    • Submitted generation prompt to attempt creating a generation, which halted due to sandbox authorization requirements, keeping 'Re-apply last generation' disabled.

Findings that survived the Critic's audit. Security-class issues stay summary-only until the maintainers ship a fix.

highwithdrawnfunctionalF1 · S6

LLM Model Combobox fails to open or change selection due to continuous re-rendering loop on /generation

I navigated to /generation and attempted to select a different model in the LLM Model combobox. The action timed out or failed because the combobox element is continuously unmounting and remounting (evidenced by changing refs on each snapshot), rendering the dropdown inoperable. The page reported 3 console errors during the scenario.

Expected

The LLM Model combobox should open a dropdown menu and allow selecting an alternative model (e.g. anthropic/claude-sonnet-4-2025), visibly updating the selection.

Actual

Clicking or interacting with the LLM Model combobox fails because the page enters a continuous component re-render cycle (following a sandbox creation authorization failure), unmounting and remounting DOM elements repeatedly so the dropdown menu cannot open or retain focus.

Repro · 3 steps

1. Navigate to http://127.0.0.1:3000/generation
2. Click on the LLM model selection combobox
3. Attempt to select a different model from the options

S6-2.pngS6-9.png

These failures came from the test environment, not from the application: a credential the sandbox does not hold, a demo nobody may write to, a resource it cannot reach. They are not counted as issues.

• S1 could not exercise this: Sandbox creation fails due to missing API credentials. The sandbox initialization fails with an unauthorized error because the required authorization header is missing. The audit recorded the test environment as the cause, so it is not counted as an issue.