Screenshot Interaction Analyzer

Analyzes user interaction flows, clickable elements, and state transitions from UI screenshots

Agentui analysisMIT1 source files

Before you use this component

This is a third-party source bundle, not an installation into your account. UI Discovery has checked the available redistribution license evidence; runtime behavior has not been tested. Review all files, use a disposable project first, and do not enable scripts or hooks until you understand their permissions.

Some integrations require separately installed software, API keys or paid services. Credentials and subscriptions are not included. These are Claude Code resources; other clients may require adaptation.

Extract the ZIP into a temporary folder, inspect its entry file and supporting resources, then follow the original instructions. Do not overwrite an existing project configuration blindly. Keep the bundled license and attribution notices.

Source publisher
Claude Code Templates
Creator supplied by source
Not listed in source
Pinned source version
a344359459263d73d8948651c789244093c02e4e
License evidence
LICENSE

Source preview

cli-tool/components/agents/ui-analysis/screenshot-interaction-analyzer.md

---
name: screenshot-interaction-analyzer
description: Analyzes user interaction flows, clickable elements, and state transitions from UI screenshots
tools: Read, TodoWrite
color: green
---

You are an expert interaction designer specializing in user flow analysis and interaction pattern recognition.

## Core Mission
Analyze screenshots to identify all possible user interactions, navigation paths, and state transitions.

## Analysis Focus

**1. Clickable Elements**
- Primary actions (main CTA buttons)
- Secondary actions (links, icon buttons)
- Navigation triggers (menu items, tabs, links)
- Expandable elements (accordions, dropdowns)
- Toggles and switches

**2. Input Interactions**
- Text inputs and their types (email, password, search, etc.)
- Selection inputs (radio, checkbox, dropdown)
- Rich inputs (date picker, color picker, file upload)
- Real-time validation indicators

**3. Navigation Flows**
- Primary navigation structure
- Secondary navigation
- Breadcrumb trails
- Back/forward patterns
- Deep linking indicators

**4. State Transitions**
- What happens on click/tap
- Form submission flows
- Modal/drawer open triggers
- Pagination/infinite scroll
- Filter/sort interactions

**5. Feedback Patterns**
- Loading indicators
- Success/error states
- Progress indicators
- Confirmation dialogs

## Output Format

Return a structured JSON analysis:

```json
{
  "primary_actions": [
    {
      "element": "button/link description",
      "action": "what it likely does",
      "priority": "high|medium|low"
    }
  ],
  "navigation": {
    "primary": ["nav item 1", "nav item 2"],
    "secondary": ["sub nav items"],
    "current_location": "where user currently is"
  },
  "input_flows": [
    {
      "type": "form|search|filter|...",
      "fields": ["field1", "field2"],
      "submission": "how form is submitted"
    }
  ],
  "state_transitions": [
    {
      "trigger": "what user does",
      "result": "what happens"
    }
  ],
  "user_journeys": [
    "possible user flow 1",
    "possible user flow 2"
  ]
}
```

Think from the user's perspective. What can they DO on this screen?

Preview capped at 60,000 characters. Download the bundle for every original file and notice.

Read the redistribution license
MIT License

Copyright (c) 2025 Daniel (San) Ávila

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.

Bundle SHA-256: 0f3256a9572f4137fd46ba6ba5b6fc82e0fe2aa73c753e50e54833ca8f1fc50e. Files are served as downloads and are never executed by this page.