Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
46 changes: 46 additions & 0 deletions agent-tools/in-app-agent-data-privacy.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
---
title: "Comfy Agent Data and Privacy"
sidebarTitle: "Data and privacy"
description: "Understand what Comfy Agent uses to answer a request and how local and Cloud use differ."
icon: "shield"
---

## The short version

Comfy Agent uses your message, selected workflow, selected nodes, and attachments. When you work with a local ComfyUI installation, chat history is stored on that machine. Your message and the information needed to answer it are sent through Comfy's online service.

Check warning on line 10 in agent-tools/in-app-agent-data-privacy.mdx

View check run for this annotation

Mintlify / Mintlify Validation (dripart) - vale-spellcheck

agent-tools/in-app-agent-data-privacy.mdx#L10

Did you really mean 'Comfy's'?

## What the Agent uses

| Data | How it helps |
| --- | --- |
| Your message | Tells the Agent what you want to do. |
| Selected workflow and nodes | Show which workflow and nodes you want explained or changed. |
| Image attachment | Lets the Agent inspect the image and use it in a workflow. |
| Video or audio attachment | Lets the Agent read media properties and extract or convert content. |
| Workflow and execution errors | Help the Agent explain and fix a failed workflow. |
| Personal skill | Supplies reusable instructions. |

The [Privacy Policy](https://www.comfy.org/privacy-policy?utm_source=docs) and [Terms of Service](https://www.comfy.org/terms-of-service?utm_source=docs) govern your use of Comfy.

## Cloud and local data flow

| Where you use Comfy Agent | What happens |
| --- | --- |
| **Comfy Cloud** | Comfy Cloud stores conversations, workflows, and assets. Your messages are processed by Comfy's online service, and workflows run on Cloud GPUs. |

Check warning on line 29 in agent-tools/in-app-agent-data-privacy.mdx

View check run for this annotation

Mintlify / Mintlify Validation (dripart) - vale-spellcheck

agent-tools/in-app-agent-data-privacy.mdx#L29

Did you really mean 'Comfy's'?

Check warning on line 29 in agent-tools/in-app-agent-data-privacy.mdx

View check run for this annotation

Mintlify / Mintlify Validation (dripart) - vale-spellcheck

agent-tools/in-app-agent-data-privacy.mdx#L29

Did you really mean 'GPUs'?
| **Local ComfyUI in Desktop** | The local installation stores chat history, workflows, and files. Your messages and relevant workflow information are processed by Comfy's online service. Local workflow nodes run on your hardware; partner nodes use their online providers. |

Check warning on line 30 in agent-tools/in-app-agent-data-privacy.mdx

View check run for this annotation

Mintlify / Mintlify Validation (dripart) - vale-spellcheck

agent-tools/in-app-agent-data-privacy.mdx#L30

Did you really mean 'Comfy's'?

## Chat history and sync

Conversations with the Cloud Agent are stored with Comfy Cloud. Conversations with the local Agent are stored on the machine running ComfyUI. The two histories do not sync. This depends on whether you are using Cloud or a local installation, not which application window you open it in.

## Skills and guidance

Personal skills contain instructions you create for the Agent. They are saved to your account and used when your request matches them or you name them.

Built-in Agent guidance and skills for external coding agents are separate from your personal Agent skills.

## Retention and deletion

For retention details, see the [Privacy Policy](https://www.comfy.org/privacy-policy?utm_source=docs) and [Data Retention](/support/data-retention).

For account or data-deletion requests, contact [support@comfy.org](mailto:support@comfy.org).
72 changes: 72 additions & 0 deletions agent-tools/in-app-agent-installation.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,72 @@
---
title: "Get Started with Comfy Agent"
sidebarTitle: "Get started"
description: "Open Comfy Agent in Comfy Cloud or Comfy Desktop."
icon: "play"
---

## Choose your setup

You need a Comfy account with Agent access. If you do not have access, [join the private alpha waitlist](https://links.comfy.org/agentalpha).

- **Comfy Cloud:** [Sign in to Cloud](https://cloud.comfy.org). No local installation is needed.
- **Comfy Desktop:** Follow the [Desktop installation guide](/installation/desktop/overview), then sign in. For an existing installation, follow [Update ComfyUI](/installation/update_comfyui).

## Make your first image

### Open the Agent

Open a blank workflow, then select **Ask Comfy Agent** in the workflow bar. Read and accept the consent notice if prompted. Use **Choose a workflow** in the Agent panel to select the blank workflow.

### Build a workflow

Send this message:

> Build a text-to-image workflow for a red sneaker on a neutral gray background. Use an available model and include a Save Image node. Check the workflow for errors, but don't run it yet.

The Agent builds the workflow on the canvas, fills in the prompt and model settings, and checks the node connections and required inputs. You should see a connected workflow ending in a **Save Image** node.

If the Agent reports a missing model or file, supply it or ask for an alternative available in your installation. Ask it to check the workflow again before continuing.

### Generate the image

Open **Run permissions** next to the message box, choose **Ask**, and select **Save changes** if you changed the setting.

Send “Run this workflow.” When the Agent asks for approval, select **Run**. Select **Cancel** instead if you do not want to start that run.

When generation finishes, the Agent returns the output in the conversation. The image also appears in the **Save Image** node. Right-click the image there to save it to your computer.

### Make a change

Send “Change the background to white and keep the model and other settings.” The Agent updates the existing workflow. Ask it to run again to compare the result.

## Troubleshooting

### The Agent button is missing

Sign in to your Comfy account. In Comfy Desktop, [update the application](/installation/update_comfyui) and restart it. If the button is still missing, check your account's Agent access with [support](/support/contact-support).

### The Agent cannot edit the workflow I expected

Choose the intended workflow in the Agent panel, then send your message again. See [Choose which workflow to edit](/agent-tools/in-app-agent#choose-which-workflow-to-edit).

### The Agent asks for an input

Select **Attach a file** or drag the requested file into the message box, then ask the Agent to continue.

### I cannot find a local conversation in Cloud

Local and Cloud history are separate. See [Data and privacy](/agent-tools/in-app-agent-data-privacy#chat-history-and-sync).

## Next steps

<CardGroup cols={2}>
<Card title="Edit an existing workflow" icon="pen" href="/agent-tools/in-app-agent#build-and-edit-workflows">
Change prompts, models, or processing steps.
</Card>
<Card title="Save a reusable skill" icon="wand-magic-sparkles" href="/agent-tools/in-app-agent-skills#create-a-skill-in-chat">
Remember instructions for future requests.
</Card>
</CardGroup>

See [Data and privacy](/agent-tools/in-app-agent-data-privacy) to learn where messages, files, and conversations are stored.
52 changes: 52 additions & 0 deletions agent-tools/in-app-agent-skills.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,52 @@
---
title: "Comfy Agent Skills"
sidebarTitle: "Agent skills"
description: "Use personal skills to give Comfy Agent reusable instructions for your work."
icon: "wand-magic-sparkles"
---

## What is a personal skill?

A personal skill is a reusable set of instructions for Comfy Agent. It includes a name, a one-line description of when to use it, and the instructions themselves.

Use personal skills to repeat instructions such as “make square images,” “use a white background,” or “check node connections before running.”

Personal skills are saved to your account. The Agent loads a skill when its description matches your request or when you ask for it by name.

## Create a skill in chat

Tell the Agent what to save, what to call it, and when it should be used:

> Save this as a skill called product-shot: When I ask for a product image, use a square 1024 × 1024 canvas, a neutral gray background, and a Save Image node. Validate the workflow before running it.

The Agent saves the skill for future messages. A new or updated skill takes effect with your next message.

## Use a skill

Ask for a skill by name:

> Use my product-shot skill to create a studio photo workflow for a red sneaker.

The Agent can also select a skill automatically when your request matches its description.

## Update or delete a skill

Use the same skill name to replace its instructions:

> Update my product-shot skill to use a white background and a 1536 × 1536 canvas.

Delete a skill by name:

> Delete my product-shot skill.

## Save an existing skill file

Paste the contents of your `SKILL.md` file into chat and ask the Agent to save it as a personal skill. The Agent reads its name and description from the header at the top of the file. The saved skill is available from your next message.

## Built-in guidance and coding-agent skills

Comfy Agent includes guidance for building workflows and choosing models. Personal skills add your own instructions for repeated tasks.

[Skills for coding agents](/agent-tools/skills) are installed separately in tools such as Claude Code. Installing one there does not add it to Comfy Agent.

Keep API keys, passwords, and access tokens out of skill instructions. For data handling, see [Data and privacy](/agent-tools/in-app-agent-data-privacy#skills-and-guidance).
116 changes: 99 additions & 17 deletions agent-tools/in-app-agent.mdx
Original file line number Diff line number Diff line change
@@ -1,39 +1,121 @@
---
title: "Comfy In-App Agent"
sidebarTitle: "In-App Agent"
description: "Join the private alpha waitlist for Comfy In-App Agent on Comfy Cloud."
title: "Comfy Agent"
sidebarTitle: "Overview"
description: "Use Comfy Agent to understand, build, edit, and run ComfyUI workflows. Join the private alpha waitlist for access."

Check warning on line 4 in agent-tools/in-app-agent.mdx

View check run for this annotation

Mintlify / Mintlify Validation (dripart) - vale-spellcheck

agent-tools/in-app-agent.mdx#L4

Did you really mean 'waitlist'?
icon: "comments"
---

<Note>
**Private alpha.** Comfy In-App Agent is rolling out to a limited set of users. Public docs and website pages are not available yet. Join the waitlist to request access.
**Private alpha.** Comfy Agent is rolling out to a limited set of users. Join the waitlist to request access.

Check warning on line 9 in agent-tools/in-app-agent.mdx

View check run for this annotation

Mintlify / Mintlify Validation (dripart) - vale-spellcheck

agent-tools/in-app-agent.mdx#L9

Did you really mean 'waitlist'?
</Note>

**Comfy In-App Agent** is the agent experience inside Comfy Cloud: prompt in chat, and the agent can build or edit workflows on your graph.
Comfy Agent is an assistant inside ComfyUI. It can build and edit workflows, explain nodes, inspect media, fix validation errors, and run the finished workflow.

## Join the waitlist

Check warning on line 14 in agent-tools/in-app-agent.mdx

View check run for this annotation

Mintlify / Mintlify Validation (dripart) - vale-spellcheck

agent-tools/in-app-agent.mdx#L14

Did you really mean 'waitlist'?

<Card title="Join the alpha waitlist" icon="list" href="https://links.comfy.org/agentalpha">
Request access to the Comfy In-App Agent private alpha.
Request access to the Comfy Agent private alpha.
</Card>

## Feedback
## What it can do

Already in the alpha? Share bugs and impressions:
- Find templates, models, and nodes available in your ComfyUI environment.
- Build a workflow from a template and customize its prompts and settings.
- Change part of the current workflow without rebuilding the rest.
- Add, connect, configure, and remove nodes.
- Validate a workflow before running it.
- Inspect images and read video or audio properties.
- Run workflows and return their outputs.

<Card title="Send feedback" icon="message" href="https://links.comfy.org/agentalphafeedback">
Report bugs or share impressions from the alpha.
</Card>
## Where you can use it

| Where you use Comfy Agent | What to expect |
| --- | --- |
| **Comfy Cloud** | The Agent, workflows, and assets use your Comfy Cloud account. There is no local package to install. |
| **Comfy Desktop** | The Agent works with the ComfyUI installation on your machine, including its workflows, models, and custom nodes. |
| **Network connection** | Agent requests use Comfy services. See [Data and privacy](/agent-tools/in-app-agent-data-privacy). |

Comfy Agent is separate from [Comfy MCP](/agent-tools/mcp) and [Comfy CLI](/agent-tools/cli). MCP connects an external AI client to Comfy. The CLI is for terminal and script workflows. Comfy Agent works in the ComfyUI interface.

To make your first image, follow [Get started with Comfy Agent](/agent-tools/in-app-agent-installation#make-your-first-image).

## Choose which workflow to edit

Use the workflow selector in the Agent panel to choose the workflow to edit, then send your message. Switching to another tab while the Agent is responding does not redirect its edits.

The Agent cannot create or switch tabs itself. To work elsewhere, open the other workflow, choose it in the Agent panel, and send a new message.

The Agent can read another open or saved workflow for comparison without loading it into the current tab. For example:

> Compare this workflow with my portrait workflow and use the same sampler settings here.

## Build and edit workflows

For a new workflow, open a blank workflow tab and choose it in the Agent panel. The Agent searches for a matching template before building from individual nodes. A template includes a connected graph and an output node.

For changes to an existing workflow, name the part you want changed and what should stay the same:

- “Change the prompt to a watercolor landscape. Keep the model and sampler settings.”
- “Add an upscaling stage after image generation.”

Check warning on line 59 in agent-tools/in-app-agent.mdx

View check run for this annotation

Mintlify / Mintlify Validation (dripart) - vale-spellcheck

agent-tools/in-app-agent.mdx#L59

Did you really mean 'upscaling'?
- “Switch this workflow to Flux using models installed here.”

## Validate before running

The Agent checks node connections, model names, required values, and output nodes before a run. It separates workflow errors from inputs that only you can provide.

If the workflow is valid but still needs an image, video, or other input, attach the file and ask the Agent to continue.

## Work with media

## Related
The Agent can inspect the visible contents and dimensions of a still image. For video, it can read the duration, dimensions, frame rate, and format. For audio, it can read the duration, format, and audio tracks.

Looking for agent tools that work from Claude, Cursor, Codex, and other MCP clients (outside the ComfyUI canvas)?
Use **Attach a file** in the message box to add an image or file. You can also drag media into the conversation.

| Add to the conversation | Ask | Result |
| --- | --- | --- |
| An image | “Describe the lighting in this image.” | A description you can use to refine your prompt. |
| A video | “Trim this to the first five seconds.” | A shortened video file. |
| Two video clips | “Join clip A followed by clip B.” | One video containing both clips in that order. |
| A video and an audio file | “Add this audio to the video.” | A video with the supplied audio. |

Media editing requires the media tools to be available in your installation. In Cloud, edited files are saved to your asset library. The Agent returns a preview or file link in the conversation.

## Run permissions

Choose a run permission next to the message box:

- **Ask** requests approval before each workflow run.
- **Auto** runs workflows without asking for each run.

Select **Save changes** to apply your choice. In Ask mode, select **Run** in the approval message to start the workflow, or **Cancel** to decline that run.

Ask and Auto control workflow runs. The Agent can edit the selected workflow in either mode.
Comment thread
stale2000 marked this conversation as resolved.

## What the Agent can use

The Agent uses your message, selected workflow, selected nodes, attachments, and workflow errors. It can also read another workflow when you ask it to compare or reuse settings.

For Cloud and local data flow, chat history, and privacy controls, see [Comfy Agent data and privacy](/agent-tools/in-app-agent-data-privacy).

## Stop or cancel

Select **Stop** in the message box to stop the Agent's current response. Workflow execution has separate controls in the [run and queue area](/interface/overview); use those to manage a workflow that has already been submitted.

## Next steps

<CardGroup cols={2}>
<Card title="Comfy MCP" icon="bolt" href="/agent-tools/mcp">
Connect external MCP clients to ComfyUI for generation, search, and workflows.
<Card title="Make your first image" icon="play" href="/agent-tools/in-app-agent-installation#make-your-first-image">
Build, run, and revise an image workflow.
</Card>
<Card title="Agent Tools overview" icon="robot" href="/agent-tools">
Compare the cloud connection, the local connection, and the In-App Agent.
<Card title="Agent skills" icon="wand-magic-sparkles" href="/agent-tools/in-app-agent-skills">
Create and use reusable Agent instructions.
</Card>
</CardGroup>

## Feedback

Already in the alpha? Share bugs and impressions:

<Card title="Send feedback" icon="message" href="https://links.comfy.org/agentalphafeedback">
Report bugs or share impressions from the alpha.
</Card>
20 changes: 10 additions & 10 deletions agent-tools/index.mdx
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Agent Tools"
description: "Leverage AI agents to use ComfyUI smarter and faster. Comfy MCP, Comfy CLI, and the Comfy In-App Agent."
description: "Use ComfyUI with AI agents through Comfy MCP, Comfy CLI, and Comfy Agent."
sidebarTitle: "Overview"
icon: "robot"
---
Expand All @@ -9,8 +9,8 @@
<Card title="Comfy MCP" icon="bolt" href="/agent-tools/mcp">
Connect any AI agent to ComfyUI, on Comfy Cloud or on your own machine. **Start here.**
</Card>
<Card title="Comfy In-App Agent" icon="comments" href="/agent-tools/in-app-agent">
Agent experience inside Comfy Cloud (chat builds and edits your graph). *Private alpha; waitlist only for now.*
<Card title="Comfy Agent" icon="comments" href="/agent-tools/in-app-agent">
Built-in ComfyUI assistant for building, editing, and running workflows. *Private alpha; waitlist only for now.*

Check warning on line 13 in agent-tools/index.mdx

View check run for this annotation

Mintlify / Mintlify Validation (dripart) - vale-spellcheck

agent-tools/index.mdx#L13

Did you really mean 'waitlist'?
</Card>
<Card title="Comfy CLI" icon="terminal" href="/agent-tools/cli">
ComfyUI in the terminal. Install and update ComfyUI, manage models and nodes, and generate from scripts, CI, or batch jobs.
Expand All @@ -21,14 +21,14 @@

## Which one should I use?

| | Comfy MCP<br />Cloud Connection | Comfy MCP<br />Local Connection | Comfy In-App Agent |
| | Comfy MCP<br />Cloud Connection | Comfy MCP<br />Local Connection | Comfy Agent |
|---|---|---|---|
| **What is it** | Run Comfy Cloud workflows with your own agent. | Drive your own local ComfyUI with your own agent. | Chat with AI inside the app and watch it build and run workflows for you. |
| **Best for** | Beginners who don't want to set up ComfyUI locally.<br />People who want to share workflows. | People who have ComfyUI locally.<br />People who have private custom nodes.<br />People who need to interact with the local file system. | Everyone from beginners to advanced workflow builders.<br />People who want to see the canvas and check workflows visually. |
| **Requires** | Your own agent.<br />An active Comfy Cloud subscription. | Your own agent.<br />A local ComfyUI setup. | No setup.<br />An active Comfy Cloud subscription. |
| **GPU** | Cloud GPUs (no hardware requirements) | Your local GPU | Cloud GPUs (no hardware requirements) |
| **Models** | Comfy Cloud models.<br />You can import your own models. | Local models downloaded to your machine. | Comfy Cloud models.<br />You can import your own models. |
| **Custom nodes** | The custom nodes supported on Comfy Cloud. | You can install any custom node. | The custom nodes supported on Comfy Cloud. |
| **What is it** | Run Comfy Cloud workflows with your own agent. | Drive your own local ComfyUI with your own agent. | Chat with an Agent inside ComfyUI to understand, build, edit, and run a selected workflow. |
| **Best for** | Beginners who don't want to set up ComfyUI locally.<br />People who want to share workflows. | People who have ComfyUI locally.<br />People who have private custom nodes.<br />People who need to interact with the local file system. | Building and editing workflows while viewing the canvas. |
| **Requires** | Your own agent.<br />An active Comfy Cloud subscription. | Your own agent.<br />A local ComfyUI setup. | A Comfy account, private-alpha access, and a supported Cloud or local installation. |
| **GPU** | Cloud GPUs (no hardware requirements) | Your local GPU | Cloud GPUs for Cloud workflows. Local hardware for local workflows. |

Check warning on line 29 in agent-tools/index.mdx

View check run for this annotation

Mintlify / Mintlify Validation (dripart) - vale-spellcheck

agent-tools/index.mdx#L29

Did you really mean 'GPUs'?

Check warning on line 29 in agent-tools/index.mdx

View check run for this annotation

Mintlify / Mintlify Validation (dripart) - vale-spellcheck

agent-tools/index.mdx#L29

Did you really mean 'GPUs'?
| **Models** | Comfy Cloud models.<br />You can import your own models. | Local models downloaded to your machine. | Cloud or local models, depending on whether you use Comfy Cloud or Comfy Desktop. |
| **Custom nodes** | The custom nodes supported on Comfy Cloud. | You can install any custom node. | Cloud-supported nodes in Cloud. Local nodes in a supported local setup. |

Both MCP columns are the **same product and the same page**. See [Comfy MCP](/agent-tools/mcp) to pick one. You can connect both at once.

Expand Down
Loading
Loading