github →

New request

#21125: AI Assistant Chat : Attach images to discussions

We'll provision a sandbox, run an agent against the issue, and open a draft PR. You can pull the branch and iterate from there.

Issue

Scope & Context

We want to enhance the AI assistant's capabilities by allowing users to copy and paste multiple images directly into the chat. This feature aims to enable the AI to perform visual data extraction to automatically populate and update record fields based on the provided images (e.g., property details, invoices, business cards, or floor plans). It could also provide more context in any conversation.

Current behavior

Currently, the AI assistant chat interface primarily accepts text input. Users cannot copy and paste multiple images directly into the chat to provide visual context for data entry. If a user has an image containing data they want to encode into a record, they must manually read the image and type the information out themselves.

Expected behavior

Users should be able to paste (Ctrl+V or Cmd+V) one or multiple images from clipboard or files directly into the AI assistant chat input box. The pasted images should appear as small thumbnails above or within the input field before sending. Once sent, the AI should be able to analyze the images (using vision models), extract the relevant data, and seamlessly encode or update the information into the currently viewed record (like a Property record) or create new records.

Technical inputs

  • Modify the AI chat input component to listen for paste events and intercept e.clipboardData containing image files (image/*).
  • Implement an image upload mechanism to store these images (either temporarily or as standard attachments linked to the message thread).
  • Update the UI to display thumbnail previews of the pasted images with a "remove/delete" button before submission.
  • Update the AI integration backend to support multimodal inputs (e.g., passing image URLs or base64-encoded images to the LLM vision API).
  • Ensure the AI system prompt and tool definitions are equipped to handle visual data extraction and map it correctly to the workspace's metadata to perform update or create mutations.
Assessmentadvisory
feature●● medium90% confidence

New user-facing capability to paste images into AI chat requiring frontend clipboard handling and backend vision-model integration.

Likely files
  • packages/twenty-front/src/modules/ai/components/AIChatInput.tsx
  • packages/twenty-front/src/modules/ai/hooks/useAIChat.ts
  • packages/twenty-server/src/engine/core-modules/ai/ai.service.ts
  • packages/twenty-server/src/engine/core-modules/file/file-upload.service.ts
Create the request

This opens a fresh agent run and a draft PR for issue #21125.

Cancel