Give your agents media

Feature film0:54Mac · iPhone · Linux

Chapters

  1. 0:00The problem
  2. 0:07Hand it the picture
  3. 0:12Paperclip and drag & drop
  4. 0:16The annotation editor
  5. 0:24Upload to your host
  6. 0:30Notes in the prompt
  7. 0:38On your phone
  8. 0:44Mark them up on the phone

Your agent runs on your machine, often far away, and it can’t see your screen. Describing a misaligned button in words takes a paragraph, and the agent still guesses which one you meant.

Offsite hands it the picture. Drop files on the agent’s card or use the paperclip; on the iPhone, pick screenshots, take a photo or choose any file. Every image opens in the annotation editor: circle it, add an arrow, write one line per number. The files land on your host, even a Linux box in the cloud, and the agent gets the paths and your notes in its prompt, sent when you press Enter.

Tips

  • Send several images at once: each keeps its own markers and notes in the strip.
  • Marker 0 is for the sentence about the whole image.
  • Without a comment, only the paths go in. The drawing is still burned into the image.
  • Use annotation in the editor is the same switch as Settings › Annotate images before sending.
Transcript