Remotion AI: making videos with Claude and other agents
Many people now ask Claude Code or another coding agent to write Remotion videos. That works well for React layouts and UI. This page explains what an agent does with Remotion, where browser capture gets in the way, and when AgentFX is the better tool. AgentFX is an independent open-source project and is not affiliated with Remotion.
How agents make Remotion videos
A Remotion video is a set of React components. Rendering opens them in headless Chrome, captures every frame and passes the frames to FFmpeg. A coding agent such as Claude Code can write those components and run the render, and Remotion offers a skill and an MCP server for agents.
Where an agent hits the limits
Simulations. Fluid, rigid-body physics and fracture are not built in. The agent has to add a JavaScript or WebGL library and wire it up.
Time effects. Slit-scan, echo, time displacement and shutter motion blur need frames from before and after. A renderer that captures each frame on its own does not have those frames.
Render path. Every frame is a full page screenshot, and repeatability depends on the browser and the fonts installed.
When to use which
Stay with Remotion when your video is mostly React UI you already have, when you need the Remotion ecosystem and Lambda rendering, or when your team writes the code by hand.
Use AgentFX when the video needs effects such as fluid ink, physics, shatter, slit-scan or beat-synced motion, when you want identical frames for identical scripts, or when you want to render on your own CPU or GPU without a browser. The agent writes Reel Script, a compact text format, and AgentFX lints it, previews frames and renders natively. See the full comparison with Remotion and HyperFrames and how to make videos with Claude Code.
Every row of the image comes from a different moment. Needs the frames before and after, which a screenshot renderer never has.
FAQ
Can Claude Code make Remotion videos?
Yes. Claude Code can write Remotion's React components and run the render. AgentFX is an alternative when the video needs built-in simulations or time effects.
Is AgentFX part of Remotion?
No. AgentFX is a separate open-source project (Apache 2.0) by Levels in Linz, Austria, with its own script format and its own renderer.
Can I move a Remotion project to AgentFX?
Not as a drop-in. Remotion projects are React code; AgentFX uses its own script format. Agents write either quickly, so switching means describing the film again, not porting components.
Put an effects engine in your agent's hands.
AgentFX is open source under Apache 2.0. Clone it, build it, give the skill to your agent. Questions, ideas and effect requests are welcome on GitHub.