Hand pose and depth on every kitchen frame
“Label hands and depth on every frame of my kitchen picks”
Tell the Action Agent what your episodes need. It plans the steps, picks the models, asks before it runs, and hands back labeled and multiplied data for training robots.
You describe it. The agent plans it. You approve it. It runs.
Attach your episodes or pick a sample, then say what you need in plain words: label, segment, relight, retarget, find.
The agent picks the action and model and shows you exactly what will run. Nothing starts until you approve it.
Steps and progress stream in live. Results land next to your source, ready to inspect, compare and export.
01 / 09
›“Label hands and depth on every frame of my kitchen picks”
›“Segment every part and both hands in the assembly episodes”
›“Make cluttered versions of each household episode”
›“Add depth to all of my gameplay runs”
›“Segment the vehicles in every drone flight”
The agent chooses from the same actions you can run by hand in the Studio, and picks a model for each one. Ask for one, or chain several over the same capture.
An AI agent for robot and Physical AI video data. You describe the job in plain words, and it plans the steps, chooses the action and model, and runs it on your episodes once you approve.
Anything you can run in the World Actions Studio: segmentation, depth maps, hand, body and face landmarks, gesture detection, cleanup, search, analysis, diffusion for new scenes, and image to simulator.
No. It can read your datasets and check models on its own, but every run waits for you to approve it, and you can change the model before you do.
Runs are on us for now. Attach your own episodes or start with a sample dataset at no cost.
Yes. Add the World Actions MCP server to Claude, Cursor, Windsurf or any MCP client and ask it to run actions on your datasets from there.
Yes. Results stay next to your source in the Studio, and you can export datasets to LeRobot, RLDS, MCAP, ROS 2 bags or HDF5.
Start with a sample or your own episodes. Runs are on us for now.