Krotos has expanded its Video to Sound platform with automatic footsteps and cloth Foley, enabling editors to add Foley directly from video using AI-assisted visual analysis to interpret movement, pacing and scene context.
Traditionally, syncing footsteps and cloth movement to picture has required painstaking manual work, from lining up individual sounds to constantly adjusting timing as edits change. Building on Video to Sound’s existing ambience-based workflow, this update brings those same time-saving principles to Foley, extending automatic video-to-sound beyond backgrounds and into physical movement.
Able to place realistic footsteps and cloth sounds in sync with picture, the process preserves full creative control for refinement in a DAW or NLE.
With Video to Sound footsteps, users can quickly apply realistic footstep sounds that follow on-screen movement without manual syncing. By selecting the appropriate walking surface – such as tile, gravel or wood – the system applies professionally recorded footstep sounds that match the pacing and action of the scene. Footstep ‘performances’ can also be exported as Midi to refine timing or integrate them into Krotos Studio or a broader DAW-based workflow.
The update also introduces automatic cloth Foley. By analysing motion and changes in movement, Video to Sound applies context-aware cloth sounds that reflect subtle shifts, turns, and layered action in a single pass. Users can audition and balance individual layers in the browser before exporting them for use in a preferred DAW or NLE.
Video to Sound is available now as part of Krotos Studio.