Runway’s Motion Sketch: AI Video Generation Gets a Doodling Upgrade

Runway’s latest innovation, Motion Sketch, is turning heads in the AI video generation space by letting users create dynamic video content simply by sketching on top of still images. This new feature represents a significant shift in how AI-generated video can be created, moving beyond text prompts to embrace visual, intuitive input.

How It Works

Motion Sketch allows users to upload an image and then draw directly on it to indicate movement. Users can sketch arrows, shapes, or other visual cues to guide the AI in animating their scene. The system interprets these doodles and generates a short video clip based on the implied motion.

The process is straightforward:

1. Upload or generate a still image
2. Use the sketch tool to draw motion indicators (arrows, paths, etc.)
3. Select your preferred video model (Gen-4.5, Veo 3, or Veo 3.1)
4. Generate the video

Real-World Testing

ZDNET’s testing revealed both the impressive capabilities and current limitations of Motion Sketch. In one experiment, a simple doodle of bird-like shapes and directional arrows transformed a static image of settlers and bison into a dynamic scene where the family flees from winged creatures.

However, the technology isn’t perfect. When tasked with animating a snake sketch, the AI initially struggled, creating multiple snakes and even adding alligator-like feet. These glitches highlight that while Motion Sketch is powerful, it still requires some trial and error to achieve desired results.

Why It Matters

Motion Sketch could be a game-changer for creative professionals who think more visually than verbally. As Runway Product Manager Aditi Poduval explained, “We’re helping people get precise movement without needing to craft a specific written prompt.”

This visual approach to video generation could democratize AI content creation, making it more accessible to those who struggle with prompt engineering or prefer hands-on creative control.

Access and Pricing

Motion Sketch is available to Runway subscribers with at least a Standard plan ($12 per user per month), which includes 625 monthly credits. Users can access it through the Runway app by selecting “Motion Sketch” from the available tools.

The Future of AI Video

While Motion Sketch still has room for improvement, it represents an exciting evolution in AI video generation. By bridging the gap between imagination and production through intuitive visual input, Runway is pushing the boundaries of what’s possible with generative AI.

AI video generation
Motion Sketch
Runway AI
text-to-video
generative AI
creative technology
AI animation
visual AI tools
digital art
content creation

Game changer for creators
Absolute game changer
This is what I’ve been waiting for
Drawing your vision then watching it render
Lower the barrier between imagination and production
Exciting preview of what the future might hold
Visual approach to video generation
Intuitive creative control
Trial and error with AI
Pushing the boundaries of generative AI

,