Introduction
When people think of artificial intelligence in Hollywood, they often imagine deepfakes, synthetic actors, or AI-generated scripts and video. Headlines about Google’s Veo3, Pika Labs, Kling AI, or even the now-shuttered Sora 2 tend to focus on photorealistic clips and futuristic possibilities. But for freelance directors and cinematographers, the real revolution is happening quietly behind the scenes—not by replacing their artistic vision, but by automating the tedious, repetitive tasks that once consumed hours of their time. This how-to guide will walk you through the practical steps to integrate AI into your pre-production workflow, allowing you to focus on what truly matters: capturing the perfect shot. Whether you’re storyboarding a short film, planning a commercial, or experimenting with vertical series, these strategies will help you harness AI’s power without sacrificing creative control.
What You Need
- AI Image Generators: Tools like Midjourney, DALL·E, or Stable Diffusion for creating visual references.
- AI Video Generators (optional): Platforms such as Runway Gen-3, Pika Labs, or Kling AI for short-form clips.
- Screenplay or Concept Brief: A clear vision of your story, key scenes, and desired shots.
- Stable Internet Connection: Most AI tools are cloud-based and require reliable access.
- Time for Experimentation: AI outputs need refinement—expect to iterate multiple times.
- Team Input (optional): Collaborate with a cinematographer, director, or AI specialist (like those in the ASC AI committee) to align on style.
Step-by-Step Guide
Step 1: Identify Repetitive or Time-Consuming Tasks
Before jumping into AI, audit your pre-production workflow. Common pain points include:
- Creating hand-drawn storyboards or mood boards.
- Searching for reference images from libraries or online sources.
- Adjusting shot lists for camera angles, lighting, and composition.
- Negotiating with clients or stakeholders about visual style.
As Michael Goi, former president of the American Society of Cinematographers (ASC), noted during a seminar last year, the initial fear that AI would completely replace jobs has been overblown. Instead, AI excels at removing “the more tedious jobs” that distract from creative decisions. By pinpointing these bottlenecks, you can target the tools that offer the greatest efficiency gains.
Step 2: Choose the Right AI Tools for Your Needs
Not all AI tools are created equal. For pre-production, focus on image generation platforms rather than full video AI, because current video generators still struggle with consistency—a fact demonstrated when Goi, cinematographer Caleb Deschanel, and AI creator Ellenor Argyropoulos tried to use AI to create a specific shot. “It was a struggle to even get close,” Goi recalled. For now, image tools like Midjourney are more reliable for storyboards and visual references. If you’re working on short-form vertical series (e.g., TikTok or Instagram Reels), consider testing video generators like Pika Labs or Runway Gen-3, which can produce clips up to two minutes in 4K quality. These are ideal for microdramas like the viral Fruit Love Island—an AI-generated “fruit slop” series that amassed 300 million views in nine days before being flagged for low quality. Each two-minute episode reportedly took around three hours to make, combining text-to-script tools with AI video generation.
Step 3: Generate Visual References and Storyboards
Once you’ve selected your tool, feed it your creative brief. Start with detailed text prompts that describe the scene’s mood, lighting, camera angle, color palette, and key elements. For example: “Low-angle wide shot of a futuristic city at dusk, neon blue and magenta lighting, film grain texture, cinematic aspect ratio 2.39:1.” Iterate: tweak the prompt based on outputs. Use the variations to create a visual library that your team can review. Rob Berry, a freelance cinematographer who has worked with Bergdorf Goodman and Nordstrom, recalls his first encounter with AI-generated storyboards as a breakthrough. “It allowed me to show clients exactly what I envisioned, without spending days on sketches,” he explained. Save your best generations as JPEGs or PNGs and organize them by scene.
Step 4: Test for Consistency Across Scenes
One of the biggest hurdles to AI adoption in filmmaking is consistency—maintaining the same characters, lighting, and style across multiple shots. To address this:
- Use consistent seed numbers or style reference images (where available) in your AI tool.
- Create a “style guide” document with key visual parameters (e.g., lens type, depth of field, color temperature).
- Compare outputs side by side. If they diverge, adjust prompts and retry.
Even with these techniques, expect some variation. That’s okay—AI storyboards are meant to be a starting point, not the final frame. Use them to communicate the essence of the shot to your crew, not to dictate every pixel.
Step 5: Integrate AI into Your Existing Workflow
AI doesn’t replace your expertise—it enhances it. Incorporate AI-generated materials into your traditional pre-production tools:
- Import storyboards into editing software (e.g., Adobe Premiere, DaVinci Resolve) to create animatics.
- Share visual references with the director of photography and gaffer for lighting plans.
- Use AI-produced mood boards in client presentations to align expectations.
- If you’re experimenting with short-form content, consider using AI to rapidly prototype multiple versions of a scene before committing to a live shoot.
Goi, now co-chair of the ASC AI committee, emphasizes that the real gains come from efficiency. “You can iterate on ideas in minutes instead of days,” he said during a recent panel. This agility is especially valuable on tight budgets and fast-turnaround projects.
Step 6: Stay Updated and Collaborate
The AI landscape evolves rapidly. To avoid falling behind:
- Follow industry groups like the ASC AI committee, which often preview new models before public launch.
- Attend workshops or webinars (many are free) to see live demonstrations of tools in action.
- Network with other filmmakers who are testing AI—learn from their successes and failures. For instance, the team behind Fruit Love Island quickly learned that quality flags can halt momentum, so balance speed with quality control.
- Experiment with new features as they roll out, but always test against your creative standards before using them for client work.
Remember: the goal is not to replace your artistry, but to free up time for the creative decisions that only a human director or cinematographer can make—like how to frame an emotionally charged close-up or how to adjust lighting to match the actor’s performance.
Tips for Success
- Maintain human oversight: Use AI as a collaborative partner, not an autopilot. Review every output critically.
- Focus on pre-production: AI storyboards are excellent for planning, but rely on your on-set expertise for execution.
- Don’t chase trends blindly: Not every viral AI technique suits your project. Stick to tools that serve your story.
- Document your process: Save effective prompts and settings for future projects. Build a personal library of go-to references.
- Collaborate with specialists: If AI feels overwhelming, consult experts like those in the ASC AI committee or hire an AI artist part-time for specific tasks.
- Respect copyright: Always check the terms of use for AI-generated assets, especially when using them in commercial work.
By following these steps, you can join the growing number of directors and cinematographers who are quietly revolutionizing their workflows—not by surrendering to AI, but by mastering it as a tool for creativity, efficiency, and precision. The future of filmmaking isn’t about machines taking over; it’s about humans using smarter tools to tell better stories.