Fine-Tune Your Own A.I. Video Model (ft. Greg Schoeninger)

About this episode

This episode features Greg Schoeninger discussing AI fine-tuning for image and video models, including strategies for building datasets and deploying specialized models.

Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX Unlock the power of AI fine-tuning for image and video models with Greg Schoeninger, CEO of Oxen.ai. In this episode, we explore how to move beyond simple prompt engineering to training custom open-source models for as little as $1. Discover the technical strategies for building high-quality datasets, the trade-offs between LoRAs and full fine-tunes, and how to achieve consistent characters and styles in generative video. We dive into real-world examples, including how to generate massive product catalogs for a fraction of the cost of enterprise APIs and the story behind the viral "Isometric NYC" project built with Claude Code. Greg breaks down the entire AI lifecycle—from data curation and labeling with Vision Language Models (VLMs) like Qwen and Gemini to deploying efficient, specialized models that outperform general-purpose giants. Whether you are looking to optimize GPU costs, automate video workflows, or build your own AI tools, this conversation provides the blueprint for scaling your AI capabilities. Links from the episode: Oxen AI: https://www.oxen.ai/ Fine Tuning Fridays: https://luma.com/oxen Isometric…

People in this episode

Host: Mike Bird

Guest: Greg Schoeninger

Topics covered

• AI fine-tuning
• image and video models
• custom open-source models
• dataset building
• generative video
• AI lifecycle
• GPU cost optimization

Keywords

• AI fine-tuning
• video models
• dataset building
• LoRAs
• generative video
• GPU optimization
• custom models

Mentioned in this episode

Organizations: Oxen.ai, Tool Use, Claude Code, Vision Language Models, Qwen, Gemini

Books & works: Isometric NYC

Places: NYC

More episodes of Tool Use - AI Conversations

• Hermes Agent has won. Here's why · April 14, 2026 · 35 min
• How To Make Your Websites Fully Autonomous (ft rtrvr) · March 17, 2026 · 42 min
• How To Make Your A.I. Product Go Viral (ft Mano Tsiris) · March 10, 2026 · 47 min
• How To Build a Hybrid AI System with Any-LLM (ft Nathan Brake) · March 3, 2026 · 44 min
• AI Sovereignty - Control Your Entire AI architecture (ft Max McCrea) · February 24, 2026 · 1h 6m
• Do You Need A Vector Database in 2026? (ft Arjun Patel) · February 17, 2026 · 59 min