VDAOvideo

I'm Obsessed With Local AI. Here's Why

Greg Isenberg · 505K views · 2 months ago
Description

I run this episode solo. I explain local AI in plain terms: the model runs on hardware I control, and a cloud model runs somewhere else. I map the four pieces of the local AI landscape — the model, the warehouse, the software, and the workflow — and I define the words that beginners meet first: parameters, tokens, context window, quantization, and GGUF. I walk through the Google open model stack (Gemma 4, Google AI Edge, LiteRT-LM, AI Edge Gallery), compare the other open model families, and show three ways to run a model today. I close with a first workflow you can copy and three startup ideas that use local AI as the wedge. And a special thank you to Google for supporting the podcast. Get the full guide to running local AI: https://startup-ideas-pod.link/local-ai Timestamps 00:00 –