VDAOvideo

Learn Local AI in 30 Minutes - Run LLMs locally for FREE

Dave Ebbelaar · 20.8K views · 6 days ago
Description

Build your freelance career with me: https://go.datalumina.com/yCHk1GX 📘 Guide to follow along: https://learn.datalumina.com/docs/local-chat 🔗 Code for the app: https://github.com/daveebbelaar/local-chat 🎙️ Get one free month of Glaido Pro: https://get.glaido.com/dave ⏱️ Timestamps 00:00 Intro 00:55 Run local AI with Ollama 04:08 How local models work 09:04 The Ollama API 10:56 Tauri and the app 13:59 Connect Ollama 19:19 Apple's model 20:36 Code mode with Pi 24:41 Bundle the app 27:43 What to build next 📌 Description In this video, I show you everything you need to know about local AI by building a desktop chat app that runs open models on your own laptop. We set up Ollama, learn how memory, quantization and mixture of experts decide which models you can run and how fast, and build the app with Tauri, a Rust back end and a React front end, with an AI coding agent doing most of the work. Then we turn it into a local coding agent with the Pi harness, bundle it as a real macOS app, and look at what local AI is already good for today. 👋🏻 About Me Hi! I'm Dave, AI Engineer and founder of Datalumina®. On this channel, I share practical tutorials that teach developers how to build production-ready AI systems that actually work in the real world. Beyond these tutorials, I also help people start successful freelancing careers. Check out the links above to learn more!