The Easiest Ways to Run LLMs Locally - Docker Model Runner Tutorial
Description
Download Docker Desktop: https://docs.docker.com/desktop/ Docker Model Runner Docs: https://docs.docker.com/ai/model-runner/ There's now an even easier way to run AI models locally other than using Ollama. Now Docker just released their model runner and this is a complete game changer for running models locally. Now, just like Ollama, you can manage, run and deploy models locally with OpenAI compliant API. And all of this is built right into Docker desktop. Want to make real money with coding? I share high-signal insights on careers, monetization, and leverage in my free newsletter. Join here and get my guide How to Make Money With Coding instantly: https://techwithtim.net/newsletter ⏳ Timestamps ⏳ 00:00 | Introducing Docker Model Runner 00:54 | System Requirements 02:19 | Setup/Install
22:54Embrace the Coming AI Revolution with Safe Local AI!Level1Techs69.2K views
25:14You Don't need to use Cloud AI! Switchyard and Nemotron 3.5 LightningLevel1Techs146K views
20:38AI Doesn't Have to be Giant Data Centers!Level1Techs22.3K views
14:31How To Run Private & Uncensored LLMs Offline | Dolphin Llama 3Global Science Network1M views
22:25Running Gemma 4 Local AIExplainingComputers126K views
13:22Set up a Local AI like ChatGPT on your own machine!Dave's Garage377K views
42:58Shawn Mills – Self Hosted AI in Your Business – 14:45 – 15:30Jack Spirko428 views
2:03Gemma 4 on the iPhone (local AI, no internet required)NetworkChuck892K views
10:49Running AI Agents Locally = Safe...? Think AgainDaniel Jindoo 71.2K views
3:51Run your own AI (but private)CodeWithHarry170K views
4:18OpenAI's nightmare: Deepseek R1 on a Raspberry PiJeff Geerling2.4M views
15:21Unlimited AI Agents running locally with Ollama & AnythingLLMTim Carambat243K views
10:49Is NVIDIA’s ChatRTX The Next Big Thing?Tech With Tim17.6K views
21:27Why you NEED to be running local AI models (FULL beginners guide)Alex Finn91.6K views