VDAOvideo

The Easiest Ways to Run LLMs Locally - Docker Model Runner Tutorial

Tech With Tim · 112K views · 1 year ago
Description

Download Docker Desktop: https://docs.docker.com/desktop/ Docker Model Runner Docs: https://docs.docker.com/ai/model-runner/ There's now an even easier way to run AI models locally other than using Ollama. Now Docker just released their model runner and this is a complete game changer for running models locally. Now, just like Ollama, you can manage, run and deploy models locally with OpenAI compliant API. And all of this is built right into Docker desktop. Want to make real money with coding? I share high-signal insights on careers, monetization, and leverage in my free newsletter. Join here and get my guide How to Make Money With Coding instantly: https://techwithtim.net/newsletter ⏳ Timestamps ⏳ 00:00 | Introducing Docker Model Runner 00:54 | System Requirements 02:19 | Setup/Install