Local AI Explained | Hardware, Setup and Models
Description
In this video CJ guides you through the wide world of local AI. He shows how he set up his new 128GB memory mini PC and gives his overall impressions of running local models for basic tasks and coding. 00:00 - intro 01:03 - key terms / concepts 01:40 - we need gpus 02:16 - LLMs need a lot of VRAM 03:20 - model quantization 04:13 - where to find models 05:13 - GPU pricing 06:33 - unified memory PCs 10:58 - unboxing the mini pc 12:13 - fedora install / setup 13:28 - GTT memory configuration 14:04 - how to run local models 16:33 - how to download and find models 18:54 - impressions of basic prompting 20:31 - coding overall impressions 23:21 - conclusions GMKtec EVO-X2 AI Mini PC | https://amzn.to/4bbgdMg What is LLM Inference | https://huggingface.co/blog/Kseniase/ Large Language Models e
22:54Embrace the Coming AI Revolution with Safe Local AI!Level1Techs69.2K views
25:14You Don't need to use Cloud AI! Switchyard and Nemotron 3.5 LightningLevel1Techs146K views
20:38AI Doesn't Have to be Giant Data Centers!Level1Techs22.3K views
14:31How To Run Private & Uncensored LLMs Offline | Dolphin Llama 3Global Science Network1M views
22:25Running Gemma 4 Local AIExplainingComputers126K views
13:22Set up a Local AI like ChatGPT on your own machine!Dave's Garage377K views
42:58Shawn Mills – Self Hosted AI in Your Business – 14:45 – 15:30Jack Spirko428 views
2:03Gemma 4 on the iPhone (local AI, no internet required)NetworkChuck892K views
10:49Running AI Agents Locally = Safe...? Think AgainDaniel Jindoo 71.2K views
3:51Run your own AI (but private)CodeWithHarry170K views
4:18OpenAI's nightmare: Deepseek R1 on a Raspberry PiJeff Geerling2.4M views
15:21Unlimited AI Agents running locally with Ollama & AnythingLLMTim Carambat243K views
10:49Is NVIDIA’s ChatRTX The Next Big Thing?Tech With Tim17.6K views
21:27Why you NEED to be running local AI models (FULL beginners guide)Alex Finn91.6K views