The HARD Truth About Hosting Your Own LLMs
Description
Hosting your own LLMs like Llama 3.1 requires INSANELY good hardware - often times making running your own LLMs completely unrealistic. But I have a strategy that I reveal in this video for how to start cheap with self-hostable LLMs and then continue on to scale with them infinitely as your app/business grows... 00:00 - 02:58 - The Problem with Local LLMs 02:59 - 03:35 - The Strategy for Local LLMs 03:36 - 08:02 - Exploring Groq's Amazingness 08:03 - 13:59 - The Groq to Local LLM Quick Maths 14:00 - 14:43 - Outro ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Services I mentioned in this video (I am not sponsored by any of them): Groq: https://groq.com/ RunPod: https://www.runpod.io/ DigitalOcean: https://www.digitalocean.com/ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Artificial Intelligence is no
16:38Level1 Presents: THE FORBIDDEN ROUTERLevel1Techs170K views
20:08Level1: We bootstrapped our own ZFS storage server: 172tb, extremely low costLevel1Techs381K views
3:07Easy: How To Set Up Your Own Surveillance System in LinuxLevel1Linux116K views
16:23DON'T Use Raspberry Pis for Servers! (Use THIS)Hardware Haven1.6M views
19:36Build a Router 2016 Q4 -- pfSense BuildLevel1Techs493K views
13:35Quadro P2000 hardware Transcoding in plexSloth Tech TV67K views
40:27Getting Started with Homelabing in 2026Level1Techs387K views
6:19Routers Suck. Build Your Own Instead!Techquickie1.2M views
46:39I Spent a Year Replacing My Subscriptions. Here’s How.Dammit Jeff1.8M views
8:23I Self-Hosted Everything for Years… Here’s the Truth Nobody Tells YouKeepItTechie6.9K views
16:53The $0 Home ServerKalos Likes Computers1.7M views
1:56:33Jesse Markowitz on the Start9 User Experience - Bitcoin Breakout Epi-18Jack Spirko719 views
11:07Your Old PC is Your New ServerLinus Tech Tips6.9M views
26:36You NEED to Use n8n RIGHT NOW!! (Free, Local, Private)NetworkChuck2.7M views