Posted by admin

Dave installs Deepseek on a Jetson Orin Nano and a Threadripper and explores the self-hosted editions of Deepseek R1 and evaluates their performance on a wide range of hardware. Free Sample of my Book on the Spectrum: https://amzn.to/3zBinWM Secrets of the Autistic Millionaire: https://amzn.to/3WNDDkJ Watch ShopTalk Now on Dave's Attic: https://youtu.be/5Emgx0lhllE Follow me on X: https://x.com/davepl1968 Facebook: https://www.facebook.com/davepl Introduction to the Affordable NVIDIA Jetson Orin Nano Super: 00:00 Why Run AI Locally?: 00:31 Advantages of Self-Hosted AI: 01:02 Jetson Nano Specifications: 01:33 Setting Up DeepSeek R1 with Olama: 02:04 Privacy Benefits of Local AI: 03:06 Running Queries Locally: 03:57 Use Cases for Home Automation: 05:09 Cost-Effectiveness of Jetson Nano: 05:40 Reasoning Models vs Traditional LLMs: 06:42 7B Parameter Model Performance Review On Affordable Jetson Orin Nano: 8:53 Running the full DeepSeek-R1 671B on $10,000+ machine 9:20 Outro - 11:58