My DIY OPNSENSE router, built on an old-arse AMD dual core handles 10 gigabit just fine. https://lydie.cc/opnsense-router.html #homelab
It runs hot though! But it was free.
My DIY OPNSENSE router, built on an old-arse AMD dual core handles 10 gigabit just fine. https://lydie.cc/opnsense-router.html #homelab
It runs hot though! But it was free.
41 dead terabytes. Life of a data hoarder! Bytes lost = 0. RAID used = none (everything is fully mirrored 3 times). #selfhosted #selfhosting #homelab #harddrives
Four TESLA P100 16GB HBM2 GPUs have been ordered for the Solar Powered LLM Server V2.0.
Total spend was around $700 for the components on eBay. I think I'll stripe 5 HDDs I find in a box to store models.
The idea is highest quality model and fastest tokens per second so when I ask my smart speakers to do automation things, it's faster. Not that the current server is bad in any way.
https://www.lydie.cc/solar-ai-server.html
#homelab #homeassistant #hermesagent #llm #localai #selfhosted #selfhosting
Oh no
I could not resist grabbing this sucker for $400 bucks. I feel like I stole it. So I guess with 80 PCIe 3 lanes (4 full length slots) and I can stuff 512GB of DDR3 in (16 DIMM slots!), I could load 4x GPUs in there.
So, which ones? Me thinks 4x Tesla P100 16GB GPUs are being bidded on now.
-2x Intel Xeon E5-2620 V2 Processor
-64 GB DDR3 (I will make it 128 methinks)
-ASUS Motherboard: Z9PE-D16
-1100w Power Supply
-ASUS Blu-Ray MDISC Burner
Might end up selling my 2080 ti LLM server if this can crank out serious tokens per second with a big arse LLM