Everyone assumes the 2013 "Trash Can" Mac Pro is useless for local AI (dead ROCm, radeon driver, no AVX2).
I forced amdgpu Vulkan across both FirePro D500s, enabled 2MB Huge Pages (+60%), and beat a StarFighter Ultra 5 & 8GB MacBook Neo on 1.5B-14B token gen + 32B capacity!
Watch + trash-top: https://youtu.be/-pYbBmB14Sk
Ad-free PeerTube: https://tube.devwithzachary.com/w/mtVRJmHpBTz2Gg2X5ky5L6