home.social

#macpro — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #macpro, aggregated by home.social.

  1. Everyone assumes the 2013 "Trash Can" Mac Pro is useless for local AI (dead ROCm, radeon driver, no AVX2).

    I forced amdgpu Vulkan across both FirePro D500s, enabled 2MB Huge Pages (+60%), and beat a StarFighter Ultra 5 & 8GB MacBook Neo on 1.5B-14B token gen + 32B capacity!

    Watch + trash-top: youtu.be/-pYbBmB14Sk
    Ad-free PeerTube: tube.devwithzachary.com/w/mtVR

    #Linux #MacPro #LocalAI #SelfHosted

Share on Mastodon

Enter the server where you have an account.