#mi325 — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #mi325, aggregated by home.social.
-
First #AI #Benchmarks Pitting #AMD Against #Nvidia
Results are good in that they show #MI300X is absolutely competitive with H100 #GPU on one set of AI inference benchmarks, and based on our estimates of GPU and total system costs can be competitive with Nvidia’s H100 and #H200. But, tests only done for #Llama2 #LLM model from Meta with 70 billion parameters.
A lot will depend, on how AMD prices #MI325 later this year and how many AMD can get its partners to manufacture.
https://www.nextplatform.com/2024/09/03/the-first-ai-benchmarks-pitting-amd-against-nvidia/ -
First #AI #Benchmarks Pitting #AMD Against #Nvidia
Results are good in that they show #MI300X is absolutely competitive with H100 #GPU on one set of AI inference benchmarks, and based on our estimates of GPU and total system costs can be competitive with Nvidia’s H100 and #H200. But, tests only done for #Llama2 #LLM model from Meta with 70 billion parameters.
A lot will depend, on how AMD prices #MI325 later this year and how many AMD can get its partners to manufacture.
https://www.nextplatform.com/2024/09/03/the-first-ai-benchmarks-pitting-amd-against-nvidia/