#techroi — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #techroi, aggregated by home.social.
-
Running local LLMs makes no sense unless you have a steady workload to feed them. Otherwise your hardware costs pile up while utilization stays low, and the ROI is poor.
Good as a learning exercise, and there’s been plenty of tuning involved, but in real coding work it’s largely impractical. It does fit lightweight tasks that must run locally for privacy reasons.
Recommendation: start by practicing on your own hardware. If you find it too slow and don’t want to invest, rent a GPU setup to test whether a bigger hardware investment would be worth it: https://upcloud.com/products/gpu-servers/
#LocalLLM #SelfHosted #AI #MachineLearning #GPU #Infrastructure #TechROI #DevOps
-
Running local LLMs makes no sense unless you have a steady workload to feed them. Otherwise your hardware costs pile up while utilization stays low, and the ROI is poor.
Good as a learning exercise, and there’s been plenty of tuning involved, but in real coding work it’s largely impractical. It does fit lightweight tasks that must run locally for privacy reasons.
Recommendation: start by practicing on your own hardware. If you find it too slow and don’t want to invest, rent a GPU setup to test whether a bigger hardware investment would be worth it: https://upcloud.com/products/gpu-servers/
#LocalLLM #SelfHosted #AI #MachineLearning #GPU #Infrastructure #TechROI #DevOps
-
Running local LLMs makes no sense unless you have a steady workload to feed them. Otherwise your hardware costs pile up while utilization stays low, and the ROI is poor.
Good as a learning exercise, and there’s been plenty of tuning involved, but in real coding work it’s largely impractical. It does fit lightweight tasks that must run locally for privacy reasons.
Recommendation: start by practicing on your own hardware. If you find it too slow and don’t want to invest, rent a GPU setup to test whether a bigger hardware investment would be worth it: https://upcloud.com/products/gpu-servers/
#LocalLLM #SelfHosted #AI #MachineLearning #GPU #Infrastructure #TechROI #DevOps
-
Running local LLMs makes no sense unless you have a steady workload to feed them. Otherwise your hardware costs pile up while utilization stays low, and the ROI is poor.
Good as a learning exercise, and there’s been plenty of tuning involved, but in real coding work it’s largely impractical. It does fit lightweight tasks that must run locally for privacy reasons.
Recommendation: start by practicing on your own hardware. If you find it too slow and don’t want to invest, rent a GPU setup to test whether a bigger hardware investment would be worth it: https://upcloud.com/products/gpu-servers/
#LocalLLM #SelfHosted #AI #MachineLearning #GPU #Infrastructure #TechROI #DevOps
-
Running local LLMs makes no sense unless you have a steady workload to feed them. Otherwise your hardware costs pile up while utilization stays low, and the ROI is poor.
Good as a learning exercise, and there’s been plenty of tuning involved, but in real coding work it’s largely impractical. It does fit lightweight tasks that must run locally for privacy reasons.
Recommendation: start by practicing on your own hardware. If you find it too slow and don’t want to invest, rent a GPU setup to test whether a bigger hardware investment would be worth it: https://upcloud.com/products/gpu-servers/
#LocalLLM #SelfHosted #AI #MachineLearning #GPU #Infrastructure #TechROI #DevOps