The author shares their experience renting MI300X GPUs, noting they are more affordable than H100s and have exceeded their expectations despite online opinions. They mention that ROCm 6.4 is now user-friendly right from the start, and they are willing to invest an extra 30 minutes in setup for a 20% cost saving. The author expresses interest in hearing about similar experiences from others working with AI workloads.
Source link
Ask HN: Who’s Leveraging AMD GPUs for AI Workloads?

Leave a Comment
Leave a Comment