The rate limit for viewing media (especially that comes from remote instances) seems to be really strict. If you view a profile that happens to be media-heavy, you will inevitably run into images not loading and that's because your Mastodon instance is throwing 429s :/
The rate limit is really strict, you will hit it even by normal usage and without trying.