The trick with cooling is to ensure you have a smooth flow of air from one part of the case to the other, preferably opposite sides. Make sure your CPU coolers are blowing in the same direction as well.

It’s a little difficult to see from this image, but it looks like you have almost all your fans - intake and outlet - on one end of the case. This could create a big dead zone at the rear of your case. Especially for your GPU, sandwiched between CPU cooler and PSU. What I would do is move one or more of those fans to the rear, make sure front, rear, and CPU fans are all blowing in the same direction, and see if that helps any.

With every month that passes, I feel ever more infuriated that so many of the programs I use are essentially hard-locked to Nvidia, with frankly miserable performance on other GPUs. Not the cards’ fault, the software devs’ fault for - when they even bother at all - doing a piss-poor job of integration with other GPUs.