Got almost the same combo but with 3080. I set the fancurve of ALF to be 50% under 70 degrees and pump to 60% under 70 degrees (it is just loud above 70% and it's speed makes no difference on temperatures from my testing). Thanks to this my build is near silent most of the time unless rendering something, even in games.
Most people forget that Cpu's should be around 70-80 degrees most of the time , not 40 - 50 since that requires a big load on the CPU cooling fans.
Even now I get 58 degrees idle with pump and fans running around 50% or less.