Reduce the noise in your duct work by adding a silencer.
They absorb the noise created by fans and from the air hitting the sides of the duct work.
Silencers remove a lot of unwanted noise; two can be used in series where unwanted noise is a particular problem.