Similar problem here.
In February 2020 I replaced my gas water heater with a new one. Also installed a new gas feed line and shutoff valve. Since then, whenever the burner turns on, the water heater hums (not too loudly) for about 5 seconds, then the hum tapers off. No idea what's causing it...