So I ended up doing an exchange, and the noise is still present. This time however, the noise is there on both bands 2.4GHz and 5GHz, I suspect this may have something to do with the stock firmware (I was using DD-WRT Kong build for my previous one and could only hear any noise on the 5GHz)...