Checking the routing to the game server IPs after changing DNS , showed no difference. This maybe another issue. It's like over time the responsiveness degrades and after the change its back to what it should be.
Could it be something the server end? I have seen suspected DNS rebinds in the past...