I upgraded to the newest firmare 3 hours ago, which obisously leads to a reboot. But the problem is already there again. Will still try to reboot at night, maybe it will help...
Update: So I do a reboot of the rooter now every night at 2am and it actually seems to fix the issue. Thanks!