thebatfink; indeed, anything worth learning takes time, when it isn't given away. Without intending to seem preachy, you'll find you can increase your skill level, become more confident and learn more, even though everyone wants what they want, as soon as yesterday. Keep researching the wiki/forums, and you'll reach a moment when you'll see the answer you need without having to wait for anyone to get back to you. Many members help and lend a great deal of their time and expertise when they can, but between families, work and projects, pointing someone in the right direction is all that's needed. Almost anything that can be asked on a subject has been, and is answered in many ways. Best advice, to keep honing your search-fu skills, use the forum search tool and your regular search engine. Simple, short questions with various phrasing helps you locate relevant answers faster, so don't become discouraged.
Martineau is spot on, and you should be able to get this done using the router GUI, unless I've misread the intent of your post. You've probably already done this; go to the LAN tab, and under DHCP Server, at the bottom of the page, use Manually Assigned IP around the DHCP list (Max Limit: 128), and using the drop down menu, assign/apply each of your devices/MACs within the IP address range for your OpenVPN clients. You -can- list quad9, google or whatever in WAN, but be sure to tick the 'no' box, so your WAN /ISP doesn't automatically assign theirs. Your OpenVPN client will either append or ignore those you list to theirs or not. If you don't want any fall-back DNS at all, to reduce the chances of leaks, you don't hate to list any DNS servers in the WAN or LAN DHCP server tabs. Your VPNs DNS is part of their config, unless I've misconstrued what you want to do with the GUI.
This makes it quick/easy to locate/route the devices in your OpenVPN clients, and Martineau's advice saves you having to look that info up. If one of your OpenVPN tunnel goes down, you should know very quickly since your traffic will come to a screeching halt, so you many wish to have a spare OpenVPN config/tunnel or two ready to be loaded in case of emergency. Depending on how many OpenVPN configs/tunnels are available in your router model's firmware, all you may have to do is turn off the tunnel that's gone down, then turn on the standby OpenVPN config, after you reassign the devices to it. Didn't mean to go on so, and hope this is relevant to your situation. Good luck and Cheers.