No they don't.
I've done some more googling and found what I believe is the culprit. The "Windows Connect Now - Config Registrar" service. It's been present since Windows 8, and it's Microsoft's implementation of WPS configuration for your access point from within Windows. Since disabling the service, no more random devices have popped up.
Some of the links I found with people who have the same issue as me, but on Windows 8:
http://forums.digitalspy.co.uk/showthread.php?t=1778660
http://www.eightforums.com/network-sharing/12630-someones-phone-connected-my-network-why-how.html
http://answers.microsoft.com/en-us/...n/2c61616e-bcbc-4a7a-9a66-eab68fae84cd?page=3
I'm not sure what exactly causes the devices to show, maybe they are trying to connect to my network or maybe they are just in my area and Windows is able to discover them through the router with this WPS service.
None of these devices actually showed up in my routers logs at all, so I'm pretty confident my network is in fact secure. Thanks for the help guys, hopefully at the very least if anyone else faces this issue this post helps.
nice find.
seems as silly as the windows 10 feature to auto connect to wifi networks.