@N1ghtTheF0x,

I would first go through all of the Power Mode Settings on your PC. Oftentimes, the USB ports will have energy-saving modes, or will put the USB port to sleep after a while. It is possible that this is causing only your devices to receive power. There should be an option along the lines of "Allow the Computer to Turn off This USB to Save Power"

I would imagine that your other USBs see a momentary outage as your PC renegotiates with the adapter to accommodate the network. Hopefully, changing the power setting will prevent the disconnect from happening in the first place.

You may also try using the default windows drivers, rather than the drivers provided through TP-Link's site to see if there is any difference.