@jzdechlik 

Are both computers on the same network or are you remoting in from the outside and the desktop sits in the Deco network?

@jzdechlik No, they aren't.  I'm RDP-ing into my computer at work, which I've done for years with the same setup (less the Deco) and haven't had any problems.

It seems like an intermittent connection thing as opposed to a speed thing.  I am connecting to the Deco wirelessly, of course.  It is wired into my cable modem.

@jzdechlik 

Rather than connecting wirelessly have you tried wiring to the second Ethernet port of the Deco? Does the same issue still happen?

What you can also try is disabling SIP ALG (More > Advanced > SIP ALG).

If you have multiple nodes your computer may be jumping to different nodes. If possible turn off the other nodes as well and see if just one node works fine.