I'm the owner of the remote machine (host), but I've no control on the client machine.
Perhaps, there are subtle differences, like pyinput using discrete "jumps" on the mouse coordinates, and on the other hand, a real mouse is using an "continuous" movement.
I'm not looking for a comprehensive analysis of keyboard or mouse usage. I prefer to look for something very simple like these jumps, or a system flag.