To achieve a better experience when interacting with devices in manual mode, you would want to increase the device reflection's refresh rate, as well as lower the quality.
Refresh rate increases the FPS rate of the screen while lowering the quality ensures faster deliverability of frames.
After opening a device in manual mode or in automation mode, look for a cogwheel in the button menu right of the device itself.
Click on the cogwheel, this will open up "Screen Settings" popup.
Set the desired quality and refresh rate in this Popup.
This should achieve better responsiveness while giving an experience as close as possible to having the device in your own hands.
Default values are:
Quality - 20%
Refresh rate - 4 fps (frames per second).