Zend certified PHP/Magento developer

gtx1050 and gtx1060 in one PC

Excuse my English, I will try to explain my pain.
I have one GeForce GTX1050 2GB for one monitor and on GeForce GTX1060 3GB for another monitor. Don’t ask why, I have my reasons.
Before having the 1060 I had gt610.
When I move google chrome(for example) from the monitor with gt610 to the monitor with gtx1050, the gtx1050 parameters(GPU Load etc) increase and gt610 decrease. It seems logical to me.
Now, when I have the gtx1060 and gtx1050, when I do same action, the 1050 always keeps working like the window is on the monitor connected to the gtx1050. Work load on the gtx1060 increases, but the gtx1050 still got pretty much of it. The Nvidia control panel has that “GPU activity icon”, that shows me that everything is running on the gtx1050, but I am doing everything on the monitor with gtx1060. On the monitor with gtx1050 I have outlook opened, that’s it.
Can someone explain to me why is that happening?
I will appreciate your help!
Thank you in advance!