Swapping hive locations does not start or promote robbing.
Forage bees coming back to the hive, are loaded with nectar and pollen. They exhibit no signs of robbing or aggressive behavior. So they are more than given a pass into the hive. You can watch them enter, come back out as they are confused, take a brief flight, go back in, etc. They are more tuned into the location than the smell.
If you watch a hive being tested by potential robbers, they swoop in, back off, swoop in again, and are testing the defences of the hive. The guard bees know the signs and automatically sense these bees. They will make a motion towards these hovering bees.
Forage bees on the other hand, come straight back to the entrance. They are loaded with stores, they are tired, and exhibit none of the classic behavior that alarms the the guard bees.
Hive swapping is a true and tested method of equalizing hive strength, and bolstering a weak. I do it all the time in nuc building.
Hope this helps.