If it's an advanced case of laying workers, I'd even go one further and use a double queen screen rather than an excluder. After a week or so, you'll start to see the laying workers back off (decline in egg laying) in the presence of better pheromones. It's when they start backing down that I remove the double queen screen and combine the boxes.