Shoot, I dont know how you could look for the queen....I've NEVER seen mine yet since the day i put them in the box!
I think what i would do at this time is use the dustpan to catch the bees onto and put the bees in the top of the box.
I found that for me, sugar syrup was important in making the bees stick together for easier handling.
your friend,
john