don't give up yet, you might have a queen, she could have been in the boat when you went back and she could have been in that cluster on the ground, the brood might have been chilled brood or brood that died in the removal and the bee's are just cleaning out the cells, it happens.