Hard to answer for certain, could be the rest of the day or a few hours. If you didn't smoke them before mowing, try that next time. If they still get pissy when mowing you could seal them up (depending on how many hives you have) or mow by the hives after dark.
...JP