I was cringing every time you pushed your hive tool down between the frames and again when you put your hand down into the box to scrape off the mold.
If there had been bees living in this hive, you would have had some very mad bees.
I recomend removing the outer frames first then move frames over to make room where the frames are that you were trying to get to.
Instead of driving your hive tool down ward, use the other end. Put it between the frames and then twist to to separate the frames. Then lift them out.
You can scrape the bottom out the way you were doing it but just remove enough frames so that your glove is not killing lots of bees and your queen.
Sorry to sound so negative, but if that had been a full hive, you could end up with a whole hive boiling out on you and from then after they would seem like a mean hive.
Remember bees treat you like you treat them.