Yup, shawn's got it, that is columbine.
A biennial, it spreads by seeds so will show up in new spots occasionally. And it isn't a weed, you can buy it at the store.
I suppose you can buy black-eye susans and shasta daisies too, and those have turned into weeds by me...