I like the pallet idea, if you ask local feed stores, they often have a few they are willing to part with that aren't in good enough condition for moving supplies, but would work well for your wind break.
Also, straw bales work well. Not very expensive and easily movable, but they will rot over time. Not sure you'd get more than one season out of them.