Any tips for lowering the cost of heating a home with oil heat, besides turning the heat down ;-D?

I am thinking for next winter about possibly using space heaters. Or even an electric fireplace which would be both pleasing to the eye and warm. I live in New England.