Difference between non-VR lens and VR lens?

I'm buying a DSLR soon, and I'm attracted to the cheaper price of the non-VR lens, but have read some reviews that I'd be better off with the VR lens. I'm sure the VR lens would be better, but is it worth the extra money? Thanks.