Refinancing......general rule of thumb?

As a general rule how much less would interest rates need to be before it became a good idea to refinance? Lets also assume that you've had the existing loan for somewhere between 2-5 years.