As low mortgage rates continue to break records, you may be feeling the pressure to refinance. This week, the average rate for a 30-year fixed-rate mortgage is 2.88%—which doesn’t include origination points—according to Freddie Mac. While you may score a lower interest rate, experts warn that refinancing isn’t always the deal you may expect because of high closing costs.