Mortgage rates are significantly higher than they were at the start of this year, but they pulled back slightly last week after several weeks of straight increases.