There are many factors involved when shopping for your mortgage. Of course, rates are top of mind for everyone involved, but the lowest rate isn’t always the most important factor.