Now what?

We thought we had it all figured out. And now we don't. We're back to square one with selling our house. We're struggling with really, really wanting to move since we pretty much hate the location of our house and all of the people around us. They're just all 'trash' with very few exceptions. We can get approved for a mortgage so that's not the problem...the problem is this ~ When we look at houses we like versus houses we love, we find that the houses we love are slightly over what we want to spend right now. It would make us literally house poor. So do we wait another year (GROAN) so we have more of a down payment to get the house we love but risk the interest rates going up and the price of homes going up to the point where we're not really getting anything more than we can comfortably purchase right now? We never want to move again after we leave this house. So what we purchase will be our forever house (hopefully). I'm just so confused. I don't want to rush into anything and make a mistake and I'm trying to not let my hatred for this house sway my judgement. So what to do....That is the question.