Do looks really matter?

to a degree yes. Youll have to look at your special person for as long as your with them, more often than anyone else. Also if you decide to have kids, theyll likely look like them to some extent and inherit some features.