I like to imagine that all the inaccessible houses in the game belong to people (animals?) who are absolutely terrified of and do not partake in all the sexual activities the local mayor, mechanic, and shopkeeper do.