If a character refuses an invitation, you likely haven't reached the required "Affection" level. Go back and engage in more casual conversation.

The game begins with an introduction to the main characters:

Finding hidden collectibles