You chose to decline the offer to lunch.
The man says ok and goes off to invite someone else. As you walk around the ship you find a barrel of apples.
You can eat the apples or you can pass on them.