"No, please - don't be sorry. It was kind of a silly joke to make, considering we've only met a few times." he replied, waving his hand dismissively once it was dry. "I wasn't trying to make you feel bad or anything like that."

Probably best to change the topic.

"Anyway - let's get the buns divided up so we can toast them in a little while - the patties will take a little while to cook so we can't toast them just yet."