In that case...

[No, it really doesn't need to be said, so he'll leave it at that, and start walking away from the party. If they're both interested in company, he assumes they'll end up in the same place.]