What's the toughest part of being a vegan?

Apparently keeping it to yourself.