When you hoist your gut and see that white puss that gathers in the folds of your skin, now that is FAR more unsanitary than an envelope. That stuff in your fat folds is alive. The germs and bacteria on an envelope cannot survive the environment they are in. Don't sweat it, you'll be fine.
