Even if you do avoid coffee, you may not be as careful about another major source of caffeine: tea. Drinks labeled as “herbal tea” such as peppermint or chamomile varieties are probably caffeine-free, says Grandner, but varieties that contain black, green, or white tea leaves do indeed contain the stimulant.