Health experts say that even low to moderate caffeine intake may raise the risk of miscarriage, low birth weight, and slow fetal growth. Because the baby can't process caffeine like adults can, it stays in the system longer. While some guidelines allow up to 200 mg daily, many now recommend avoiding caffeine completely to protect your baby's health.