Studies on drug utilization in western countries disclosed that about nine over ten women use at least one or more drugs during pregnancy. Determining whether a drug is safe or not in pregnant women is a challenge of all times. As a developing organism, the fetus is particularly vulnerable to effects of drugs used by the mother. Historically, research has predominantly focused on birth defects, which represent the most studied adverse pregnancy outcomes. However, drugs can also alter the ongoing process of pregnancy and impede the general growth of the fetus. Finally, adverse drug reactions can theoretically damage all developing systems, organs or tissues, such as the central nervous system or the immune system. This extensive review focuses on different aspects of drug-induced damages affecting the fetus or the newborn/infant, beyond birth defects, which are not addressed here.