Jun 20, 2019 How to Dry Up Your Breast Milk Supply DoctorRecommended Advice Wean gradually, whenever possible. Take a pain reliever containing ibuprofen or acetaminophen. Avoid nipple stimulation, as this will trigger milk production. Avoid pumping your milk as it signals to your body that it needs to