Jul 22, 2017  How to reheat your breast milk. How to reheat frozen milk. Ideally, move frozen milk from the freezer to the refrigerator the night before you intend to use it. It can take anywhere from 8 to 24 hours for milk to thaw completely in the refrigerator, so its best to have it working while you sleep.