However, you may lose some hair under your arm or on the breast or chest area getting radiation (this may be a concern for some men with breast cancer). Rare short or longterm side effects Although rare with modern treatment, the conditions below may occur a few months or years after radiation therapy.