HOW LONG DOES IT TAKE TO BAKE CHICKEN. TO BAKE FROZEN CHICKEN PIECES (BREASTS, THIGHS, LEGS, WINGS Cover it with foil, shiny side down! Place in preheated oven at 375 and bake for 45 minutes or until the chicken reaches 165F at its thickest part. TO BAKE A WHOLE FROZEN CHICKEN Place in a preheated oven at 425 for 15 minutes.