In a large bowl, dissolve yeast in warm water. Add the milk, butter, sugar, eggs, lemon zest, salt and 3 cups flour. Add the raisins, candied fruit and almonds. Add enough remaining flour to form a soft dough.
Turn onto a floured surface; knead until smooth and elastic, about 6-8 minutes. Place in a greased bowl, turning once to grease top. Cover and let rise in a warm place until doubled, about 1-1/2 hours.
Punch dough down and divide in half; cover and let rest for 10 minutes. Roll or press each half into a 12x7-in. oval. Fold a long side over to within 1 in. of opposite side; press edge lightly to seal. Place on greased baking sheets. Cover and let rise until nearly doubled, about 1 hour.
Bake at 375° for 25-30 minutes or until golden brown. Cool on wire racks.
Combine confectioners' sugar and enough milk to achieve desired consistency; spread over the Christmas Bread.