Preheat oven to 350 degrees. Grease an 13 x 9" baking dish and set aside.
Place 6 slices of cinnamon raisin bread along the bottom of your baking dish.
On each slice of bread, layer about 2 slices of ham and 1 slice of cheese. Top with remaining 6 pieces of bread to form sandwiches.
In a small bowl, whisk together eggs, milk, vanilla, brown sugar, cinnamon, rosemary and salt. Evenly pour over bread, gently pressing down with finger tips to make sure all the bread is soaked with egg mixture.
Top each slice with a pad of butter. Bake 25-30 minutes or until cheese egg is cooked and cheese is melted.
*Casserole can be made ahead and kept covered in the refrigerator unbaked for up to 2 days.