Prepare the baking dish: Lightly grease a 9×13-inch baking dish with butter or cooking spray.
Add the bread: Spread the cubed French bread or brioche evenly in the prepared baking dish.
Make the custard: In a large mixing bowl, whisk together the eggs, milk, heavy cream, granulated sugar, brown sugar, vanilla extract, cinnamon, nutmeg, and salt until well combined.
Soak the bread: Pour the custard evenly over the bread cubes. Gently press the bread down with a spatula so it absorbs the custard. Let it sit for 15 minutes.
Make the topping: In a medium bowl, combine the flour, brown sugar, and cinnamon. Add the cold butter and work it into the mixture with a pastry cutter, fork, or your fingertips until coarse crumbs form.
Prepare for baking: Preheat the oven to 350°F (175°C). Sprinkle the crumb topping evenly over the casserole.
Bake: Bake uncovered for 45–55 minutes, until the top is golden and the custard is set in the center.
Rest: Remove from the oven and let the casserole rest for 10 minutes before serving.
Serve: Serve warm with maple syrup, fresh berries, powdered sugar, or whipped cream.