Apple Spice Fritter Bread

For the Bread:

1/3 cup  light brown sugar

1 teaspoon ground cinnamon

2/3 cup white sugar

1/2 cup unsalted butter, softened

2 large eggs

1 1/2 teaspoons vanilla extract

1 1/2 cups all-purpose flour

1 3/4 teaspoons baking powder

1/2 cup milk

2 apples, peeled and chopped (any variety, but Granny Smith or Honeycrisp work well)

2 teaspoons ground cinnamon

2 tablespoons granulated sugar

For the Glaze:

1/2 cup powdered sugar

2–3 tablespoons milk or cream