Preheat the oven to 350°F (175°C).
In a large bowl, whisk together the dry ingredients: flour, baking soda, baking powder, salt, cinnamon, nutmeg, and ginger.
In another bowl, combine the granulated sugar, brown sugar, pumpkin puree, eggs, oil, and vanilla extract. Beat until smooth.
Gradually add the dry ingredients to the wet ingredients, mixing until just combined.
Pour the batter into a greased and floured loaf pan. Smooth the top with a spatula.
Bake in the preheated oven for 60-70 minutes, or until a toothpick inserted into the center comes out clean.
Once baked, cool the bread in the pan for 10 minutes, then transfer to a wire rack to cool completely.
While the bread cools, prepare the cream cheese frosting by beating the softened cream cheese with powdered sugar, milk, and vanilla until smooth.
Once the bread is completely cool, spread the cream cheese frosting evenly over the top.
Slice and serve, enjoying the delicious contrast of spiced pumpkin loaf and rich cream cheese frosting.