Actually look at the numbers and it's not as insanely loaded as a soda or piece of cake, especially when you take fiber into account. They also make a lot of reduced carb breads and bagels and such now.

Also hunter gathers had to walk everywhere and carry everything themselves so it's an inaccurate comparison, their TDEE was insane compared to modern people.