If a kingdom goes all military and can wipe an opposing army, then the time and resources it takes to bounce back from that should be comparable to what spells do.
An offensive spell taking half a kingdoms buildings, also wiping military and cutting production 50% seems broken. I can see there being an opportunity cost of running, or not running schools being there, but it shouldn't be mandatory.
Rate in which wizards rest and the rate that someone can recover from an EQ makes it an impossibility to survive a 1v1 as military heavy kd vs magic heavy. Balance needs fine tuning