I'd like to go a little further with the topic... When destroying buildings I believe we should get some wood and iron back since we are paying a workforce to destroy it for us. Random input 20% return?
My thought also go to the potential disband of military units, not all military members will take their weapons. Say 10% get left behind?
Just looking at it from a quality of life perspective, I have never had any issues with either.