Ask them to move to another province by using the preferences section to reset their kingdom. We don't currently sell something like "reserved provinces", but I suppose it might be something we'd consider if there is interest in it.
Oh yeah, this is probably going to be part of a provincial diplomacy feature in the future too, along with a few other enticing options players in provinces will be able to take (war, etc).
