I like the idea. The troops called from the fiefdoms are, in my eyes, comparable to the Ruhn or Harad reinforcements. So it makes sense to let them march in from outside the map.
It would make it easier to destroy the beacon, because the defender can't just summon troops in your back all the time.
best regardes,
Seleukos I.