Towns and Counties are called ‘Settlements’ collectively. You’ll get Fealty of your occupied Settlements after a certain period of time. With enough Fealty you’ll get the boost provided by the Settlement. If you lose the Settlement, Fealty will decreases. Please note that Fealty will drop to zero if you abandon a Settlement!