Locals are concerned about asylum seekers being bused in from a nearby former airbase.