The Duke and Duchess of Sussex have reportedly moved to the Cotswolds and their neighbour has spoken out.