Prince William is said to be "extremely concerned" about Prince Harry's UK return.