Prince Harry and his family will leave the sunny shores of southern California and return to the United Kingdom, a source familiar with the couple’s plans said.