But since the couple stepped back from the royal family to move to the US, this is said to be “no longer on the cards”.
It has long been said that Charles plans a major shake-up of the Royal Family when he becomes head of state – and it could affect royal residences.
In a bid to slim down the royal estate when he ascends to the throne, it has been reported that he will live in little more than “ a flat above the shop” at Buckingham Palace and use Highgrove as his family home.
And according to the Mail On Sunday, he had earmarked his current London residence of Clarence House to Harry and Meghan, but the paper adds their departure to California means that it is “no longer on the cards”.
It is said the residence will likely be saved for Prince George, Princess Charlotte or Prince Louis.
It is also understood that Prince William and the Duchess of Cambridge will move from Kensington Palace to Windsor Castle, a relocation that the couple is said to want.
Love the royals? Sign up for the Mirror’s daily newsletter to get all the latest news on the Queen, Charles, Kate, Wills, Meghan, Harry and the rest of The Firm. Click here to sign up.
There are also said to be plans to open up both Balmoral and Buckingham Palace to the public.
Queen Victoria was the first British monarch to use Buckingham Palace as her official home – with all other monarchs following suit in the years since.
The palace is currently used as a working royal residence, housing the Queen’s offices among its 775 rooms.
There are also 52 royal and guest bedrooms, 188 staff bedrooms, 92 offices, and 78 bathrooms.
Members of the public can currently visit the majestic staterooms, the gardens, see the priceless fine art hanging from the corridors and visit Her Majesty’s throne room.
The Queen moved into the palace following her father George VI’s coronation in 1936.
With her late husband Prince Philip, she raised four children there – Charles, Princess Anne, Prince Andrew, and Prince Edward.
The palace’s last renovation was during the Second World War, but in 2016 a £369million restoration of the palace was approved which is expected to be finished in 2027.