John Brown died before Queen Victoria. After her death, Edward VII got rid of many of his mother's monuments to her late servant and his sister Beatrice destroyed much of their mother's diary entries and correspondence regarding Brown. The Munshi was allowed to keep the property he'd purchased in the UK, but he went/was sent back to India after the Queen's death and Edward VII had his mother's letters to him destroyed and no pension was paid to him (thanks, Wikipedia, for this bit).

I don't think Charles feels bound by his mother's wishes. I think he's just going to do what he wants.