I don't think there was anything to talk about.

I thought the Queen made it quite clear last year that she was holding those positions open for one year. If at the end of the year, he hadn't changed his mind and wasn't going to return to being a full-time working royal, then those positions would be filled by somebody else.

Harry and Meghan appear to have assumed that when the year was up, the entire Megxit agreement would be renegotiated. Once it was made clear to him that his assumption was incorrect, there was no need for him to fly to the UK.