After just 18 months in charge of the Lilywhites, Mourinho was shown the exit following a poor run of form in North London.
The former Chelsea manager was replaced on an interim basis by former Tottenham midfielder Ryan Mason, who led the club into the Carabao Cup final, losing to Manchester City, and earned a place in next season’s Europa Conference League by finishing seventh on the league table.
Mourinho priced Doherty away from Wolverhampton Wanderers ahead of the 2020/2021 season and the right back feels his former manager was let down by the Tottenham players.
"He was only there for 18 months," Doherty said of the Portuguese coach while on international duty with the Republic of Ireland.
"If it was three or four years, it could be a different conversation, but we just weren't getting the results for him.
"The manager is always the one to lose his job, but as players, we were the ones on the pitch and we weren't able to get the results for him, which was a shame because he's one of the best managers ever."
Mourinho has since been snapped up by Italian Serie A side AS Roma ahead of the 2021/2022 season.