Just four months into his role, Potter has come under pressure after winning just eight of his 18 games in charge of the Blues.
Chelsea are out of both the FA Cup and Carabao Cup and find themselves 10th on the Premier League table, 10 points off the Champions League spots.
Guardiola and his Manchester City side humbled Chelsea 4-0 in the FA Cup fourth round at the Etihad Stadium on Sunday with goals from Julian Alvarez, Phil Foden and Riyad Mahrez's brace inflicting more misery on the Stamford Bridge outfit.
City raced into a 3-0 lead before half time and even a slight improvement in the second period from the visitors was not enough to muster any sort of comeback.
Guardiola is however adamant that Chelsea will eventually come good if Potter is given time to implement his ideas.
"I would say to Todd Boehly, it was a pleasure to meet him, but give him time," he said. "I know results are important in big clubs but I would say give him time.
"I think the second half today is what he is and what he did in Brighton was outstanding. All the managers need time and he was right. We need time in the first season.
"I had results in Barcelona in the first season but we had Lionel Messi so one season was enough. But yes, everyone is an idiot [in football management].
"To play against Man City at the level we are at in the Carabao Cup or FA Cup is not easy. Not for Graham, Chelsea or any team."
