Potter has won just nine of his 25 games in charge of the Blues since taking over from Thomas Tuchel back in September.
That run also includes just two wins in their last 14 Premier League games despite significant spending in the January transfer window.
Chelsea's last outing resulted in a 1-0 defeat at home to bottom side Southampton.
Potter has come under pressure but he retains the backing of the club's board.
It seems some disgruntled fans have taken their frustrations a bit too far and Potter has detailed some harrowing experiences ahead of Chelsea's trip to London rivals Tottenham Hotspurs on Sunday.
"I've had some not particularly nice emails come through, that want me to die," Potter said.
"That's obviously not pleasant to receive."
"You could ask my family how life has been for me and for them. It's been not pleasant at all," Potter added.
"If you go to work and somebody's swearing abuse at you, it's not going to be pleasant.
"You can answer it two ways. I could say I don't care, but you know I'm lying. Everyone cares what people think, because we're hardwired to be socially connected."
"With the results as they are, you accept criticism.
"That's not to say it's easy at all. Your family life suffers, your mental health suffers, your personality - it is hard."
