Liverpool removed Manchester City's cloak of invincibility this season after Mohamed Salah's 76th minute effort condemned the champions to their first loss of the season at Anfield.
A contentious moment in the game arrived shortly after halftime when VAR intervened to rule out Phil Foden's goal for Man City after Erling Haaland was deemed to have fouled Fabinho in the build up.
But Silva feels having allowed the game to flow up to that point, Taylor showed inconsistency by going back to an infringement that looked soft at best.
"What we expect from the referees is consistency in the decisions," the Portugal midfielder told Sky Sports.
"When you go through a path of not whistling little contacts through the whole game, you need to keep those decisions and keep going that way.
"If you want to whistle all of them, whistle all of them, but if from the beginning of the game you are not whistling all the little fouls, and we saw in this game the referee was letting us play, which is good, it's fine.
"Then, if there's a goal, you cannot whistle that soft one.
"If you want consistency from the referee, you cannot change just because there's a goal and just because it's a tough decision.
"You have to make the tough decision and keep the goal in my opinion."
Pep Guardiola's side remain second on the table but are now four points behind leaders Arsenal.
