The England superstar believes his side should have secured the maximum points against the Magpies.
Despite Tottenham having the lion’s share of possession inside the opening period, it was Joelinton who gave the hosts a surprise lead on 28 minutes, but Kane articulated a swift reply to put Spurs level before giving Jose Mourinho’s men the lead four minutes later.
The North Londoners protected their lead until the 85th minute, when Arsenal loanee Joseph Willock, who came on as a substitute pulled parity for Steve Bruce’s men.
Tottenham could have been out of sight before Newcastle’s equalizer if not for their own profligacy and Kane was not a happy man after the game.
"Whenever you are ahead in a game, as we have been a lot this season, and you give the lead away in the last 5-10 minutes, it's always hard to take,” Kane said.
“I feel like we could have played better in the second half. We were a bit sloppy. We didn't take our chances and got punished for it.
"I think we had some good chances. The final ball, final pass or final touch weren't quite there. That's the fine margins. We need to play better. We need to dust ourselves off and go again next week.
"Their goal woke us up a little bit if I'm being honest. We reacted really well and scored two quick goals then finished the half well.
“We didn't take that momentum with us [into the second half] and allowed Newcastle back into the game. It's always hard to respond with four or five minutes to go."