Man United who have won just one of their last four Premier League matches will be facing in-form Liverpool on Sunday.
And with the Red Devils targeting a Premier League success this season, Solskjaer believes his side can only compete for the title if they improve their game.
"We’ve lost points recently that we’re not happy with. We have to take it from here and really, really get going,’ Solskjaer said.
"There is no time to lose because even though it’s a long season, the teams we are competing against are not going to give you too many options to catch them.
"We know that we were too open against Leicester, too easy to cut through. We’ve conceded some bad counter attack chances and set-play goals lately and that’s something we work on and have to put right.
"The funny thing is that this season we’ve had more players behind the ball than last season but we’ve been easier to play through.
"We have conceded goals that we could have avoided, definitely. We are working to get better, the boys agree on what we have to do and they’re giving their best.
"We’re competing at such a high level that if you switch off for a split second you will be punished. That’s the difference between this level and the one below — focus and concentration."