Liverpool were beaten 5-0 by Manchester City before being held by both Sevilla and Burnley.
They are already five points off the pace setters from Manchester and only two teams have conceded more goals in the first five games.
Liverpool have been branded limp this week with Jamie Redknapp claiming they lack a cutting edge, while talk continues around their defence following the failed signing of Virgil van Dijk.
But Klopp has stood strong and insists his side are capable of taking teams apart – like they did against Arsenal.
“I’m not sure if there is pressure on us,” he said.
“I don’t feel pressure, I feel opportunity, the chance to do something really good.
“I have pressure, but it cannot be bigger than the pressure I put on myself.”
He believes Liverpool are on the right track but does admit Anfield can generate pressure on his players if they don’t get an early goal.
“When we don’t score the first goal it is like this (pressure) and you can feel it in the stadium,” he said.
“I didn’t see a lack of being ruthless. They were in the right positions.
“Solanke hit the crossbar, do I need to talk to him about this? Outside people do.
“We have to take the criticism and the blame.
“It’s not allowed for us to be happy or satisfied after (Burnley) but we cannot question everything. I can see the good and bad things”
He added: “We have to score and avoid goals from the opponent – actually we do that quite often but not always.
“We love working together, we enjoy this team but we also know there is a big responsibility.”
And Klopp admits he’s not surprised by United and City’s starts to the season.
The Manchester clubs are neck and neck at the top on the same points, goal difference and goals scored after United’s late flurry against Everton and City’s 6-0 win at Watford.
“I watched United and City, but it’s not my job to count points,” he said.
“They are in a good shape but a season is like this. As long as your attitude is right then you do not need to look at other teams.
“It’s not a surprise that City and United are in (the title race). I cannot always say what everybody wants to hear. If I am fine with a lot of things then I say it and a lot of people do not want to hear it.
“I can’t change my opinion every day because there are 500,000,000 different opinions.”
Klopp is set to make changes for the clash with Leicester with Danny Ward coming into the side in goal while Alex Oxlade-Chamberlain and Marko Grujic could start.
“As long as we can line up strong, we will line up strong,” he said.
“I’m sure both sides will make a few changes, that makes sense.”