Koeman is currently facing intense criticisms from the Barca fans after the Dutch trainer lost 2-1 to Real Madrid in the El Classico.
Victories for Koeman have become hard to come by, as the fans are not pleased with the tactics by the 58-year-old.
After the game against Real, Koeman received a lot of boos when departing the Camp Nou.
The former Everton boss' job at Barca somehow seems to be on the line despite having the backing of the club’s hierarchy.
But Koeman says he wants to "enjoy the time I have left" as the Barcelona manager.
"I'm a grown up and I know how these things work," Koeman said on Tuesday.
"I want to enjoy the time that I have left, if it is eight years, six months, one year, or some weeks. I think it's important that we win this game in Madrid, we cannot afford back-to-back losses.
"It is a social problem. Uneducated people that don't understand rules and values.
"Inside the stadium the environment was completely different and that is what I keep in mind, that festive vibe, not with those kinds of people."
Koeman also discussed the potentials of his next opponents Rayo Vallecano who are inspired this season by the arrival of experienced striker Radamel Falcao and the possibility of Ansu Fati making the trip to the Estadio de Vallecas on Wednesday.
"They are a really tough team to beat and they are even better this season," said Koeman. "We'll have to be in our best shape to beat them in their home.
"He [Fati] doesn't feel right, we will decide on Wednesday morning if he makes the trip."