Ea Lla Koto have slipped down to 14th on the log, just a point above the relegation zone, after losing 1-0 to SuperSport United and have only won five league games this season.
Kavazovic says his team doesn’t deserve to be playing in the National First Division next season.
"If I don’t believe [we will stay up] I will go straight to Johannesburg at the airport and go home," said Kavazovic.
"I believe we have the quality. Our level is not on NFD, with all the respect to NFD teams. Our level is in PSL."
The Serbian says his team has already started preparing for life in the top tier again next season with the signing of new players and setting up pre-season training.
"We have a full programme for the transfer window with regards to signing and releasing players. We have a full programme of pre-season, where to go and how to prepare because we want to be in the top five next season," Kavazovic added.
Stars are set to host AmaZulu in a league match in Betlehem this weekend.