Pressure is rising on Rosslee as Usuthu are yet to win this season and are propping up the Absa Premiership standings with three points after seven rounds of fixtures.
Some of the club's fans even went as far as to march on the team's offices to demand Rosslee's sacking. Van Heerden, however, feels replacing Rosslee could prove counter-productive.
"He is a good coach and we enjoy working with him and enjoy his philosophy of football," Van Heerden says.
"So to fire the coach now it would probably be not the best thing for the club and like I said he is a very good coach. Players respect him and we all enjoy working with him.
"We just need that little bit of luck and once that comes, everything will fall into place. We have not played badly. If you have watched our games, we have played good football and it is just the luck that is not there for us."
The 26-year-old, who started his career at University of Pretoria before joining Usuthu in 2008, admits morale has taken a hit at the Durban outfit. Nevertheless he is encouraged by the team's fighting spirit.
"Look, it's not easy for us. We haven't won a game since the start of the season and we only picked up three points in three draws and it is not easy.
"These kind of situations aren't easy and funny to deal with. The team's morale is a little bit down but at the end of the day, the guys are still willing to got out there and fight to prove to everybody that we are a good side, a good club.
"It is just that little bit of luck I suppose we need, but in saying that we have to go out there and work harder and do the job."
AmaZulu next face Bloemfontein Celtic in the Telkom Knockout last-16 at Princess Magogo Stadium on Saturday. Van Heerden naturally hopes the game will prove to a turning point in their campaign.
"Celtic is always a tough game, whether you play at home or away. They are always a side that gives you a hard time," Van Heerden says.
"They have a good coach behind them in (Ernst) Middendorp. He is a very tactical coach and it will be a difficult game.
"If we win this game it could change our season."
In team news, Rosslee is without injured pair Nkosinathi Mthiyane and Aubrey Mathibe, while Celtic, who last month won a league match 2-0 between the sides, are minus suspended duo Alfred Ndengane and Hellings Mhango.