Gabuza, who was jeered by supporters in the first half, threw his shirt into the crowd out of frustration and bizarrely beelined to the dressing room, forcing Pirates to play with 10 men at Peter Mokaba Stadium.
This followed after he whipped a low cross into the Leopards box which was turned into goal by Thivhavhudzi Ndou in the 35th minute. He then went straight to a section of Pirates fans and took off his top, earning a yellow card in the process, before throwing it into the stands.
He then left the pitch without the referee's permission, which yielded a second booking and his dismissal.
'Micho' was reluctant to comment on the situation, but says Gabuza exited the field with a knock.
"I'm personally not ready to comment regarding that (Gabuza walking off the field). It is something what is beyond technical aspects and the coach," Sredojevic said.
"Our player Gabuza went off because prior to that he got kicked in his muscle and after the goal was scored because of that injury he left.
"However, [the] referee has recognised as per the rules that he went out of the field without him knowing. He put his jersey down so double yellow card and red card.
"We played for 60 minutes with a player less against a very good team, it was not easy. However, players gave everything and deserved to score the second goal.
"Overall, I personally believe a good match, a thriller from start to end. It could have been a totally different game if we had stayed with 11, we could have killed the match."
Pirates went on to win the match 2-1 but were forced to hang on with Leopards throwing everything at them in the dying stages of the league tie.
Gabuza has previously lost his cool with fans, who often get on his back for missing goal-scoring opportunities. In 2016 he notably had to apologise for an inciteful goal celebration during a Nedbank Cup match with Free State Stars.