Stars made two changes from their last encounter as they were looking for their first win of the year. They wasted no time enforcing their plan for victory, with pressure on the hosts.
Celtic looked the more likely to score after catching the visitors napping at the back, but Deon Hotto was unable to make them pay with a weak effort on 15 minutes.
The best chance yet came to Lucky Baloyi on 25 minutes after Hotto laid off a perfect ball for him, but the former Kaizer Chiefs man was unable to make the net bulge.
Another effort came into the box but Kabelo Dlamini, like his predecessors, failed to make it count with a wayward effort.
Chances from the home side continued to come through, but Dlamini, Hotto and Ndumiso Mabena couldn’t make them count as the first half ended goalless.
The breakthrough finally came for Celtic after Mabena sneaked into the box to send a half-volley past Mzimela on 58 minutes.
Dikwena pushed for an equaliser in the closing stages with Bongi Ntuli going close with a header, but the home side managed to hold on for the win.