Both sides came into the game on the back of one win in their last five matches, with the lack of consistency their major stumbling block. SuperSport made a total of five changes, handing Billy Mutale a long-awaited debut, while Celtic re-called Patrick Tignyemb in goal.
United showed their earlier dominance when Ghampu Lungu took aim with a long-range shot that sailed wide of the right-hand post.
Making his first start following a lengthy injury layoff, Bradley Grobler made no mistake to punch home from a mistimed shot by Aubrey Modiba on 13 minutes to hand SuperSport the lead.
SuperSport missed a good chance to go further in front when Lungu failed to poke home an inviting delivery metres from the net inside the final passage of the half.
Trailing the hosts, Siwelele looked to their substitute’s bench and brought on striker Tshegofatsa Mabasa before the second half resumption.
This did little to stop United from upping the ante when Teboho Mokoena showed good composure to beat Tignyemb with a sweet right-foot curler inside 57 minutes to double the lead.
Celtic made an offensive change in Neo Maema, and the youngster quickly set-up Mabasa with a perfectly-weighted pass to cut the tally in half on 63 minutes.
Into the final 20 minutes, Kaitano Tembo made his first change of the game as Siyabonga Nhlapo made way for Grant Kekana.
Zambian Mutale missed a decent opportunity to cap off his debut in style, as he was unable to direct home the close-range set-up on 74 minutes.
Following good interplay from the hosts, Modiba got onto the end of the move to get an eye on goal but Tignyemb made a good save in the closing stages.
Nevertheless, Tembo's men held on for a much-needed victory in the top flight.
SuperSport: Williams, Bhasera, Khumalo, Modiba, Mutale, Furman, Letsholonyane, Nhlapo, Mokoena, Grobler, Lungu.
Subs: Gould, Ntshangase, Pule, Mahlatsi, Mnyamane, Kekana, Malinga.
Celtic: Tignyemb, Lingwati, Pfumbizai, Rikhotso, Mabena, De Jongh, Masuku, Mashikinya, Dlamini, Phalane, Baloyi.
Subs: Dambe, Motshegwa, Shikweni, Maema, Khasipe, Mabasa, Potsane.