After snatching a draw from the jaws of defeat at Baroka FC last weekend, forced Lehlohonolo Seema to make three changes as Wandisile Letlabika, Bongani Sam and Menzi Masuku returned to the line-up.
After surviving the earlier pressure, Celtic failed to sneak in front when Tshegofatso Mabasa fired over the top from close range on 13 minutes.
As Celtic continued to dominate, Kabelo Dlamini nearly broke the deadlock as his effort from distance narrowly sailed past the top corner of the on 30 minutes.
The hosts nearly fell behind on the stroke of halftime when Patrick Tignyemb’s poor handling gifted the ball to Paseka Sekese who was unfortunate not to connect properly.
Undoubtedly Celtic squandered a glorious opening 10 minutes into the second half when Dlamini missed an absolute sitter following a right-sided cross.
The experience of Celtic proved telling as they eventually broke the deadlock on 66 minutes, with Mabasa calmly slotting home from 12-yards out.
It seemed to fall apart for the visitors as Masuku’s shot from a cut back touched the hand of Junaid Sait, prompting the referee to award a spot-kick, which Tignyemb failed to convert after seeing his effort saved.
Mabasa looked to complete his brace and round off the match late on, but after beating the offside to go clear on goal, he shot tamely at Andile Mbanjwa.
In the closing stages, the NFD side were reduced to 10 men, with Katleho Maphathe given his marching orders for a poor challenge on Sam, as Celtic ran out 1-0 winners.
Celtic: Tignyemb, Letlabika, Sam, Rikhotso, Masuku, Tani, Mabasa, Mashikinya, Dlamini, Phalane, Baloyi.
Subs: Dambe, Letsoalo, Shikweni, Pfumbizai, Mabena, Mahashe, Potsane.
Bay: Mbanjwa, Maphathe, Mthethwa, Sait, Bernard, Khubeka, Dlamini, Madondo, Gumede, Ngubo, Sekese.
Subs: Ngcobo, Mushono, Erasmus, Saal, Shange, Mcineka, Ngubane.