City lost 5-0 to Sundowns on Wednesday, but turned it around to end Celtic's four-game winning run thanks to goals from Jabu Maluleke, Puleng Tlolane and Cole Alexander.
Clinton Larsen’s men took the game to the hosts and had chanes from Lerato Manzini and Musa Nyatama saved by Modiri Marumo.
Polokwane slowly started finding their feet and after Alexander fired wide, Maluleke got the opener just before the break – a stunning strike from long-range.
Modiri denied Nyatama again in the 64th minute, and shortly afterwards the hosts got their second – Tlolane the man with his ninth of the campaign.
With five minutes to go, Alexander hammered the final nail in the coffin with a beautiful strike to give City a 3-0 lead and secure the points for Rise and Shine.
The victory takes the Polokwane side seventh with 32 points, Celtic are one place and one spot better off.