Celtic co-coaches Lehlohonolo Seema and John Maduka made two changes from the side that defeated Chippa United 2-0 last time out. In came Kabelo Mahlasela and Vusi Shikweni, with Atusaye Nyondo and Mpho Maruping dropping out.
Stars coach Cavin Johnson sprung a surprise by dropping Ndumiso Mabena to the bench.
The visitors made an excellent start to the match and had Gerald Phiri Junior to thanks for two quick goals.
His first was a free-kick inside the first six minutes as he beat Patrick Tignyemb in the home goal.
And lightning struck twice just three minutes later when the Malawian international produced a carbon copy to give Dikwena a 2-0 advantage.
Celtic had more of the ball after that, and Stars had a scare when they lost goalkeeper Mbongeni Mzimela to injury, handing a Premier League debut to Mwenya Chibwe.
Stars added their third with 15 minutes to play when Bongi Ntuli was on target, sealing the points for his side.
The game was stopped in injury-time when a section of the Celtic fans threw bricks and sticks onto the pitch, but police cleared the troublemakers and the match was played to completion.