The Amakhosi saw their winning start to the season halted by the struggling Birds following a 1-1 Absa Premiership draw on Wednesday.
Baxter says his team are looking to bounce back straight away against a Stars side who they have already played – and beaten – three times this season.
“All cup competitions are always a little bit special and different to league games because the name of the game here is to get through and get into the hat.
“So we have an opponent that we have played a couple of times before and we know that those games have not been easy games, and we know it is going to be a tight one.
“The players will be more fired up for the cup game as they will want to make up for the two points that we dropped in the last game,” Baxter says.