Matsatsantsa will meet Orlando Pirates at the Moses Mabhida Stadium this weekend in what will be Baxter's last match with the Tshwane giants before he switches his focus fully to Bafana Bafana.
And Williams feels the best way to thank the Brit for his service to the club is to give him the Ke Yona title as a send-off.
“It's going to be a good one, they [Pirates] got the 80th anniversary going on and are wanting to finish it on a positive note regarding the season they had,” Williams said.
“So we just want to go out there and do our best. Obviously, do it for ourselves and send coach Stuart Baxter off with a bang.
“He has been amazing for this club, what he has done for many of us. Not only myself, before he came in my confidence was low, I was conceding a lot of goals, silly goals.
“And he took my game to another level. He has done that to a lot of guys in the team. You can see what he has done for the club, we are in the Nedbank Cup final, the quarter-final of the CAF Confederation Cup and we reached the Telkom Knockout final.
“This is for him to send him off for what he has done for the club.”
Despite having beaten Pirates 6-1 in a league match and having knocked them out from the Telkom Knockout competition, Williams still believes they go into the cup final as underdogs.
“We are underdogs. Pirates are a big team, a big brand. They will always be a big team in South Africa and the continent as a whole,” Williams said.
“We just have to go out there and do our best, we don't care about any status. On current form, we have done much better than them [Pirates] but this is one game, just 90 minutes or 120 for the guys to put in their all.
“We just have to go out there and do what we have done the whole season. We've had positive results over Pirates in the last few years. I can't remember the last time they defeated us so hopefully, it can stay that way.”