The pair have claimed numerous honours between them, with Klate notably winning the Absa Premiership fives times in a row at former clubs SuperSport United and Orlando Pirates.
Pelembe also tasted League success with Matsatsantsa and Mamelodi Sundowns.
"We've been lacking a winning mentality in the team. Having Pelembe and Klate is very great," said Mkhwanazi ahead of his team's MTN8 semi-final decider with Ajax Cape Town at Bidvest Stadium on Sunday.
"Having Pelembe, Klate, those players are eager to win. They have won titles before, maybe they can help us get silverware."
The former University of Pretoria man will captain Wits on the weekend in the absence of injured defender Thulani 'Tyson' Hlatshwayo, who picked up a knock in the 4-2 League loss to Sundowns on August 22.
"Thulani Hlatshwayo is recovering well, we still have to hear from the doctors. It's only a matter of time [before he returns]," Mkhwanazi added.
The Clever Boys will advance to the Final on away goals if they keep a clean sheet against Ajax following a 1-1 draw in the first leg in Stellenbosch.
Mkhwanazi, however, is guarding against complacency.
"We have to take Ajax Cape Town seriously even with the away goal that we have."
MTN8 holders Kaizer Chiefs and Bloemfontein Celtic will contest the other semi-final at FNB Stadium on Saturday, having also drawn 1-1 in the first leg.
-----------------------------------------------------------------