Jordaan won his third term as SAFA president by a convincing margin with 186 votes to Ledwaba's 27 votes while Solly Mohlabeng amassed just 8 votes in a landslide win for Jordaan.
"I'm not disappointed at all," Ledwaba said. "I knew the odds were against me when I came here but I think I fought a good fight.
"I still believe the South African Football Association needs change, that's my belief and I believe I didn't lose today, football lost a servant.
"I am in SAFA to serve, I was in SAFA for all these years to serve.
"You are going to hear a lot from me until Jordaan is out of football, I will not rest.
"I don't think he is good for domestic football, I believe that he has done his part, he has done for all these years that he has been in football, but you cannot have a one-man show.
"That's the truth, and they can say whatever they want but the bottom line is that's how he rules the association."