Baloyi, who joined Chiefs as a teenager and made his PSL debut in 2010/11, was released by Amakhosi at the end of last season.
The Mokopane-born midfielder often played second fiddle to the likes of Willard Katsande in the Glamour Boys engine room, prompting a loan spell at Moroka Swallows in 2014/15 during which he scored once in 28 league games.
Baloyi, however, expects no favours from Celtic coach Veselin Jelušic and insists he will work hard for his place in the team.
"In football and wherever you go, you'll get competition. At Chiefs it was not like Willard Katsande was the 'god' of that position [central midfield], it's just because of working hard," Baloyi tells KickOff.com.
"But what I can say is that I've been there with the team but things didn't go well and I think it is time for me to establish my career going forward.
"I'm not saying I've got an advantage here because I'm from a big team, no. I still have to work hard for me to get my position.
"Even at Chiefs, I was working hard but the problem is it was difficult to break through and sometimes you know how coaches are, so it's all about the tactics of the coach when you are in the team and you must know that the competition is always there. So it's all about working hard and supporting each other."
Meanwhile, Baloyi remains grateful for his time at Naturena.
"There's one thing that I won't forget about that team because I grew up there," he adds.
"I arrived at 14 so look at me now, I'm a man. Everything they did to me I really appreciated it because they were there for me and that is how life is. But I won't forget what they did for me.
"I knew how to drive a car because of that team, I knew how to earn a salary because of that team, so it is something that I won't forget about that team.
"And most importantly, we didn't fight with the team it was a mutual agreement. They gave me the blessings to go wherever I'm going and they were still helping me to find a team after I have left them so that I can settle because they know what kind of person I am.
"I think whatever I got from that team I really appreciated it because now I'm someone because of that team."
Baloyi does not rule out a return one day to the club that gave him a platform.
"About that [going back], you know how football is, and I think that is up to me if I perform better here at Celtic," concluded Baloyi, who won the league, Nedbank Cup and Telkom Knockout in his time with the Soweto giants.