Chester was linked with a move away in the summer but ahead of Aston Villa's clash with Bolton on Friday night, however insists it was always his intention to stay.
"I never wanted to leave," said Chester. "I think the situation the club found itself in was dictating of [a potential move].
"It's always nice to have interest in you but the most difficult part for me was that I may have had to make a decision I didn't really want to make. I've loved my time at Aston Villa and I wanted that to continue for a lot longer.
"I don't think I appreciated how big Villa was until I came and signed here. It's got one of the biggest fanbases in the country and they take thousands away from home. The history of the club is huge, it makes his period even more difficult after seeing what the club has achieved in the past."
He also admitted feeling slightly guilty for Steve Bruce's dismissal, as he and the squad failed to live up to their pre-season expectations.
"It was a shame because I played for him here and at Hull City for a long time," continued Chester. "He's done a lot for me on a personal level so it was hard to see him leave, and you almost feel that extra bit of responsibility having known him for so long.
"We started the season really well, definitely the best since I've been here. But then the odd decision or result didn't quite go our way and the atmosphere around the club changed a little bit. It was probably too far for Steve to turn it around."
"The expectation of this club is huge," Chester added.
"We should be in the Premier League and I signed to try and get this club back there. At the moment we are not managing that but we know we've got the ability in the squad to turn it around.