It's usually because of your Taxes, as the city gets bigger, taxes will inevitably need to go up to support it, which means the houses that are not huge, will become abandoned, in my opinion, SC's tax system has always sucked, it makes it near impossible to make a successful city unless you follow something out of a prima startegy guide.