I would say that the emptying expanse of expensive SFH's is a common trend for many adjacent neighbourhoods as you head in a westward direction. From the Annex to Seaton Village, Christie Pits, Dovercourt Village, Wallace Emerson, etc. As the children of these households continue to be pushed out due to the unaffordability to remain in these communities, these areas will become increasingly like "seniors" areas.
Some other areas like Davenport West, Dufferin Grove, Roncy/Sorauren, and the Junction have seen some revitalization or influx of new residents in the past decade or so. But even in those areas, they might only be treading water in terms of the population replacement rate, or still on the slightly underperforming side. That along with often these new residents are living in newer higher density developments instead of the traditional SFH housing stock anyways.