Taal, I think you are right about Yordale being highly successful to an extent at the expense of downtown retailers. On the other hand downtown has more of a monopoly on tourist dollars.
I do think there will be a rise in business for luxury goods downtown associated with the condo boom. My logic is that condo dwellers are more likely to use their disposable income for expensive vanity goods. Toronto is much richer than people here think (one study I cited elsewhere suggests that Toronto actually has more millionaires than Chicago and almost as many as LA if you can believe it). The issue for luxury retailers is how does this wealth translate into luxury goods purchases? I think in Toronto the amount of luxury goods people purchase is low because wealthy people use their money to buy bigger homes or another vehicle or a vacation property etc. rather than clothes or hand bags. Travelling in Eastern Europe and Asia I could see that people even of modest means spend money on luxury purchases. On the other hand most of the people I know with higher net worth do not purchase such goods regularly.