I'm not sure what causes this, as I don't experience it any other GCN games played on Dolphin.
Basically.. when I play Zelda: TP on Dolphin, over time the performance slowly worsens. I start out at 30-40fps average, and after playing for about 25 mins it's down to 10fps.
Specs are as listed...