This is correct, and yet not for the reason expected.
Most uninstalled programs leave stuff in the registry. This is bad, but doesn't affect performance on Windows. (Okay, it does, but 16MB vs 32MB is something like a 2% performance drop)
What hits performance the worst is programs that don't...