Jim Lamb has posted a great summary about things you can do to improve build performance in TFS 2008.

Many of the things mentioned are described in the excellent book on MSBuild and Team Build "Inside The Microsoft Build Engine Using MSBuild And Team Foundation Build". If you haven't looked at it yet make sure you do!

And beware of the TargetNotLogged fix may not have been applied correctly as described in my previous post.