If I close Chrome, Sublime Text and Terminal it gets close to normal speed. Exposé seems to scale very badly with the number of apps running. It's also possible that some of these apps are badly optimized redrawing themselves in some way that slows down Exposé.