Packaging Comparison (loading jquery, all variants)
Next time you pick a compression technique, remember this formula:
Total_Speed = Time_to_Download + Time_to_Evaluate
Average Time to Load Toolkit (non cached, gzipped, minified)
Now, some might argue that testing the speed of un-cached pages would be unfair, however according to Yahoo’s research on caching, approximately 50% of users will never have the opportunity to have the page contents be cached. Thus, making sure that you page loads quickly both on initial load, and subsequent loads, should be of the utmost importance.
Average Time to Load Toolkit (cached, gzipped, minified)
Once you examine cached speeds the difference becomes much less noticeable (10-30ms difference – with the exception of Prototype/Scriptaculous). Since these results are completely cached we can gauge, roughly, the overhead that’s provided by file transfer, in comparison to evaluation speed).
If nothing else, I think this type of analysis warrants further examination. Using user-generated input, against live datasets, to create real-world performance metrics is quite lucrative to everyone involved – to users, framework developers, and browser vendors.
Web Browser Performance
Finally, this test gives us the opportunity to examine the load speed of some real-world code – specifically, the performance of evaluating the scripts when they’re retrieved from a cache.
Browser Comparison (loading jquery from cache)
There’s a couple things that we can note about the results:
- Even though there aren’t that many samples yet, it’s pretty obvious that Firefox 3 is going to be much faster than Firefox 2 – the full extent will only become apparent after its final release, and further analysis.
- There was a definite jump in performance in IE 7 from IE 6.
- The Opera results are suspect – they were listed as Opera 5 (which doesn’t make sense – who still uses Opera 5?) and are too high – causing me to suspect tampering.