THE YAHOO RULES for High Performance Web Sites:

1. Make Fewer HTTP Requests
2. Use a Content Delivery Network
3. Add an Expires Header
4. Gzip Components
5. Put Stylesheets at the Top
6. Put Scripts at the Bottom
7. Avoid CSS Expressions
8. Make JavaScript and CSS External
9. Reduce DNS Lookups
10. Minify JavaScript
11. Avoid Redirects
12. Remove Duplicate Scripts
13. Configure ETags
14. Make Ajax Cacheable

Also check out this related articles

• SitePoint - Web Site Optimization: 13 Simple Steps
• Y! Developer Network - Performance
• Y! User Interface Blog - Performance
• Suggested reading