Even a minimal amount of caching can greatly boost your site’s performance. Here’s a comparison on dmwl.net of no caching vs. drupal: