Since you are using apache on both the servers, can you list the apache modules enabled on both these servers? (a command like <span style="background-color:rgb(255,255,255);color:rgb(68,68,68);font-size:14px;line-height:21px">apache2 -l</span> can be helpful) <div>
<br></div><div>Also, is there any kind of web logging software (like AWStats) installed and enabled on your prod server?<br><br><div class="gmail_quote">On Thu, Jan 5, 2012 at 10:49 PM, John Pagakis <span dir="ltr"><<a href="mailto:drupal@pagakis.com">drupal@pagakis.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-US" link="blue" vlink="purple"><div><p class="MsoNormal"><span lang="EN">Posted by <a href="http://drupal.org/user/1746988" title="View user profile." target="_blank">toolsmythe</a> on <em><span style="font-family:"Calibri","sans-serif"">January 4, 2012 at 8:18pm</span></em><u></u><u></u></span></p>
<p><span lang="EN">I'm dealing with an odd performance issue on a production Drupal 7.7 site.<u></u><u></u></span></p><p><span lang="EN">I have a machine that is configured thus:<u></u><u></u></span></p><p><span lang="EN">4gig<br>
Quad proc<br>900GB disk<u></u><u></u></span></p><p><span lang="EN">OS: Debian 6 <u></u><u></u></span></p><p><span lang="EN">For apache we are using version<br>ii apache2 2.2.16-6+squeeze1 Apache HTTP Server metapackage<br>
ii apache2-mpm-prefork 2.2.16-6+squeeze1 Apache HTTP Server - traditional non-threaded model<u></u><u></u></span></p><p><span lang="EN">For PHP we are running version<br>ii php5 5.3.3-7+squeeze3 server-side, HTML-embedded scripting language (metapackage)<br>
ii libapache2-mod-php5 5.3.3-7+squeeze3 server-side, HTML-embedded scripting language (Apache 2 module)<u></u><u></u></span></p><p><span lang="EN">ii mysql-client-5.1 5.1.49-3 MySQL database client binaries<u></u><u></u></span></p>
<p><span lang="EN">Database is on a seperate server.<u></u><u></u></span></p><p><b><u><span lang="EN">The Problem</span></u></b><span lang="EN"><br>We are getting a pretty consistant 5+ second delay before any page on the site renders. It renders quickly once it starts to render, but there is a delay of 5 or more seconds before that happens.<u></u><u></u></span></p>
<p><span lang="EN">Oddly enough, we have a copy of the site running under cPanel that has no delay whatsoever. That box is configured thus:<u></u><u></u></span></p><p><span lang="EN">Apache 2.2<br>PHP 5.2.17<br>Mod SuPHP<br>
CentOS release 5.7 (Final)<u></u><u></u></span></p><p><span lang="EN">Not sure if this is worthy of note, but the production server has Suhosin (PHP hardening) and the copy does not.<u></u><u></u></span></p><p><span lang="EN">We made a second copy on the prod server and it is experiencing the same delay.<u></u><u></u></span></p>
<p><span lang="EN">All the database instances are practically empty.<u></u><u></u></span></p><p><b><u><span lang="EN">What we've tried so far</span></u></b><span lang="EN"><br>We've tried optimizing the tables in MySQL.<u></u><u></u></span></p>
<p><span lang="EN">We've tried applying various optimizations to Apache and MySQL recommended on Drupal pages (for example: <a href="http://drupal.org/node/215516" title="http://drupal.org/node/215516" target="_blank">http://drupal.org/node/215516</a> and <a href="http://drupal.org/node/2601" title="http://drupal.org/node/2601" target="_blank">http://drupal.org/node/2601</a>).<u></u><u></u></span></p>
<p><span lang="EN">No joy.<u></u><u></u></span></p><p><span lang="EN">We did an ab benchmark on both servers. as follows:<u></u><u></u></span></p><p><span lang="EN">ab -n 500 -c 50 <u></u><u></u></span></p><p><span lang="EN">The test server showed this:<u></u><u></u></span></p>
<p><span lang="EN">Benchmarking .com (be patient)<br>Completed 100 requests<br>Completed 200 requests<br>Completed 300 requests<br>Completed 400 requests<br>Finished 500 requests<u></u><u></u></span></p><p><span lang="EN">Server Software: Apache<br>
Server Hostname: .com<br>Server Port: 80<u></u><u></u></span></p><p><span lang="EN">Document Path: /clients///<br>Document Length: 18543 bytes<u></u><u></u></span></p><p><span lang="EN">Concurrency Level: 50<br>Time taken for tests: 50.229747 seconds<br>
Complete requests: 500<br>Failed requests: 0<br>Write errors: 0<br>Total transferred: 9663634 bytes<br>HTML transferred: 9327129 bytes<br>Requests per second: 9.95 [#/sec] (mean)<br>Time per request: 5022.975 [ms] (mean)<br>
Time per request: 100.459 [ms] (mean, across all concurrent requests)<br>Transfer rate: 187.88 [Kbytes/sec] received<u></u><u></u></span></p><p><span lang="EN">Connection Times (ms)<br>min mean[+/-sd] median max<br>Connect: 0 0 1.0 0 9<br>
Processing: 703 4901 5312.1 3312 38328<br>Waiting: 657 4653 4788.4 3134 33105<br>Total: 703 4902 5312.4 3312 38330<u></u><u></u></span></p><p><span lang="EN">Percentage of the requests served within a certain time (ms)<br>
50% 3312<br>66% 4721<br>75% 5718<br>80% 6374<br>90% 10416<br>95% 14444<br>98% 24669<br>99% 33351<br>100% 38330 (longest request)<u></u><u></u></span></p><p><span lang="EN">Meanwhile, here's the same test for our prod server:<u></u><u></u></span></p>
<p><span lang="EN">Server Software: Apache/2.2.16<br>Server Hostname: .com<br>Server Port: 80<br>Document Path: /clients//<br>Document Length: 18760 bytes<br>Concurrency Level: 50<br>Time taken for tests: 314.671 seconds<br>
Complete requests: 500<br>Failed requests: 0<br>Write errors: 0<br>Total transferred: 9757000 bytes<br>HTML transferred: 9380000 bytes<br>Requests per second: 1.59 [#/sec] (mean)<br>Time per request: 31467.146 [ms] (mean)<br>
Time per request: 629.343 [ms] (mean, across all concurrent requests)<br>Transfer rate: 30.28 [Kbytes/sec] received<br>Connection Times (ms)<br>min mean[+/-sd] median max<br>Connect: 0 0 0.3 0 1<br>Processing: 11813 29570 12525.7 27341 126615<br>
Waiting: 11745 29509 12525.6 27281 126535<br>Total: 11813 29570 12525.7 27341 126615<br>Percentage of the requests served within a certain time (ms)<br>50% 27341<br>66% 31105<br>75% 33440<br>80% 35335<br>90% 40918<br>95% 47849<br>
98% 66717<br>99% 84633<br>100% 126615 (longest request)<u></u><u></u></span></p><p><span lang="EN">We tried turnning on Long Running Queries in MySQL; it logged nothing.<u></u><u></u></span></p><p><span lang="EN">top showed nothing of interest.<u></u><u></u></span></p>
<p><span lang="EN">We're stumped over here (though to be quite honest, stumping us is no great feat <grin>, at least when it comes to Drupal). Any thoughts would be much appreciated.<u></u><u></u></span></p><p class="MsoNormal">
<u></u> <u></u></p><p class="MsoNormal"><u></u> <u></u></p></div></div><br>--<br>
[ Drupal support list | <a href="http://lists.drupal.org/" target="_blank">http://lists.drupal.org/</a> ]<br></blockquote></div><br><br clear="all"><div><br></div>-- <br>Cheers,<div>Mukesh Agarwal</div><div>________________________________</div>
<div><font color="#999999"><a href="http://www.innoraft.com" target="_blank">Innoraft Solutions</a> || </font><span style="color:rgb(153,153,153)">+91 8017220799</span></div><br>
</div>