Back in June I moved my website hosting from MediaTemple to Dreamhost. I was happy with the decision, but you don’t totally know if you made the right decision until you have a real test of the new web host. Last week I had a major issue with my sites and I thought it would be good to follow up with my earlier “MediaTemple vs. Dreamhost” review by outlining my experience. These kind of posts can be pretty boring and technical, so if you are just looking for a one sentence summary it is this: Dreamhost does a pretty good job, but it depends a great deal on the individual person giving you technical support. I still recommend them and if you are looking to switch, you can save $50 from Dreamhost if you use the promo code “adrian3″ when you sign up for a year.
So let me tell you what happened. My websites went down and I went digging around to see what caused the downtime. I am on DreamHost’s private server which allows you to manage the resources associated with your account. This has a nice feature that allows you to monitor how much CPU usage and memory your account is using at any given time. Here is what the previous week looked like for me:

This is showing weekly averages, so what was actually happening was much more severe than it looks. For example, the 400mb spike is actually happening on the same day as my sites being offline. So, despite big chunks of time when the CPU usage was effectively 0, there were times when I was spiking above 500mb which in turn killed my site again. Look at this mess when you zoom in to an hourly view:

The most frustrating part about a situation like this is that it is terribly hard to isolate the issue causing the problems. Is it a script gone wild? Is it a WordPress plugin? Is it the server itself? Here is a list of things that I did to try to identify the problem, none of which ended up being the real issue:
• Upgraded all WordPress installations
• Upgraded all WordPress plugins
• Eliminated WordPress plugins (like all-in-one SEO pack)
• Replaced WordPress plugins
• Reverted to default WordPress plugins
• Turned off Mint
• Turned off Fever
• Turned off TweetNest
• Turned off OpenX ads
• Took sites on and offline systematically
• Reviewed access logs
• Reviewed error logs
As best I can tell, this is what was actually happening. Font Burner just uses a ton of resources and it finally hit a point where it overwhelmed my servers. Because so many sites hotlink to the javascript, css, and swf fonts on the site, there is a constant stress on the server. Hundreds of sites are serving up thousands of pages that are accessed thousands of times every day. Each time a page is loaded on one of these sites it makes 1-6 request of the Font Burner server. Since the load is spread out across so many sites, it is hard to reduce this usage. Surprisingly, taking fontburner offline completely didn’t even reduce the load because this doesn’t reduce the amount of requests coming in from the outside. So even though the site was technically offline, the server was still getting bombarded with requests. With the site offline, these turn into errors. And errors require cpu usage to be handled. Even an htaccess rule that blocked hotlinking wasn’t enough to keep the site online.
So I was in a really tough spot. I couldn’t take the site offline and I couldn’t leave it up. Either way, the site was crashing DreamHost’s server. Finally, in desperation I changed the dns settings to point to an unused hosting package I had on 1and1.com. This at least would redirect the nuclear waste pointing at my site. I thought this would cripple the 1and1 server, but to my surprise it has stayed up so far.
To reduce the amount of resources used by Font Burner I made a fundamental change to how Font Burner works. I can’t afford to let people hotlink to my files any more. So, I blocked hotlinking with .htaccess. I took some of the files that get hotlinked to offline completely. I changed the instructions to encourage people to host files themselves. This is a bit more work for the average user, but it will benefit everyone since they won’t rely on my site being online for their fonts to get served. To read the full change announcement, you can click here.
Finally, I want to post transcripts of my correspondence with Dreamhost technical support. Probably not the most fascinating read, but it might give you insight into the type of help and timeframe of their responses. Hopefully this is helpful to you…
Customer Name:
Webid: adrhan
Begins: 2010-09-21
Ends: 2010-09-21 09:53:13
Duration: 4.8 minutes
info: Please wait for a site operator to respond.
info: You are now chatting with ‘Brandon’
Brandon: Hi, how may I help you?
me: My sites are down. It doesn’t seem to be listed in your system status blog. Can you look at adrian3.com?
Brandon: I’d be glad to. One moment please.
Brandon: Hmm. It looks like your scripts are being killed for going over the set memory limits on your PS. Please e-mail me at brandon@dreamhost.com from the address associated with your account so I can provide you with further details.
me: okay. just sent it.
Brandon: Great. I’ll be in touch ASAP!
info: Chat session has been terminated by the site operator.
By email, Brandon wrote:
Hi Adrian, I’m very sorry that you’ve been running into this issue.
I’ve checked into why you’ve been receiving these internal server errors,
and it seems your scripts have been getting automatically killed by the
host machine due to your memory usage spiking above the set limits on
your PS:
Sep 21 12:14:04 homie-vserver118 debuglogger: ps26964/memory.failcnt 11806
Sep 21 12:18:04 homie-vserver118 debuglogger: ps26964/memory.failcnt 11928
Sep 21 12:26:04 homie-vserver118 debuglogger: ps26964/memory.failcnt 8161
Sep 21 12:28:05 homie-vserver118 debuglogger: ps26964/memory.failcnt 1949
Sep 21 12:30:04 homie-vserver118 debuglogger: ps26964/memory.failcnt 4659
Sep 21 12:32:04 homie-vserver118 debuglogger: ps26964/memory.failcnt 7663
Sep 21 12:36:04 homie-vserver118 debuglogger: ps26964/memory.failcnt 658
Sep 21 12:38:04 homie-vserver118 debuglogger: ps26964/memory.failcnt 4548
Sep 21 12:40:04 homie-vserver118 debuglogger: ps26964/memory.failcnt 5730
Sep 21 12:42:05 homie-vserver118 debuglogger: ps26964/memory.failcnt 8021
This log basically shows us when the host machine (on which your PS runs)
had to forcibly kill a script running on your PS in order to prevent the
PS from using more than the memory allotted.
Please understand that while you may not be hitting your disk space or
bandwidth limits, these are actually entirely different things.
Also, as the spikes typically occur and are then subsequently killed
within milliseconds, they often don’t register on the panel memory usage
graphs at all.
I would highly recommend that you follow the steps in the following wiki
articles in order to reduce your usage:
http://wiki.dreamhost.com/Finding_Causes_of_Heavy_Usage
http://wiki.dreamhost.com/PS_Optimization
Also, please be aware that the site displaying the error isn’t
necessarily the one responsible for the total usage involved.
For instance, if Site A is using 90% of your allotted memory usage, and
then Site B attempts to use an additional 15%, Site B will be 5% over and
will get it’s script killed.
I’d also recommend looking into any 3rd party plugins you may be running,
especially if you happen to be running WordPress installs as they can be
notoriously poor at memory management.
You may find this link helpful in specifically optimizing any WordPress
installations:
http://www.prelovac.com/vladimir/wordpress-optimization-guide
Lastly, you may want to look into raising your memory limits via “Private
Servers” > “Manage Resources”. This will especially make it easier to
diagnose the problem without the scripts constantly getting killed while
you’re attempting to resolve the issue.
Thanks!
Brandon
My response:
Thanks, Brandon. I appreciate the links to the helpful info. The strange
thing is that when my site goes down I can’t even connect by FTP. That makes
it really hard to troubleshoot things. Is there anything I can do to keep my
site up for long enough to fix things?
Adrian
By email, Brandon wrote:
Hi Adrian,
Throwing up the memory limits temporarily should help with being able to
connect so that you can troubleshoot things
Thanks!
Brandon
Customer Name:
Webid: adrhan
Begins: 2010-09-21
Ends: 2010-09-21
Duration: 74.3 minutes
info: Please wait for a site operator to respond.
info: You are now chatting with ‘danielj’
danielj: Hi! How can I help?
me: Hi. My site is hitting some limits and scripts are getting killed. At least that’s what a dreamhost person told me earlier. The site came back online for a few minutes, but now it is down again. I can’t login by FTP so I can’t really change anything to reduce my server load. Can you advise me?
me: The domain is adrian3.com
danielj: ok let me check it out
me: It looks like I started getting resource spikes on the 19th. That’s when I installed an app called Tweetnest.
danielj: ok, yeah the server should be accessible in the next few minutes, I have an admin looking at it
me: I deleted the database about tweetnest a half hour ago. But that hasn’t helped.
me: Sorry. That didn’t make sense. I meant…
me: I deleted the database for tweetnest about a half hour ago…
danielj: no problem I understood what you meant
danielj: ok the server was just restarted, you should now be able to log in
me: I am in.
danielj: great
me: Can you tell if this was the same issue as earlier or something new?
danielj: it appears to be the same issue
me: Okay. I am going to take tweetnest offline and see if that fixes things.
danielj: ok
me: I am watching my my “Load” numbers in the Dreamhost P.S. panel.
me: It looks like that is a couple hours behind real time. Is that a correct assumption?
danielj: oh yeah it’s not real time, though it should be about 15 to 30 minutes behind real time I think
me: So if the server needed to be restarted does that mean my site killed the server? Yikes.
danielj: it looks like it was the case this time
me: My memory usage never goes beyond 286 it seems. My limit is 300. Do you think I am hitting the limit consistently or am I in the safe zone?
danielj: let me check
danielj: it looks like you have been hitting the memory limit, it basically never shows higher than 280ish because the processes which are being killed would normally take more than 20MB
me: I see.
danielj: is there anything else I can help you with?
me: No. Thanks very much for your help.
danielj: anytime!
info: Chat session has been terminated by the site operator.
Customer Name:
Webid: adrhan
Begins: 2010-09-21
Ends: 2010-09-21
Duration: 8.3 minutes
info: Please wait for a site operator to respond.
info: You are now chatting with ‘Jeremy T.’
Jeremy T.: Hi there! how can I help you?
me: Hi Jeremy. I am wondering if you can help me with a unique hotlinking question.
me: Are you an htaccess wiz?
Jeremy T.: A bit, what’s up?
me: I have a site with you guys at fontburner.com. It basically is a service that allows people to use sIfr fonts that I host for free.
me: So I am encouraging people to hotlink to my files.
me: But I am hitting my bandwidth limits.
me: I need to block certain ip addresses from hotlinking to .swf files.
me: I think if I blocked a few of the heaviest users I could significantly reduce my total bandwidth.
Jeremy T.: Okay, here’s a guide on blocking hotlinking:
Jeremy T.: http://altlab.com/htaccess_tutorial.html
me: But .htaccess scares me and I am not sure I can figure out how to just block ip addresses. Do you know if that is even possible?
Jeremy T.: You just need to add one line to it, one of the conditions from this page:
Jeremy T.: http://www.netshinesoftware.com/component/option,com_myblog/Itemid,65/show,Restr icting-access-to-a-URL-by-IP-address-using-mod-rewrite.html/
me: That looks promising.
Jeremy T.: If you combine those two, you shoud be good to go.
Jeremy T.: Well, have a good day!
info: Chat session has been terminated by the site operator.
Customer Name:
Webid: adrhan
Begins: 2010-09-21
Ends: 2010-09-21
Duration: 17.1 minutes
info: Please wait for a site operator to respond.
info: You are now chatting with ‘Jeff M’
Jeff M: Hello, how may I help?
me: Hi, Jeff. I am having trouble writing an .htaccess rule.
me: There is an offensive website that is hotlinking to a .swf file on my site.
me: Everything I have read tells me that the rule I wrote should work, but I am missing something.
me: Can I show you the rule I have written?
Jeff M: Sure, I can’t guarantee I can help though
me: Warning, it has an offensive site listed in it…
Jeff M: Also, we have a guide on this
Jeff M: http://wiki.dreamhost.com/Preventing_hotlinking
me: RewriteEngine OnRewriteCond %{HTTP_REFERER} !^http://(www\.)?baddomain\.net [NC]RewriteRule .*\.(jpg|jpeg|swf)$ – [NC,F,L]
me: I am wondering if this only works for images and not swf files.
Jeff M: Looks right to me, based on my limited knowledge.
me: Hmmm. The swf still shows up on there site. The swf gets called from a javascript. Could that affect things?
Jeff M: I don’t know.
Jeff M: I’ve never set this up myself.
me: I think I have it working.
me: Thanks for your help.
Customer Name:
Webid: adrhan
Begins: 2010-09-22
Ends: 2010-09-22
Duration: 15.2 minutes
info: Please wait for a site operator to respond.
info: You are now chatting with ‘steve’
steve: Hello! How may I assist you?
me: Hi steve. Over the last two days I have been getting huge spikes in my CPU usage that I am seeing in the chart on my P.S. “Manage Resources” screen.
me: Can you help me pinpoint where it is coming from?
me: It has been steady at 0mb for months.
me: My domain is adrian3.com
steve: Having a look
steve: It looks like the big CPU user is a PHP process under the ahanft3 user. Unfortunately, it doesn’t show us what exact process that is. Have a look at this page in our wiki to view your usage and determine what’s causing it.
steve: http://wiki.dreamhost.com/PS_Optimization
me: I read that yesterday.
steve: Also, have a look at-
steve: http://wiki.dreamhost.com/Finding_Causes_of_Heavy_Usage
steve: Skip down to Checking Processes.
me: I am terrible at command line stuff. I can’t figure it out.
Customer Name:
Webid: adrhan
Begins: 2010-09-22
Ends: 2010-09-22
Duration: 34.7 minutes
info: Please wait for a site operator to respond.
info: You are now chatting with ‘george’
george: Hello
george: how can I help you?
me: Good morning.
me: I am hoping you can help me.
me: All I get is links to the dreamhost wiki from other people I talk to. I need some real advise.
me: advice.
me: I am trying to track down the source of spikes in my cpu usage.
me: My domain is adrian3.com
me: I am too dumb to do any command line things. I am on a mac and I can’t get terminal to connect to the server.
me: Over the last two days I get giant spikes in cpu usage.
george: well you’re going to need to connect via ssh to run the commands
me: Then I need you to walk me through getting that to work.
me: I can’t connect because I get this error.
me: Offending key in /Users/Adrian3/.ssh/known_hosts:1RSA host key for adrianhanft.com has changed and you have requested strict checking.Host key verification failed.Adrian-Hanfts-Computer-4:~ Adria
george: try removing your .ssh/known_hosts file
me: okay. where would I find that?
george: or even better edit the file
george: it’s listed in the error
george: /Users/Adrian3/.ssh/known_hosts
george: this is a mac issue that you should sort of by either searching the web or checking a mac forum
george: when you have that sorted contact us via the contact support page in the panel
george: https://panel.dreamhost.com/index.cgi?tree=support.msg&
me: It’s not a mac issue.
me: It is a spike in traffic on YOUR SERVER.
me: You guys just dodge the questions.
me: It’s really frustrating.
me: I need HELP.
george: your inability to connect via ssh is an issue on your end
me: Who can I talk to about the REAL issue?
me: Forget it.
me: You guys are worthless.
me: Nothing has changed on my site.
george: so you want us to figure out the issue then just let you know
me: And all of a sudden I get huge spikes that I can’t identify.
george: give me a few minutes
me: All I want is help so I can identify where the problem is.
george: that will require you to connect via ssh
george: one moment
george: fontburner.com is getting the most traffic
george: you’re going to want to get rid of all of this:
george: all-in-one-seo-pack
george: You’re going to need to make sure you’ve optimized the install and that you’re running FCGI and not cgi.
george: you can replace all-in-one-seo-pack with platinum seo pack
george: it runs better
me: Great advice! THanks.
me: Good to know.
george: If you haven’t already, you should also download and enable either wp-cache or wp-super-cache
me: We use the all-in-one seo on a bunch of sites where I work. I didn’t realize it was a resource hog.
me: I use w3 Total Cache.
me: Is that one any good?
george: that alone can get some site with decent amounts of traffic to get kicked off of our shared servers
george: any caching solution is good
george: we know that supercache runs well
george: checking what’s currently running under your user
george: I know you don’t want to see another wiki, but fontburner can use this http://wiki.dreamhost.com/Preventing_hotlinking
george: so fontburner is the cause
george: using 338
george: I disabled it for a sec
george: the ps was using 114
george: you’re still going to want to take care of the seo plugins but fontburner needs the most attention
me: I am working on the hotlinking issue.
george: good
me: That site kind of encourages hotlinking. So there are a ton of sites linking to my files.
me: I am trying to contact the big sites that are using my bandwidth and having them host the files themselves.
george: here are the top 10 IP hitting your site:
george: 102 87.14.226.194
115 94.193.69.208
116 98.232.199.18
121 79.213.197.55
125 98.17.182.244
130 208.78.53.179
239 64.132.49.242
240 87.153.110.155
243 87.89.61.206
354 86.131.252.193
me: Awesome!
me: I can block them with .htaccess I think.
me: I will try to give them a chance to stop the hotlinking before I pull the plug on them.
george: not sure if you want to
george: but you can
george: okay
george: here’s a link that might help with your ssh issue
george: http://forums.macrumors.com/showthread.php?t=367310
me: Thanks for looking that up for me. Sorry I got frustrated with you guys.
me: Now that I am certain that Font Burner is the major drain, I can do some work to clean up how that site works.
george: okay
george: take care
info: Chat session has been terminated by the site operator.
Customer Name:
Webid: adrhan
Begins: 2010-09-23
Ends: 2010-09-23
Duration: 23.9 minutes
info: Please wait for a site operator to respond.
info: All operators are currently assisting others. Thanks for your patience. An operator will be with you shortly.
info: You are now chatting with ‘chalise’
chalise: Hi, how can I help you?
me: Good morning. I have been talking to you guys for the last few days about spikes in my memory and cpu usage on my domains. Out of the blue it just skyrocketed and we can’t figure out why. I have gone through all your wiki articles and nothing seems to help. I have eliminated WordPress plugins, I have optimized my databases, taken sites offline, I have prevented hotlinking, I have cleaned up my themes – pretty much anything I can think of. Nothing seems to work. Can you take another look and see if you can tell if there is something else that might be causing the excessive load? My domain is Adrian3.com
chalise: Have you tried disabling any cronjobs you my have set to run?
chalise: Honestly, the information on our wiki pages are exactly the same things we’d check as well.
me: I don’t have any cronjobs. Although, WordPress might use cronjobs, right?
chalise: Actually, it looks like you have one set to run every hour.
chalise: Goodies / Cronjobs in your panel
me: I will take a look.
me: How much of a toll does a single cron job cost in terms of cpu and RAM usage?
chalise: It depends on what the script you have it set to execute is coded to do.
me: It just refreshes a page.
me: I will disable it and see if it has any effect.
chalise: You may also want to try clearing out any old scripts or old files you’re not using.
me: Okay.
me: Is there a way to elevate my issue? Because I have exhausted the wikis. Something is wrong with my site as of 3 day ago. Nothing changed on my end at that point. And now I can’t keep the site online because the spikes are so extreme.
chalise: Honestly, there’s very little we’re able to do to help you troubleshoot your scripts, themselves.
me: None of my scripts changed.
me: And if the problem were a script, I can’t identify which one (or ones) are causing the problem.
me: Seriously, I have spent days optimizing things. Nothing works, and I could seriously use some help. Is there anything you can do for me?
chalise: I’ve gone through your support history and seriously, everything that has been suggested is exactly what I would suggest and all we can really offer as that is exactly what we check as well. If you’re running a script or many scripts on your PS, it is really important to know how to troubleshoot them, or to have a developer or contact with the developer who created them who can lend you some advice.
chalise: I just had my supervisor take a look at the same things I was checking and the only thing he suggested was that if you really think it’s something on our end, to go ahead and submit a support ticket and request to move to a new host machine.
chalise: However, if the problem is your sites and what you’re running on them, that’s not going to fix the problem.
me: Okay, thanks.
chalise: Sure thing.
chalise: Good luck and have a good day!
info: Chat session has been terminated by the site operator.
Customer Name:
Webid: adrhan
Begins: 2010-09-23
Ends: 2010-09-23
Duration: 20.8 minutes
info: Please wait for a site operator to respond.
info: You are now chatting with ‘john’
john: Hello, what may I assist you with today?
me: Hello. My sites are down again. Can you help me get it back online? I have rebooted my P.S. and it isn’t coming back online.
me: The domain is adrian3.com
john: Let me check that out for you one moment
john: seems to be the apache server
john: I am going to kill and restart that
me: okay, thanks.
john: That did it
john: there were a bunch of these:
dhapache 7043 0.0 0.0 0 0 ? Z 14:01 0:00 [apache2-ps26964]
dhapache 7044 0.0 0.0 0 0 ? Z 14:01 0:00 [apache2-ps26964]
dhapache 7045 0.0 0.0 0 0 ? Z 14:01 0:00 [apache2-ps26964]
dhapache 7046 0.0 0.0 0 0 ? Z 14:01 0:00 [apache2-ps26964]
dhapache 7047 0.0 0.0 0 0 ? Z 14:01 0:00 [apache2-ps26964]
dhapache 7048 0.3 0.0 0 0 ? Z 14:01 0:00 [apache2-ps26964]
dhapache 7049 0.0 0.0 0 0 ? Z 14:01 0:00 [apache2-ps26964]
dhapache 7052 0.3 0.0 0 0 ? Z 14:01 0:00 [apache2-ps26964]
john: so I manually killed them off and it started up
john: I also agree with your appreciation of Apple =)
john: is there anything else I can help you with?
me: Ha! Thanks.
me: I have been watching my resources over the last 24 hours and I get massive spikes and falls.
john: You might try sifting through access logs
me: Is there any way to know if this is the same apache errors?
me: Okay, I will.
john: if you’ve noted when the spikes are you should be able to look at time stamps
john: and see what’s being called right at that moment
me: I have a 6mb error log, so something is going on.
john: could be in there as well
john: if not the access.logs should say what script/page is called
john: if it comes to it I am able to install our process watcher for you as well
me: I have been talking to you guys for the last few days but can’t isolate the problem.
john: that runs on shared only usually
john: and it kills runaway processes
me: Oh really? That might help.
john: it’s not a ‘fix’ but it might serve as a solution
john: =)
john: here’s my direct address: john@dreamhost.com
me: I thought we had isolated it to my site fontburner.com. So I moved that to a different web host this morning.
john: feel free to hit me up directly if you would like me to install it (we can always remove it later too)
me: But things seem to be getting worse not better.
john: maybe requests are still hitting the server?
me: Thanks for the email.
john: of course =)
me: I will let you know if I end up needing that.
me: Maybe, so.
john: one moment
me: I will let things settle down (hopefully) and see what’s left when the dust settles.
john: let me ask one of our admins if he has any suggestions too
john: our apache expect shows as available on jabber
john: so hopefully I can grab his attention
john: I am still seeing requests for that one site
john: 0-1 16474 0/4/107 _ 0.00 3 399 0.0 0.00 0.37 64.234.84.101 www.fontburner.com GET /flash/asenine.swf HTTP/1.1
john: but they probably just have slow DNS
john: you just moved that today right?
john: the only other active request I see is for your other site:
3-1 16464 0/7/78 _ 0.00 0 385 0.0 0.00 24.84 95.108.246.253 www.beadesigngroup.com GET /blog/archives/2008/01/live-designblog-i-fail-to-design-a-c
john: which did take a while to load
john: the front page that is
john: do you have your WordPress sites fully optimized?
me: Yes, fontburner.com got moved today.
me: Yes, I have been working to optimize my WP installs.
john: one of my minions found this:
http://www.prelovac.com/vladimir/wordpress-optimization-guide
john: he swears it’s the best one he’s run across so that might come in handy
me: Checking plugins, etc.
john: caching is the big one
john: that seems to cut down on overhead a ton
me: You guys sent me that link yesterday. I have read it thoroughly.
john: oh ok sorry just making sure all bases are covered
john: if you like I can email you if he gets back to me, looks like he’s caught up on other projects as he hasn’t responded yet
me: No, that’s good to know I wasn’t chasing a ghost!
me: Okay.
me: My email is designer@adrianhanft.com
john: got it
john: aah also this was just called
john: 9-1 22501 2/29/76 C 0.12 1 124 15.6 0.14 0.24 75.71.108.198 www.adrian3.com GET /mint/?record&key=6734323451363732353851486e4879584b584b326
me: Thanks for your help.
john: I know mint can be troublesome
john: I am not sure if it can be optimized
me: Oh? Interesting.
john: I am just looking at your apache status
john: and reloading it to see what comes up
me: At this point I could get rid of Mint if that were the problem.
john: it might be something to test for a day
john: I am not sure how frequent the outages are
john: but if it’s daily that would be one to test
me: Definitely. Outages seem to be a handful of times each day.
john: I used to work on unstable shared hosting servers and I remember seeing Mint crash a few back in the day – it may be better coded now but it’s worth a look
john: anyways I’ll get in touch if he responds and do let me know if you would like me to just pop the process watcher on there to keep it under control
me: Do you think I can just rename my mint folder? Or do I need to strip out the javascript code from my themes that uses Mint?
john: Sorry we don’t have a tool to just track the problem for you – it’s pretty tricky determining what’s causing spikes sometimes
john: I think re-naming it would do it
me: Cool. Thanks.
john: that’s how I used to disable it previously
john: Was there anything else I can help you with in the meantime?
me: I have talked to probably 6 people at Dreamhost on this issue. You are the first to give me hope!
me: Thanks. That is all for now.
me: Is there any way to contact you directly in the future?
john: john@dreamhost.com
john: you may also ask for me on chat
john: but I am not on all the time
john: the other managers and myself rotate
me: Thanks, so much.
me: Bye.
john: Cheers!
info: Your chat transcript will be sent to designer@adrianhanft.com at the end of your chat.
Customer Name:
Webid: adrhan
Begins: 2010-09-23
Ends: 2010-09-23
Duration: 43.0 minutes
info: Please wait for a site operator to respond.
info: You are now chatting with ‘Sam’
Sam: Hello!
me: Hi. I was talking to john@dreamhost.com and he told me I could request to have a process watcher turned on for my P.S.
me: My domain is adrian3.com
me: Is that something you can activate for me?
Sam: Checking for ya!
Sam: Yes we can, and I will for you
Sam: Yall ready for this?
Sam: and yes, feel free to imagine that I did actually play the song
Sam: k might take some time
Sam: your system is not responding
Sam: so i will do the needful
me: Thanks! Oh, and I appreciate the music reference. I am singing along with you.
me: You probably already looked at my history, but you guys restarted apache for me a couple hours ago.
Sam: haha awesome
Sam: Yes, I do see, I have it stopped right now as I set things up
me: This has been a heck of a week for my sites. I can’t keep them online. I am wondering if I need to switch to a different P.S. machine or something.
Sam: Ok, procwatch is installed now
Sam: configured and running, turning on your apache
me: Cool. Do I access that from my control panel then?
Sam: Its all automated and running in the background of your PS
me: Things must be back online. My CPU usage just shot up to 500mb again. Dang!
Sam: 219 used right now
Sam: 230
Sam: now 196, so its up and down a bit right now
Sam: fontburner.com is really the only one being visited right now
Sam: and there is no reason for you to be using so much memory, considering traffic alone
me: That’s weird. I changed the dns for that domain early this morning.
me: It is now hosted through 1and1.
Sam: So, you must be running some processes, perhaps web scripts, that could be eating up memory
me: Can I still be using scripts if the site is offline?
Sam:
ps26964:/home/ahanft3/logs/fontburner.com/http# awk ‘{print $7}’ access.log|cut -d? -f1|sort|uniq -c|sort -nk1|tail -n10
1125 /flash/engebrechtre.swf
1235 /flash/geosans_light.swf
1417 /flash/candara_bold.swf
2635 /css/fontburner.css
2694 /css/fontburner_print.css
2738 /flash/andron_scriptor_web.swf
2798 /fontburner.js
2829 /flash/cuprum.swf
4055 /flash/delicious_smallcaps.swf
25759 /flash/fontin_sans_bold.swf
Sam: Yes you can, scripts will run on your server
Sam: But without apache, no website to use
me: That’s interesting.
Sam: Top 10 files being visited on your page
me: Those are the files that other sites were hotlinking to.
me: So I blocked hotlinking with htaccess.
me: And yet they are still getting pounded apparently.
me: I don’t get it.
Sam: http://wiki.dreamhost.com/Preventing_hotlinking
me: If I were to rename my fontburner.com folder would that kill all the processes?
Sam: You should consider raising your memory, and maybe removing the file will help lower your memory usage
me: Well, I moved the site to 1and1 so once that goes away my memory levels should drop to normal.
me: I hope.
me: /fontburner.js is a file that I renamed this morning because I suspected it.
me: What happens when a site hotlinks to a file that is no longer there? Does that cause an error?
Sam: I recommend that you review the following article
Sam: http://wiki.dreamhost.com/PS_Optimization
Sam: It errors out, the server still has to respond and reply to their request
Sam: So, albeit less things to do, the traffic could still be flowing in
me: Maybe all my cpu usage is from the sites hotlinking to files that are no longer there.
me: That kind of makes sense.
me: Well, the dns should have all switched over to 1and1 servers. So it is still puzzling that Dreamhost would be handling anything for that domain.
me: But, 1and1′s control panel is down. So I can’t get in there and confirm anything. That’s the way it has been going for me.
me: I have the touch of death.
Sam: Lol! Big words
Sam: how long ago the switch?
Sam: cached DNS servers can still be serving it to us
Sam: and since your domain is hosted here, its going to handle the requests until those servers recognize 1 and 1 as the host
me: It was over 8 hours ago.
Sam: Servers around the world take 4 hours or longer to update their DNS
Sam: They query the nameserver, us, to retrieve the update
Sam: I cannot guarantee that all DNS servers around the globe will update at the exact time
me: I will give it some time. Thanks for your help. And the tunes!
Sam: ^_^
Sam: take care
info: Chat session has been terminated by the site operator.