Thursday, April 29, 2010

I give up!

There is nothing else I can do right at this moment to improve usability of the site.

The Internet's attention span can not last much longer....I hope.

There are potentially several bottlenecks where things are hanging, some can be addressed with some hardware upgrades, others maybe more complicated to figure out.

I don't think we are at a do or die stage for getting this figured out, as the vast majority of this is "drive-by" traffic that should probably lesson considerably in a matter of days.

19 comments:

  1. Out of interest, do you know what the major bottleneck is? Network bandwidth/Disk bandwidth/RAM (swapping)/CPU?

    ReplyDelete
  2. Unfortunately its not clear. The only thing that we are clearly approaching the limit of is RAM. RAM is cheap might as well upgrade that, it can't hurt right?

    The CPU doesn't appear to under much duress, there very well might be some network bandwidth issues either with my max upload speed, or even maximum concurrent connections.

    ReplyDelete
  3. Oh, really, it's RAM rather than CPU? I'd have thought it'd be CPU since MediaWiki's arse is so fat.

    (I suggested Varnish to Nx with the aim of cutting CPU. I'm fiddling with a new MW 1.16beta install at work and might shove Varnish in front of that just to see how it goes.)

    ReplyDelete
  4. The load capacity for the CPU is averaging less than 1 on a duo core setup.

    There maybe some bottle necks in Apache or MYSQL as well.

    I think doubling up are RAM is probably a good investment, and to be honest the hard drive we are using is a tad outdated as far as its transfer rate and cache.

    ReplyDelete
  5. Heh, yes. What's the spec of the box it's running on?

    ReplyDelete
  6. Dual CPU E2200 2.20GHz
    2 GB RAM
    Ubuntu 8.10 32 bit

    Roughly the upgrade plan at the moment is pick up 4 gigs of RAM and a new harddrive (higher cache, and transfer rate, maybe higher RPM).

    At this point we can install the new Ubuntu 64 bit OS, transfer over the files and database, drop in the memory, do some voodoo chanting, and voila.

    ReplyDelete
  7. Hell yes. As much memory as you can afford that will fit.

    ReplyDelete
  8. Afford is an operative word.

    The much alluded to play boy life style of grad students is vastly over stated.

    ReplyDelete
  9. Hey, grad students get to feed from the stuff the postdocs spill over the side when they're rummaging through the dumpster. The undergrads don't even get that much!

    ReplyDelete
  10. Trent, check the motherboard if it supports that much memory. Some older boards only support 4 gigs despite being 64 bit.

    ReplyDelete
  11. I'm surprised you're using Ubuntu. I assumed you'd be using Redhat or some other server-specific distro.

    ReplyDelete
  12. Ubuntu has a server edition, although I think we have the desktop edition right now.

    ReplyDelete
  13. I've heard that 64-bit Ubuntu has stability issues (well, more than other OSes anyways). If/when we move to 64-bit, is this something we should be concerned about? (Or would it only come up if Trent uses the server to peruse flash-based sites? : ))

    ReplyDelete
  14. "I've heard that 64-bit Ubuntu has stability issues (well, more than other OSes anyways)."

    What in particular?

    ReplyDelete
  15. What spec of RAM would be used in that box?

    ReplyDelete
  16. Can you configure mediawiki to completely cache particluar landing pages, such as the ones being hit by the FriendFace traffic, to reduce the processing the server has to perform?

    ReplyDelete
  17. Eaccelerator and Memcache do that for us all ready.

    This things can't really be used though for some of the other high traffic areas of the site like saloon bar, or wigo CP

    ReplyDelete
  18. To take it a step further you could redirect static content like images to the Coral CDN (http://en.wikipedia.org/wiki/Coral_Content_Distribution_Network), that should definitely reduce the servers work load. I've used it on a few database driven sites to redirect all images even site graphics to Coral and saw a huge decrease in server load and bandwidth.

    ReplyDelete
  19. What about resurrecting the old non-mw forums and destroying the saloon bar and mw forums?

    ReplyDelete