This group is dedicated to solutions and approaches for high traffic, high performing Drupal sites. As such, it will deal with a lot of information around the rest of a typical Drupal "stack" -- the operating system, web server, database, and PHP tweaks that combine to support the Drupal application.
This is not a support channel or a place to post bug reports.
If you think you have found a bug, use the issue queue for the appropriate project.
If you need support, see http://drupal.org/support for options.
We have a fairly high traffic site 1.5 million page views a month. The site uses a fairly standard Panels node override for displaying individual nodes. Left side gets node content such as title, content body and node comments. Right sidebar gets a latest stories block, an ad, and related stories block. Actually panels panes in most cases not blocks. We do run memcache and Varnish but we find that the traffic pattern always includes a number of uncached requests and scaling the site up mean delivering a single page as fast as possible.
Devel outputs this.Read more
I work for a web design company and part of our service is hosting for our clients. We buy hosting in the form of VPS accounts and put a certain number of clients on each account depending on their usage and the 'size' of the VPS.
For example, I have one VPS that has 1G of RAM and 32 cores and I run 12 sites each in their own cPanel, each with bandwidth anywhere from nothing to (at peak) 130G/month. I have another VPS with 5G of RAM, 16 cores and almost 50 sites with usage from nothing to 65G for a couple of them.Read more
I have a drupal installation with two frontend servers, which have a memcached server in each. If I'm surfing the frontend 1 and the frontend 2 memcached goes down, the page stops loading correctly. Has anyone ever had this problem?
Thank you very much.
I wrote a post here about this also but want to get some tips from this group if possible. https://drupal.org/node/2200175
What I want to know is how do you optimize drupal admin UI, or to be more exact how to make views admin UI react quicker or instantly.
I am looking for
-hacks(exclude something just for dev enviroment)
-raw power suggestions (use SSD (I do locally) use more ram, put DB in RAM somehow, use other type of DB)
-modules (memcache or some other, I use memcache for now)
-server setups (switch to prefork/worker apache, move to some other server nginx)
I have a Drupal with the majority of users logged
Approximately 25,000 pageviews per day.
Two front and two backend servers.
APC and Memcached installed.
Authcache for authenticated users.
Some 5,000 nodes and 20,000 reviews, about 20 types of content.
Approximately 100 modules.
The loading time of the web for a single user is about 3-5 seconds, but for 100 concurrent users are more than one minute.
What could be done?
Thank you very much.
Who are we?
Crifkin is a small team of engineers working on several interesting projects; NOT just Drupal. Our current projects are using: nodejs, chef, angularjs, custom php APIs, and yes, Drupal. As a team we are interested in solving business problems with the best technology we can deliver. We are constantly pushing our boundaries to stay current as to what is going on out in the world and to avoid the dreaded "dinosaur complex" we all face working in the world of technology.Read more
I've got Nagios and Munin up and running for my infrastructure. Now I've got to figure out how to best utilize those tools so that I'm not wasting system resources in the process of monitoring the system!
I searched on "nagios" and "munin" to see if there were any posts that already addressed this question. I didn't find any that answered my specific questions. But, for the sake of starting out by adding some value with this post, here is the list of things that are at least relevant:
I currently work on a Drupal 6.x site that has over 100,000 nodes and over 100 content types. Some content types have 45 or 50 fields. The developers who built the site originally wrote a custom module to display taxonomy pages for each content type. It's a directory listing site and the owner frequently adds new content types for different kinds of businesses, so the list keeps growing. Eventually, the developers started creating a new module for each new content type when the original module started getting big.Read more
Building classified ads project which will use some heavy emailing: reminders, subscriptions, order confirmations and so on. Expect to be tens or hundreds thousand of emails per day. It may seem not huge quantity and standard Drupal email sending just works, but server and Drupal itself has more important tasks to do as sending batches of emails.
Which alternate and faster email sending modules would you recommend? Reliability and "set and forget" modules are also a priority.
Had a strange problem today that took my entire CentOS LAMP server offline. "top" command showed httpd using almost 100% of my CPU & a massive memory consumption within moments of starting up. "free -m" command would show the httpd process spiral up to consume all the RAM in less than one minute.Read more
Just a heads up that the newer version of metatag has a bottleneck with lots of node revisions. https://drupal.org/node/2183203
In our case we had a node load take over 8 seconds because the node has over 100k revisions. Raw output from my debug code
hook_entity_load metatag in 8.2447 seconds
hook_entity_load rdf in 0 seconds
hook_TYPE_load webform in 0.0443 seconds
hook_TYPE_load bf_field_mapper in 0.0401 seconds
hook_TYPE_load comment in 0.0165 seconds
hook_TYPE_load print in 0.0159 seconds
hook_TYPE_load scheduler in 0.0159 seconds
Anyone else noticed Linode slowing quite a lot in the last 4-5 weeks?
I have felt the site slowing lately but it's clearly illustrated on my google crwal stats in webmaster tools..
I have even had them move my server to another host but it made no difference..
Just wondering is anyone else has noticed it..
I've been running an Drupal7 setup with Varnish3 & Memcached.
I'm building a new instance for similar use, and have decided to replace Memcached with Redis/phpredis.
The redis server+extension install was painless -- the system is up & running.
What's missing for me is a good guide to tuning Redis for Drupal use. I'd tuned memcached using info from both own experience & forums.
I've not yet found any similarly focussed good guides, examples, etc for Drupal on Redis -- either for the server conf, or a redis.ini
Can anyone share, or point to, some good guidance?
Plan and discuss the first Extreme Drupal Games (aka the "Golden Neckbeard" competition) for GLADCamp 2014
This year's GLADCamp conference will feature the first Extreme Drupal Games! This event will run throughout the conference, beginning on Friday, March 7th and ending when winners are announced at the closing of the conference on Sunday, March 9th.
We have a sponsor who will be donating 6 identical VMs (distro and stack TBD) for us to use during the conference. I've asked that each VM have a minimum of 2 cores and 4GB of RAM, but exact specs are still being worked out. These VMs are hosted at 1 Wilshire in Downtown Los Angeles, so there will be extremely low latency.
The plan right now is for up to 6 teams to compete over the course of the weekend, tuning both the stack and the Drupal application to get the best possible performance in the allotted time. The team with the fastest Drupal site at the end of the conference will be declared the winner.
Now that we have a date and time, the question is how we're going to load test and judge the teams. What are the rules? Do we test for both anonymous and logged in users? Will contestants be permitted to rip out pieces of the stack and install completely different ones? How about the use of premade scripts? Do we allow commercial software, or go 100% free and open source?Read more
We have a large multisite install with varnish in front of it. We have had an increase in traffic in the last week and are getting a lot of segmentation faults from one of the two web servers.
Our basic architecture is 2 varnish servers, two web servers, 2 db servers (master and slave).
Any ideas where to go to start debugging this stuff?
I have a requirement for a 'transaction' node. Ordinarily, this would be a node that shows payment from one referenced node to another referenced node (both using entity reference). This is then used in views to create a 'statement' of transactions listed against those referenced nodes.
There are plans floated to allow users to make simultaneous transfers, with potentially thousands of payments being made in one go. Originally the idea was to have each transaction as a separate node, but I don't think this would be wise if we now scale to this amount of transactions.Read more
We have over the last couple of years built what is essentially a web based database application for our business that is accessed by our customers.. Launched in Sept 2011 and actively developed with new functionality being added since then.. We now have just under 16,000 "nodes" in the database..
The server is a Linode 1.5GB VM and runs nginx, php-fpm with APC and mysql..Read more
Wondering if anyone has any experience/opinions on Pantheon vs. Rackspace managed cloud for running high performance Drupal?
My initial thoughts are that Pantheon probably offers the superior developer experience for Drupalers, but Rackspace likely has more flexibility in terms of backend configuration at a server level for real experts (as well as being slightly cheaper?).
Unfortunately for me, Pantheon doesn't yet have servers in Australia although I'm told this is in their long term expansion plans. I can use the local CDN to serve statics at least.Read more
taxonomy_update_7011 runs out of memory and once that is fixed it can take up to 15 minutes to run.