Amazon Web Services (S3, EC2)

joshk's picture

Project Mercury: PressFlow Drupal+Varnish AMI Alpha4 Release

Today I'm glad to announce the latest release in this line of AMI development. This update solves a number of issues and moves us one step closer to a sable beta release. The current AMI ID is ami-c353b2aa, and you can find this AMI by searching for "chapter3" or "mercury" in your AWS console.

For more background information about this project, see my initial g.d.o post and my blog post announcing the initial release.

Below you will find the notes for this release. Also in this post I will include a development roadmap, as well as some more explicit explanation of the techniques I'm using for making the AMI work out of the box.

Read more
joshk's picture

Project Mercury: Pre-configured Drupal+Varnish AMI

Inspired by my own work over the past year with Amazon EC2 and this great post from Eric Hammond at Alestic on how to bundle public AMIs, today I released my first public machine image. I call the project "mercury," and the goal is to combine the power of Varnish and Pressflow Drupal in one easy-to-run package.

Why is this important? Because Varnish fills the same role as the Boost module, except it can handle 1000s of requests per second. Your constrained resources are going to be network and bandwidth. Getting it working well takes a bit of doing, but thanks to PressFlow and support from davidstrauss and DamZ, I've gotten a vanilla system working.

Read more
Jonas E's picture

EC2/S3 for DB-intensive drupal system

Hi everybody,

First of all, I am very new to Drupal and actually not actively coding myself but more involved as a project manager. However, as I've done some programming before and had some computer science modules at university I think I do have a basic grasp on the bigger issues around cloud computing.

We're just finishing a new system which we of course hope will become a huge hit but right now I am more concerned about general hosting issues.

Read more
muldos's picture

AWS Integration for drupal modules with Creeper

Hi all, I have posted a module for using easily the AWS services within drupal modules.
It is based on the tarzan api library
And I have provided as example / documentation the source code of a module that plugs the drupal
authentication system on an Amazon SimpleDB domain.

This is done here : http://drupal.org/project/creeper

Feedback comments and suggestions welcome :)

Regards,

David

Amazon's picture

Multi-master synchronous replication system for MySQL on AWS with Drupal as POC

At MySQLcon I ran into the guys from Codership. They did a 25 minute presentation on how to do multi-master synchronous replication across many instances of MySQL.

In layman's terms.

If you are running 5 Master MySQL databases behind your giant Drupal site, and one of those servers crashes, you won't lose a transaction, and you won't corrupt your logs and destroy your database.

Read more
Toktik's picture

Amazon S3 and Drupal

Hi all!

There is available any working module for Drupal 6 + S3? If yes, what features they have? If not, what we have at this moment, which is more or less working?

Thank you :)

bradlarson's picture

Tutorial for setting up a Drupal 6 site on Amazon EC2

I just completed a tutorial for running Drupal 6 on Amazon's EC2 at http://www.sunsetlakesoftware.com/2008/09/13/running-drupal-website-amaz... . With the advent of the persistent storage that Amazon's Elastic Block Store provides, I figured that it was finally practical to operate a website out of EC2.

Read more
greggles's picture

Amazon Web Services Discussion in Boulder

Per coloradostartups.com an Amazon Web Services evangelist will be in Colorado this coming week to give a talk and evangelize.

From the post:

Mike will be in town visiting TechStars on Tuesday, June 3rd. While he’s here, and since he’s such a nice guy, he’s also holding a get-together at The Cup in Boulder for anyone interested in Amazon Web Services. This will be at 10am on Tuesday. This is the guy to talk to if you want to learn more

Read more
bfelix's picture

Amazon FPS link

Just curious if anyone has integrated Drupal with Amazon's FPS. We are evaluating Drupal from a number of perspectives but we are looking at some microtransaction (<$10) business model which makes Amazon FPS appealing. Seems like there are links to Authorize.net but not yet to FPS?

Thanks in advance,
Brad

Resources for Drupal with Amazon Web Services

Thought it would be a good idea to have a resources wiki page where we could all share stuff relating to Drupal on Amazon

Modules


Amazon EC2 Console - http://drupal.org/project/ec2
AWS Base API http://drupal.org/project/aws
AWS EC2 API http://drupal.org/node/214944
AWS XML API http://drupal.org/node/219893

AMI's


http://www.io1.biz/blogs/drupalxdebugvimkcachegrind-ec2-ami (selectable version of drupal + preconfigure xdebug/vim and output for kcachegrind/wincachegrind)

Read more
Amazon's picture

Amazon releases elastic IPs - so you can resolve your domain name to your AWS instance

In order to host most Drupal sites you've needed a reliable IP which you can have a DNS mapping for. This is now available with AWS.

http://developer.amazonwebservices.com/connect/entry.jspa?externalID=1348

What other barriers need to be resolved for AWS to become the Drupal platform of choice?

fudge-gdo's picture

SysAdmin Amazon EC2/S3 & Drupal setup | SM

Employment type: 
Contract
Telecommute: 
Not allowed

Hello,

Require a EC2/S3 expert to tweak and configure a drupal site running on AWS that we notice not performing as it should.
We are preparing for launching a project in the next week and we need to make sure all is configured correctly.
We have provisioned the Centos+Virtualmim AMI and installed drupal afterwards.

Appreciate your assistance.

Regards
George
chrisg.eu {at} gmailcom

toemaz's picture

FOSDEM 2008 presentation: Combining AWS with Drupal

If you are interested in a case on Drupal + AWS, you may want to watch my presentation captured at FOSDEM 2008. You can the slideshow as well. I used the Wikifonia project as the case study.

Want to start developing? Check out the aws module.

dragonwize's picture

SQS Changes its API and pricing

Amazon has just announced a new API and much lower pricing structure for their SQS service. Check out the migration guide.

dragonwize's picture

Amazon Web Services API Module

I have just uploaded the beginning of my Amazon Web Services API module.

This module is for other module developers that want to consume Amazon's web services. It abstracts the services to functions allowing developers to easily use them without dealing with the lower level details of creating, sending, and receiving the requests. Currently, only REST style requests are supported but SOAP is planned for a later release.

Read more
greggles's picture

ec2 image for Drupal

I keep seen these images for Django or MovableType or whatever - does anyone see value in an AMI for Drupal? I'm not sure if it would be valuable enough or not. I just setup a site based on the Gutsy Public Base Image and on Victor's guide to taking a base Ubuntu server to Drupal host. It wasn't impossible, but it was harder than I'd like someone using ec2 to try out a system to have to endure.

Read more
budda's picture

S3 integration module

I was expecting a Drupal module for S3 to already be in existence by now, as there isn't I have a proposal for a module I'm considering developing. Any feedback or suggestions on the implementation/features are greatly welcome.

This is not intended to be a full FileAPI-like module, but more a helper for general node related usage.

  • Support for node attachments (Core upload.module), CCK filefield uploads etc that are attached to a node.
  • Upon publishing of a node, any associated files are streamed over to Amazon S3 bucket(s).
Read more
jaysmall's picture

Drupal developer(s) and administrator(s) | Company Confidential

Employment type: 
Contract
Telecommute: 
Allowed

Apologies for the post across too many groups. Now corrected; won't happen again.


I am posting on behalf of a client with an existing Drupal implementation in a start-up Web business. This client has an imminent need for the following, most likely on a contract basis:

Read more
allisterbeharry's picture

SoC 2007 proposal - Drupal Automated Staging Kit

Hello all,
Sorry for cross-posting; but I think people working on different aspects of Drupal may have interest in this idea.

I've submitted a SoC 2007 Drupal proposal on automating the whole process of creating a complete Drupal site with a LAMP stack in a self-contained virtual machine image. A formatted PDF version is here:
http://www.abeharry.info/SoC2007_DrupalAST_FullProposal.pdf
Here is the abstract:

The Drupal automated staging toolkit is a proposed set of code libraries, file schemas and parsers, and code generators, for

Read more
keizo's picture

soc project

Has anyone made progress with a general integration with Amazon S3? I am interested in a summer of code project integrating S3 to serve static content and file uploads. Any thoughts?

Subscribe with RSS Syndicate content

Amazon Web Services (S3, EC2)

Group organizers

Group notifications

This group offers an RSS feed. Or subscribe to these personalized, sitewide feeds: