Posted by kitestring on May 19, 2011 at 9:52pm
I have a client that wants me to develop an image and video library which I've already done with Drupal since the taxonomy among other things works very well. My challenge now is to handle the storage requirements. Initially we will need about 1TB and eventually about 2TB. Amazon S3 seemed like a great option, both cost effective and scalable. I just can't figure out how to have the system/modules store the images in my bucket rather than a directory on the server. Cloudfront looked like it might work but from what I understand, it's temporary storage and you still have to have the original files on the local site server. Given the growth of digital media, I'm surprised this hasn't been a hot topic.
Comments
D7?
I believe the Media module for D7 has a baked-in option to store images/video/etc. on S3. On D6, take a look the Media Mover. (Note: the Media module may not be ready for prime time yet and it's Git branches are a bit of a mess right now).
You're correct that the Cloudfront module will create a copy of your images on S3 and then rewrite imagecache URLs to point at Amazon instead of your server. I don't believe it works for video... Regardless, I'd be cautious about any module without any code changes in nearly a year and an open issue asking for a co-maintainer.
If you can run daemons on your server, take a look at the CDN module.
Finally, there's always the option to write your own module based on the AWS API to meet your exact needs...
The CDN module is an
The CDN module is an excellent solution. Running the daemon is no longer necessary -- use the custom origin option instead (very simple!)
---
Tomáš J. Fülöpp
http://twitter.com/vacilandois
s3fs is a great way to use S3 without any modules!
Hi
I spent a little time wondering how to host my content, not video but the same principal, on S3 and wasn't happy with the available modules for Drupal 7. The most promising seemed to be the filestream filter for S3 but I had some problems of it not always working. In the end I found a solution where Drupal doesn't even know that the data isn't local. Do you use an Linux environment? If so I'd really recommend "s3fs" which is a FUSE tool which allows you to mount an S3 bucket just like a NFS filesystem! Here's a page I wrote about it here, http://www.practicalclouds.com/content/guide/storing-drupal-content-amaz...
I decided to host my site in Amazon EC2 and have created a simple AMI based on Fedora 14. By adding Java, the EC2 tools, s3cmd and s3fs I'm creating a simple boot process which is capable of booting your instance into anything you like, Drupal included.
Check out: -
http://www.practicalclouds.com/content/guide/create-your-own-fedora-14-a...
and
http://www.practicalclouds.com/content/guide/practical-clouds-bootstrap-...
Regards
David
http://www.practicalclouds.com
Host your Drupal website in EC2