Scalable Web Architectures (w/ Ruby and Amazon S3)

Slide 1: Scalable Web Architectures with Ruby and Amazon S3 or: what we learned building SlideShare

Slide 2: jonathanboutelle.com

Slide 3: Scalability?

Slide 4: Cheap hardware for parallelizable tasks

Slide 5: Parallelizing web serving Load Balancer ($$$) Web Server Web Server Web Server

Slide 6: Sessions? 2 Client Load Balancer ($$$) Web Server Web Server Web Server 1 cache cache cache 4 DataBase 3

Slide 7: Scaling a Rails Boxen Web Server App Server cache

Slide 8: LightHttp Mongrel Mongrel Mongrel cache

Slide 9: LightHttp Pound Mongrel Mongrel Mongrel cache

Slide 10: LightHttp Pound Mongrel Mongrel Mongrel backgroundrb cache

Slide 11: LightHttp Pound Mongrel Camping Mongrel Camping Mongrel Camping backgroundrb cache

Slide 12: LightHttp Pound Mongrel Camping monit Mongrel Camping Mongrel Camping backgroundrb cache

Slide 13: Vs.

Slide 14: Asynchronous Processing File Processer … File Processor job2 job2 job1 dbase File Processor

Slide 15: Database reads ;-> Write master Write / Read writes Read slave1 writes X 1:OK 2:OK 3: Down slave2 writes

Slide 16: Database reads ;-> cache Write master Write / Read writes Read slave1 writes X 1:OK 2:OK 3: Down slave2 writes

Slide 17: Database writes ;-> cache Write master Write / Read writes Read slave1 writes X 1:OK 2:OK 3: Down slave2 writes

Slide 18: Database writes ;-< Master 1 Master 1 slave1 slave2 slave1 slave2

Slide 19: MySQL Clustering Box 1 Mirror 1 Box 2 Mirror 2

Slide 20: Serving Static Files cache proxy cache cache

Slide 21: Saving Static Files Data 1 AB proxy Data 2 AC Data 3 BC

Slide 22: S3! • What is it • scaling (technically) • scaling (economically)

Slide 23: Storage+Bandwidth Costs (failure)

Slide 24: Storage / Bandwidth Costs (Success)

Slide 25: Cash Flow • 1st of the month – AMZN Bill • 22nd of the month – Google AdWords Payment • 28th of the month –Credit Card Bill

Slide 26: Things to google… • Mongrel • Monit • LightHttp • Pound / Pen • Nagios • MogileFS