How to scale your Cloud Service to 100k users
Basic scale concepts: Scale out and Scale Up
How to scale Cloud Services, Websites, SQL Database, Bandwidth
Basic tools we use to monitor and test our assumptions
2. Style Jukebox is a High Fidelity cloud-music streaming service
that helps you keep all your music – be it bought, self-produced,
or imported from CDs or other media, always backed up and
synced across all your devices.
3. FREE PREMIUM
Start with 250 songs free (~1.5 GB)
Earn up to 3,000 songs for free (18 GB)
Add storage for 25,000 songs (~120GB – 1 TB)
Hi-Fi Sound Quality
MP3, AAC, WMA, OGG +Lossless (FLAC, M4A- ALAC)
Free, with NO ADS $24.99 / year or $2.99 / month
30 MB limit / song 1GB limit / song
10. Scale Up
One operation that cannot
be divided requires more compute power
(Audio/Video encoding, Your own DB, etc.)
Basic A1
1 Core AMD CPU
1,75 GB RAM
EUR 41/month*
G5, 32 cores
Intel Xeon
448 GB RAM
6 TB
EUR 4865/month*
11. Scale Out
Used for API, Website, etc.
Ex: Each machine can have a limited number of connected users
Basic A1
1 Core AMD CPU
1,75 GB RAM
EUR 41/month*
4x
Basic A1
1 Core AMD CPU
1,75 GB RAM
EUR 41/month*
12. Load Balancer
Integrated in the Azure Cloud Services
Makes sure all instances have the same load
Auto-Scale creates new instances or removes automatically
13. Technology
Windows App
C#, WPF
iPhone App
Objective-C
Windows Phone App
C#, Silverlight
Android App
Java
Cloud Meta Service API
Fast, Sync, Gets
8-core just fine with auto scale
Azure, C#, REST Interface, JSON
Block Service API
Upload, Download, Transcoding, etc.
4-core standby with auto scale
Azure, C#, REST, JSON, Streaming
Memcache
1 GB
Redis Azure, C#
Database
SQL Azure Premium
Windows Azure Storage
30 TB
REST
Import API
(Dropbox, OneDrive,
Google Drive)
800k songs imported
Memcache
Worker
>= 2 instances
Import Worker
>= 2 instances
Traffic manager
Load Balancer | CDN
Web Player
AngularJS
File operations
Ex. Index
>= 4 instances
35. Azure CDN
Multiplies content in the region
Ex: Storage account from Amsterdam are multiplied in CDNs
from Amsterdam, London, Frankfurt, Milan, Paris
You have to manage which content is multiplied where.
Cost: EUR 0,06 / GB out CDN
compared to EUR 0,015 / GB just stored
40. Scale Up
I don’t recommend this as a scale strategy
Basic
5 DTU
30 concurrent request
Good predictability
EUR 4 / month
Premium P3
1,000 DTU
SSD, Faster CPU
Max 500 GB size
EUR 2,800 / month
41. Scale Out
I RECOMMEND this as a scale strategy
(Should not be the only one)
The right DB for you
P2, 200 DPU
EUR 700 / month
RAM in the Cloud
Pre-compiled answers
Store JSON, Bytes, etc.
From 250 MB to 53 GB per
Cache
We use 1 GB – EUR 80 / month
42. The Memcache Worker
predicts and prepares the
results
Memcache Hit Ratio 86-91%
Reduced time of response with
80% to an average of 250ms