DevoxxFR 2024 Reproducible Builds with Apache Maven
Mike Grushin Developing Ugc Sites That Scale
1. Developing
D l i
UGC SITES THAT SCALE
Mike Grushin Partner Technology
Partner,
2. Developing
UGC SITES THAT SCALE
Intro
Mike Grushin
10+ years building web applications
Fortune 500 companies
Rich Internet Application Consulting
www.omnigon.com
3. Developing
UGC SITES THAT SCALE
What is UGC
Definition…
Features:
– User registration
– Comments
– Views
– Response videos
Examples…
www.omnigon.com
4. Developing
UGC SITES THAT SCALE
Challenges
Upload
Conversion
Storage
Streaming
Scalability
www.omnigon.com
5. Developing
UGC SITES THAT SCALE
Upload
Easy, user-friendly (SWFUpload)
Consider client side component (Ex:
Youtube)
www.omnigon.com
6. Developing
UGC SITES THAT SCALE
Conversion
Format: Flash Video Vs Silverlight
Licensing/Cost
Scalability
FFMPEG
www.omnigon.com
7. Developing
UGC SITES THAT SCALE
Storage
Cost
Backups
Utility
www.omnigon.com
8. Developing
UGC SITES THAT SCALE
Streaming
HTTP, HTTP Streaming, True Streaming
Licensing/Cost
– Flash Media Server Vs Red5
Scalability
www.omnigon.com
9. Developing
UGC SITES THAT SCALE
Scalability
Web site
Conversion
Video delivery
Global delivery (CDN)
Cost
www.omnigon.com
10. Developing
UGC SITES THAT SCALE
Recommendations
Strongly consider open-source: cost
Conversion: ffmpeg
Streaming: Red5
Database: MySQL
Web: java, php, ruby, etc
Storage: discussed later
www.omnigon.com
11. Developing
UGC SITES THAT SCALE
Case studies
Large sports media company
UGC Startup
www.omnigon.com
12. Developing
UGC SITES THAT SCALE
Large Sports Media Company
Its own data center or
Dedicated hosting provider
More traditional hosting model
www.omnigon.com
13. Developing
UGC SITES THAT SCALE
Traditional Hosting Model
Lease servers
– Managed: $
$800-$1200/mo
$
– Unmanaged: $150-$400/mo
Commitment
C it t
Not easy/fast to scale
Dedicated 24x7 support
www.omnigon.com
14. Developing
UGC SITES THAT SCALE
UGC in Traditional Hosting
Upload
Conversion
Storage
Streaming
Scalability
www.omnigon.com
15. Developing
UGC SITES THAT SCALE
Traditional Hosting Setup
2 Web Servers (2 x $750 = $1500)
2 Database Servers (2 x $ = $1500))
( $750 $
2 Conversion Servers (2 x $750 = $1500)
Storage/Backup ($1500)
Cost: $6000/mo
Other costs:
– Firewall
– Hardware load balancer
– 2 Streaming Servers (optional)
– Bandwidth over the limit
2-3 days to g another server
y get
www.omnigon.com
16. Developing
UGC SITES THAT SCALE
Cloud Computing
Computing/Storage as utility
Amazon Web Services
Google AppEngine
Others
www.omnigon.com
17. Developing
UGC SITES THAT SCALE
Amazon Web Services
S3
EC2
SQS
CDN
etc
www.omnigon.com
18. Developing
UGC SITES THAT SCALE
Cloud Computing Benefits
Pay for what you use
Easy to scale
www.omnigon.com
19. Developing
UGC SITES THAT SCALE
UGC Startup
Limited capital
Huge potential for growth (2GB of traffic 2nd
mo, 1TB in 4 months)
www.omnigon.com
20. Developing
UGC SITES THAT SCALE
UGC Startup Hosting Setup
2 Web Servers (2 x $74 = $148)
2 Database S
D t b Servers (2 x $74 = $148)
2 Conversion Servers (2 x $148 = $296)
Storage/Backup (usage based)
St /B k
Cost: $600-$800/mo
Other costs:
– Software load balancer
– 2 Streaming Servers (optional)
www.omnigon.com
21. Developing
UGC SITES THAT SCALE
Thank you
Mikhail Grushin
Partner, Technology
g
Omnigon
www.omnigon.com
mike.grushin@omnigon.com
+1 646 961 4906
www.omnigon.com
