SlideShare a Scribd company logo
1 of 33
Download to read offline
Achieve Cloud-Scale by implementing
Elastic Load Balancing, Asset Deployment,
           and Synchronization
                        Chris Haddad
            Vice President Technology Evangelism
             Follow me on Twitter @cobiacomm




                                                   December 2012
Achieve Cloud-Scale

Agenda
• Scale Objectives
• Architecting for Scale
• Elastic Load Balancing
• Asset Deployment Synchronization and
  Optimization
• Getting started
Share Business Capabilities at Scale

                                                                         Business
                                            Functional                    Proces
                   Presentation and                                         Business
                       Mashups                 Role                         Process
                      Presentation            Functional                       Business
                          Role                   Role                           Process
                                                                                  Business
                      Presentation and            Functional
                                                     Role                        Process and
                          Mashups                   Functional                 Business Rules
                        Presentation and
                        Mashups                        code

Client Tier

                                                                           Resource
                                   Integration Services                      Tier
                                                                              Resource
                                                                               Services
                                                                                  Resource
                                                                                  Services
                                   Integration Services



      Public Cloud Services
                                                          Private
                                                          Applications
Scale across Clouds
                                Composite                        Mobile
                                                                                 Infrastructure as a
                                Application                    Application          Service (IaaS)
SaaS Application

                                                 Cloud API
                                                                                          Web
                                                 Endpoint                              application
                                                                                        Endpoint




                                              Integration Services



  Business Service Portfolio                                                 Application Portfolio
                                                    Hybrid
     Presentation Services
                                                   Platform
      Business
     Process and
                   Functional                      Services
                     Services
    Rules Services
      Resources Services
      Integration Services
Maintain Availability by Scaling across Regions and Zones
                Multiple IaaS (hybrid) Deployment
HIGHEST




                                                    Zone 1




                                Private cloud (data center)    Zone 2




                                                                               Zone 1




                                                                                        Zone 2
                                                                        Amazon EC2




                                                   Zone 1
          Availability



                         Cost




                                                              Zone 2
LOWEST
                                           Rackspace Cloud



                                                                                                 5
Scale Challenges (a subset)
• Tenant and service partitioning
  – Traffic Routing
• Dynamically registering service instances
  – Right-sizing service instances to match demand
• Code deployment into multiple Cloud instances
  – Minimizing Cloud instance footprint
Architecting for Scale
                                    Cloud Scale



On-demand                                                         Consumption
                    Elastic Scalability     Resource Pooling
Self-service                                                      based Funding



           Create tenant           Match capacity
                                                       Asset deployment       Meter usage
           environment             with demand



                                                             Asset
           Deploy Service          Load balancing                           Bill per scale unit
                                                        Synchronization



                                      Dynamic
         Configure Service
                                     Clustering
Mission-critical Cloud Scale
        requires new architecture components

      Availability               Scalability           Management

State replication         Tenant partitioning     Management nodes
                          Private jet mode

Session replication       Ghost deployment        Logging infrastructure

Multiple load balancers   BAM 2.0 architecture    Deployment
with                                              synchronization
keepalived or DNS RR
                          Auto-scaling

                          Elastic Load Balancer
Cloud-aware Reference Architecture
Cloud Platform
               Platform as a Service Run-time Framework (i.e. WSO2 Stratos,
  Cloud        Cloud Foundry, RedHat OpenShift)
Management        Service-aware, tenant-aware
                     Elastic Load Balancer
PaaS Manager
                      Stratos Controller           Cloud Native Container(s)
   Cloud
                    Asset/Code Deployer               Tenant 1        Tenant (n)
 Governance

   Identity       Asset/Code Synchronizer
 Management                                           Application Platform Services
                                                       (web server, database, ESB)
                    Metering and Billing


                    Asset Repositories and
                 Registries(tenant code, service        Infrastructure as a Service
                     endpoints, meta-data,            (AWS, Eucalyptus, OpenStack,
                    configuration, policies)                    CloudStack)
Platform as a Service Reference Architecture
aPaaS
iPaaS




                                      Carbon                                                                     Any
             Carbon ESB                                      Other Carbon                   PHP
                                    App Server                                                                Pluggable
              Cartridge                                       Cartridges                  Cartridge
                                     Cartridge                                                                Cartridge




                                                                 Relational     Column           File     Task
              Message     Logging      Security   Registry                                                            Billing
                                                                   Data         Storage        Storage   Mgmt
              Service     Service      Service    Service                                                             Service
Foundation




                                                                  Service       Service        Service   Service
  PaaS




              Stratos Controller

                Elastic           Cloud             Artifact
                                                                        Deployment            Management            Load
                 Load           Controller/       Distribution
                                                                        Synchronizer
                                Auto-scaler        Controller                                  Console             Monitor
               Balancer
      IaaS




                 Infrastructure Cloud (EC2, vmWare, Rackspace, OpenStack, Eucalyptus, etc)
Dynamic Instance Clustering

Hybrid group

   Dynamic members                Static members

                    M6
         M5
                                       WK1                           N
                                                   WK2

                         Notify                          Join (IP, Port)


               M7                      WK3         WK4
Tenant-awareness impacts Cloud Scaling
Elastic Load Balancer Config
Private Service Clouds
Deployment Synchronization

• Allows you to synchronize deployment
  artifacts across nodes in a cluster
• Also includes meta data synchronization
Deployment Synchronization
 •   Allows you to synchronize deployment artifacts across
     nodes in a cluster
 •   Also includes meta data synchronization
Management Node Config –
                 carbon.xml
•   <DeploymentSynchronizer>                      AutoCommit/Checkout = RW
•       <Enabled>true</Enabled>
•       <AutoCommit>true</AutoCommit>
•       <AutoCheckout>true</AutoCheckout>
•       <RepositoryType>svn</RepositoryType>
•       <SvnUrl>http://10.100.3.115/svn/repos/wsas</SvnUrl>
•       <SvnUser>wso2</SvnUser>
•       <SvnPassword>wso2123</SvnPassword>
•       <SvnUrlAppendTenantId>true</SvnUrlAppendTenantId>
•   </DeploymentSynchronizer>
Deployment Optimization
• Four variants
  •   Lazy initialization
  •   Virtual proxy
  •   Value holder
  •   Ghost
• Two aspect of lazy loading in Carbon
  • Lazy loading global configuration
  • Lazy loading artifacts
Ghost deployment for services
carbon.xml - <EnableGhostDeployer>true</EnableGhostDeployer>
Lazy loading with Ghost Deployment
What is your scale value baseline?
Scaling a Cloud Business
     • Measuring Revenue versus Cost




Source: http://giffconstable.com/2009/11/freemium-business-model-template/
Tenant Scaling Method Impacts Value Proposition

•   Single Application Tenant per    Multiple Application Tenants per
                                    Shared Application Platform Service
•   Dedicated Application Server
                                                  Container
             Container
Cloud Topology and Value
Five (5) Container Instances, Three Tenants


                                                       Tenant
 Application Solution                                  Traffic


   Tenant Partition             Tenant-1                   Tenant-2           Tenant-3



      Container          AS-1              ESB-1    AS-2              ESB-2    ESB-3



   Tenant Context       Tenant-1      Tenant-1     Tenant-2      Tenant-2     Tenant-3
Cloud Topology and Value
Three (3) Container Instances, Three Tenants


                                                                Tenant
 Application Solution                                           Traffic



                                                                                   Web
   Service Partition                             ESB
                                                                                 Application



      Container                    ESB-1                ESB-2                        AS-1




    Tenant Context      Tenant-1           Tenant-3    Tenant-2           Tenant-1          Tenant-2
Single Node



          Primary-Secondary, single LB


             Primary-Secondary,
             with multiple LBs
                                                         at a cost




                   Multi-node active
                   cluster
                   - Single zone

                             Multi-zone
                                Multi-region
                                               Cloud Scale = High Availability




                                   Multi-IaaS
26
Key Metrics


• Foundation
  • Time to create new application environment
  • Time to redeploy application
• Optimize
  • Minimum and maximum scale
  • Scale frequency (i.e. time to scale up/down)
• Transformation
  • Time and effort required integrating business process, event
    processor – creating a complex app.
  • Time and effort required to apply policy across tenant(s)
  • Cost to operate application per user or transaction
Quick Start Use Cases


Service level management and elastic scale
• Use cases
  • Ensure application satisfies consumer demand while
    maximizing resource utilization
     • Scale workload processing and increase performance while
       minimizing infrastructure spend
  • Load test application service
  • Demonstrate multi-tenant web application
• Key Metrics
  • Minimum and maximum scale
  • Scale frequency (i.e. time to scale up/down)
Quick Start Use Cases


Consumption based pricing and billing
• Use cases
  • View service logs
  • View bill by business value
• Key Metric
  • Cost to operate application per user or transaction
Resources
• Try Stratos right now:
  – https://stratoslive.wso2.com/
• Read about Stratos:
  – http://wso2.com/cloud/stratos/
  – Source Download available
• Contact us:
  – bizdev@wso2.com
Resources
• Information on tenant-aware load balancing
•   http://sanjeewamalalgoda.blogspot.com/2012/03/tenant-aware-load-balancer-is-upcoming.html
•   http://sanjeewamalalgoda.blogspot.com/2012/05/tenant-aware-load-balancer.html

• Information on long running performance
•   http://kishanthan.wordpress.com/2012/06/27/lazy-loading-pattern-in-wso2-stratos

• Lazy loading deployment artifacts
•   http://blog.afkham.org/2011/11/lazy-loading-deployment-artifacts-in.html

• Scaling Stratos
•   http://srinathsview.blogspot.com/2012/06/scaling-wso2-stratos.html
•   http://blog.afkham.org/2011/09/how-to-setup-wso2-elastic-load-balancer.html
•   http://blog.afkham.org/2011/09/wso2-load-balancer-how-it-works.html
Resources
• Auto-scaler service deployment
•   http://nirmalfdo.blogspot.com/2012/07/autoscaler-service-deployment.html



• Auto-scaler service
•   http://nirmalfdo.blogspot.com/2012/07/wso2-autoscaler-service-part-i.html




• Pass-through transport – performance
  comparison
•   http://wso2.org/library/articles/2012/03/wso2-esb-message-transfer-mechanisms-comparative-benchmarks/


• Automatic failover for WSO2 ELB
•   http://gonesimple.org/2012/09/24/automatic-fail-over-for-wso2-elb/
Achieve Cloud Scale by Implementing Elastic Load Balancing, Asset Deployment, and Synchronization

More Related Content

What's hot

Hot Cloud Companies: Tap In Systems - The Problem: Managing Cloud Complexities
Hot Cloud Companies: Tap In Systems - The Problem: Managing Cloud ComplexitiesHot Cloud Companies: Tap In Systems - The Problem: Managing Cloud Complexities
Hot Cloud Companies: Tap In Systems - The Problem: Managing Cloud ComplexitiesOpSource
 
CloudStack Collaboration Conference 12; Refactoring cloud stack
CloudStack Collaboration Conference 12; Refactoring cloud stackCloudStack Collaboration Conference 12; Refactoring cloud stack
CloudStack Collaboration Conference 12; Refactoring cloud stackbuildacloud
 
Planning the Migration to the Cloud - AWS India Summit 2012
Planning the Migration to the Cloud - AWS India Summit 2012Planning the Migration to the Cloud - AWS India Summit 2012
Planning the Migration to the Cloud - AWS India Summit 2012Amazon Web Services
 
Comparison of Cloud Providers
Comparison of Cloud ProvidersComparison of Cloud Providers
Comparison of Cloud ProvidersSabapathy Murthi
 
Eucalyptus-AWS Hybrid Using RightScale myCloud
Eucalyptus-AWS Hybrid Using RightScale myCloudEucalyptus-AWS Hybrid Using RightScale myCloud
Eucalyptus-AWS Hybrid Using RightScale myCloudRightScale
 
Open Architecture for Developing Multitenant Software-as-a-Service Applications
Open Architecture for Developing Multitenant Software-as-a-Service ApplicationsOpen Architecture for Developing Multitenant Software-as-a-Service Applications
Open Architecture for Developing Multitenant Software-as-a-Service ApplicationsJavier Mijail Espadas Pech
 
Roadmap to the Clouds - How to Easily Migrate to the Cloud Platform Using WSO...
Roadmap to the Clouds - How to Easily Migrate to the Cloud Platform Using WSO...Roadmap to the Clouds - How to Easily Migrate to the Cloud Platform Using WSO...
Roadmap to the Clouds - How to Easily Migrate to the Cloud Platform Using WSO...WSO2
 
Cloud Computing 101
Cloud Computing 101Cloud Computing 101
Cloud Computing 101Kamal Arora
 
HP CloudSystem Matrix
HP CloudSystem MatrixHP CloudSystem Matrix
HP CloudSystem MatrixArun prasath
 
Oracle cloud computing strategy
Oracle cloud computing strategyOracle cloud computing strategy
Oracle cloud computing strategyjameskenney
 
Open source and standards - unleashing the potential for innovation of cloud ...
Open source and standards - unleashing the potential for innovation of cloud ...Open source and standards - unleashing the potential for innovation of cloud ...
Open source and standards - unleashing the potential for innovation of cloud ...Ignacio M. Llorente
 
Enterprise Cloud Architecture Best Practices
Enterprise Cloud Architecture Best PracticesEnterprise Cloud Architecture Best Practices
Enterprise Cloud Architecture Best PracticesDavid Veksler
 
Clarity in the virtual world - VMware vRealize Automation With vRealize Business
Clarity in the virtual world - VMware vRealize Automation With vRealize BusinessClarity in the virtual world - VMware vRealize Automation With vRealize Business
Clarity in the virtual world - VMware vRealize Automation With vRealize BusinessAmcom
 
Oracle Cloud Reference Architecture
Oracle Cloud Reference ArchitectureOracle Cloud Reference Architecture
Oracle Cloud Reference ArchitectureBob Rhubart
 
AWS Cloud Use Cases - Ezhil Arasan Babaraj, CSS Corp
AWS Cloud Use Cases - Ezhil Arasan Babaraj, CSS CorpAWS Cloud Use Cases - Ezhil Arasan Babaraj, CSS Corp
AWS Cloud Use Cases - Ezhil Arasan Babaraj, CSS CorpAmazon Web Services
 
Running Microsoft SharePoint On AWS - Smartronix and AWS - Webinar
Running Microsoft SharePoint On AWS - Smartronix and AWS - WebinarRunning Microsoft SharePoint On AWS - Smartronix and AWS - Webinar
Running Microsoft SharePoint On AWS - Smartronix and AWS - WebinarAmazon Web Services
 

What's hot (20)

Cloud architecture
Cloud architectureCloud architecture
Cloud architecture
 
Hot Cloud Companies: Tap In Systems - The Problem: Managing Cloud Complexities
Hot Cloud Companies: Tap In Systems - The Problem: Managing Cloud ComplexitiesHot Cloud Companies: Tap In Systems - The Problem: Managing Cloud Complexities
Hot Cloud Companies: Tap In Systems - The Problem: Managing Cloud Complexities
 
CloudStack Collaboration Conference 12; Refactoring cloud stack
CloudStack Collaboration Conference 12; Refactoring cloud stackCloudStack Collaboration Conference 12; Refactoring cloud stack
CloudStack Collaboration Conference 12; Refactoring cloud stack
 
Planning the Migration to the Cloud - AWS India Summit 2012
Planning the Migration to the Cloud - AWS India Summit 2012Planning the Migration to the Cloud - AWS India Summit 2012
Planning the Migration to the Cloud - AWS India Summit 2012
 
IBM Cloud Strategy
IBM Cloud StrategyIBM Cloud Strategy
IBM Cloud Strategy
 
Comparison of Cloud Providers
Comparison of Cloud ProvidersComparison of Cloud Providers
Comparison of Cloud Providers
 
Cloud Service Models
Cloud Service ModelsCloud Service Models
Cloud Service Models
 
Eucalyptus-AWS Hybrid Using RightScale myCloud
Eucalyptus-AWS Hybrid Using RightScale myCloudEucalyptus-AWS Hybrid Using RightScale myCloud
Eucalyptus-AWS Hybrid Using RightScale myCloud
 
Open Architecture for Developing Multitenant Software-as-a-Service Applications
Open Architecture for Developing Multitenant Software-as-a-Service ApplicationsOpen Architecture for Developing Multitenant Software-as-a-Service Applications
Open Architecture for Developing Multitenant Software-as-a-Service Applications
 
Roadmap to the Clouds - How to Easily Migrate to the Cloud Platform Using WSO...
Roadmap to the Clouds - How to Easily Migrate to the Cloud Platform Using WSO...Roadmap to the Clouds - How to Easily Migrate to the Cloud Platform Using WSO...
Roadmap to the Clouds - How to Easily Migrate to the Cloud Platform Using WSO...
 
Cloud Computing 101
Cloud Computing 101Cloud Computing 101
Cloud Computing 101
 
Cloud Architecture
Cloud ArchitectureCloud Architecture
Cloud Architecture
 
HP CloudSystem Matrix
HP CloudSystem MatrixHP CloudSystem Matrix
HP CloudSystem Matrix
 
Oracle cloud computing strategy
Oracle cloud computing strategyOracle cloud computing strategy
Oracle cloud computing strategy
 
Open source and standards - unleashing the potential for innovation of cloud ...
Open source and standards - unleashing the potential for innovation of cloud ...Open source and standards - unleashing the potential for innovation of cloud ...
Open source and standards - unleashing the potential for innovation of cloud ...
 
Enterprise Cloud Architecture Best Practices
Enterprise Cloud Architecture Best PracticesEnterprise Cloud Architecture Best Practices
Enterprise Cloud Architecture Best Practices
 
Clarity in the virtual world - VMware vRealize Automation With vRealize Business
Clarity in the virtual world - VMware vRealize Automation With vRealize BusinessClarity in the virtual world - VMware vRealize Automation With vRealize Business
Clarity in the virtual world - VMware vRealize Automation With vRealize Business
 
Oracle Cloud Reference Architecture
Oracle Cloud Reference ArchitectureOracle Cloud Reference Architecture
Oracle Cloud Reference Architecture
 
AWS Cloud Use Cases - Ezhil Arasan Babaraj, CSS Corp
AWS Cloud Use Cases - Ezhil Arasan Babaraj, CSS CorpAWS Cloud Use Cases - Ezhil Arasan Babaraj, CSS Corp
AWS Cloud Use Cases - Ezhil Arasan Babaraj, CSS Corp
 
Running Microsoft SharePoint On AWS - Smartronix and AWS - Webinar
Running Microsoft SharePoint On AWS - Smartronix and AWS - WebinarRunning Microsoft SharePoint On AWS - Smartronix and AWS - Webinar
Running Microsoft SharePoint On AWS - Smartronix and AWS - Webinar
 

Similar to Achieve Cloud Scale by Implementing Elastic Load Balancing, Asset Deployment, and Synchronization

Summer School Scale Cloud Across the Enterprise
Summer School   Scale Cloud Across the EnterpriseSummer School   Scale Cloud Across the Enterprise
Summer School Scale Cloud Across the EnterpriseWSO2
 
Building Cloud-Aware Applications
Building Cloud-Aware ApplicationsBuilding Cloud-Aware Applications
Building Cloud-Aware ApplicationsChris Haddad
 
Making of a Successful Cloud Business
Making of a Successful Cloud BusinessMaking of a Successful Cloud Business
Making of a Successful Cloud BusinessACMBangalore
 
Applications at Scale
Applications at ScaleApplications at Scale
Applications at ScaleServiceMesh
 
Cisco live 2013 anything as a service david deakin
Cisco live 2013 anything as a service david deakinCisco live 2013 anything as a service david deakin
Cisco live 2013 anything as a service david deakinOptusBusiness
 
SOA & BPM in Cloud Readiness
SOA & BPM in Cloud ReadinessSOA & BPM in Cloud Readiness
SOA & BPM in Cloud ReadinessJainendra Kumar
 
IBM - Massimo Leoni, Cloud Computing, Milano 2 luglio 2009
IBM - Massimo Leoni, Cloud Computing, Milano 2 luglio 2009IBM - Massimo Leoni, Cloud Computing, Milano 2 luglio 2009
IBM - Massimo Leoni, Cloud Computing, Milano 2 luglio 2009Manuela Moroncini
 
MPLS 2010: Network Enabled Cloud and Service Models
MPLS 2010: Network Enabled Cloud and Service ModelsMPLS 2010: Network Enabled Cloud and Service Models
MPLS 2010: Network Enabled Cloud and Service ModelsCisco Service Provider
 
Strategic Importance of Semantic Technologies as a Key Differentiator for IT ...
Strategic Importance of Semantic Technologies as a Key Differentiator for IT ...Strategic Importance of Semantic Technologies as a Key Differentiator for IT ...
Strategic Importance of Semantic Technologies as a Key Differentiator for IT ...CloudOps Summit
 
PHP Day 2011 PHP goes to the cloud
PHP Day 2011 PHP goes to the cloudPHP Day 2011 PHP goes to the cloud
PHP Day 2011 PHP goes to the cloudpietrobr
 
Dc architecture for_cloud
Dc architecture for_cloudDc architecture for_cloud
Dc architecture for_cloudAlain Geenrits
 
FewebPlus @ microsoft 19 april 2010 cloud continuum
FewebPlus @ microsoft 19 april 2010 cloud continuumFewebPlus @ microsoft 19 april 2010 cloud continuum
FewebPlus @ microsoft 19 april 2010 cloud continuumTom Crombez
 
Building a Hybrid Platform as a Service
Building a Hybrid Platform as a ServiceBuilding a Hybrid Platform as a Service
Building a Hybrid Platform as a ServiceWSO2
 
Building and Managing Cloud Applications and Infrastructure
Building and Managing Cloud Applications and InfrastructureBuilding and Managing Cloud Applications and Infrastructure
Building and Managing Cloud Applications and InfrastructureDarren Cunningham
 
Paving the Way to IT-as-a-Service
Paving the Way to IT-as-a-ServicePaving the Way to IT-as-a-Service
Paving the Way to IT-as-a-Servicebuildacloud
 
NIC 2013 - Configure and Deploy Private Cloud
NIC 2013 - Configure and Deploy Private CloudNIC 2013 - Configure and Deploy Private Cloud
NIC 2013 - Configure and Deploy Private CloudKristian Nese
 

Similar to Achieve Cloud Scale by Implementing Elastic Load Balancing, Asset Deployment, and Synchronization (20)

Summer School Scale Cloud Across the Enterprise
Summer School   Scale Cloud Across the EnterpriseSummer School   Scale Cloud Across the Enterprise
Summer School Scale Cloud Across the Enterprise
 
Building Cloud-Aware Applications
Building Cloud-Aware ApplicationsBuilding Cloud-Aware Applications
Building Cloud-Aware Applications
 
Making of a Successful Cloud Business
Making of a Successful Cloud BusinessMaking of a Successful Cloud Business
Making of a Successful Cloud Business
 
Applications at Scale
Applications at ScaleApplications at Scale
Applications at Scale
 
Cisco live 2013 anything as a service david deakin
Cisco live 2013 anything as a service david deakinCisco live 2013 anything as a service david deakin
Cisco live 2013 anything as a service david deakin
 
SOA & BPM in Cloud Readiness
SOA & BPM in Cloud ReadinessSOA & BPM in Cloud Readiness
SOA & BPM in Cloud Readiness
 
IBM - Massimo Leoni, Cloud Computing, Milano 2 luglio 2009
IBM - Massimo Leoni, Cloud Computing, Milano 2 luglio 2009IBM - Massimo Leoni, Cloud Computing, Milano 2 luglio 2009
IBM - Massimo Leoni, Cloud Computing, Milano 2 luglio 2009
 
Roadmap to hyper hybrid cloud
Roadmap to hyper hybrid cloudRoadmap to hyper hybrid cloud
Roadmap to hyper hybrid cloud
 
MPLS 2010: Network Enabled Cloud and Service Models
MPLS 2010: Network Enabled Cloud and Service ModelsMPLS 2010: Network Enabled Cloud and Service Models
MPLS 2010: Network Enabled Cloud and Service Models
 
Strategic Importance of Semantic Technologies as a Key Differentiator for IT ...
Strategic Importance of Semantic Technologies as a Key Differentiator for IT ...Strategic Importance of Semantic Technologies as a Key Differentiator for IT ...
Strategic Importance of Semantic Technologies as a Key Differentiator for IT ...
 
PHP Day 2011 PHP goes to the cloud
PHP Day 2011 PHP goes to the cloudPHP Day 2011 PHP goes to the cloud
PHP Day 2011 PHP goes to the cloud
 
Dc architecture for_cloud
Dc architecture for_cloudDc architecture for_cloud
Dc architecture for_cloud
 
Soa
SoaSoa
Soa
 
Soa
SoaSoa
Soa
 
Soa
SoaSoa
Soa
 
FewebPlus @ microsoft 19 april 2010 cloud continuum
FewebPlus @ microsoft 19 april 2010 cloud continuumFewebPlus @ microsoft 19 april 2010 cloud continuum
FewebPlus @ microsoft 19 april 2010 cloud continuum
 
Building a Hybrid Platform as a Service
Building a Hybrid Platform as a ServiceBuilding a Hybrid Platform as a Service
Building a Hybrid Platform as a Service
 
Building and Managing Cloud Applications and Infrastructure
Building and Managing Cloud Applications and InfrastructureBuilding and Managing Cloud Applications and Infrastructure
Building and Managing Cloud Applications and Infrastructure
 
Paving the Way to IT-as-a-Service
Paving the Way to IT-as-a-ServicePaving the Way to IT-as-a-Service
Paving the Way to IT-as-a-Service
 
NIC 2013 - Configure and Deploy Private Cloud
NIC 2013 - Configure and Deploy Private CloudNIC 2013 - Configure and Deploy Private Cloud
NIC 2013 - Configure and Deploy Private Cloud
 

More from WSO2

How to Create a Service in Choreo
How to Create a Service in ChoreoHow to Create a Service in Choreo
How to Create a Service in ChoreoWSO2
 
Ballerina Tech Talk - May 2023
Ballerina Tech Talk - May 2023Ballerina Tech Talk - May 2023
Ballerina Tech Talk - May 2023WSO2
 
Platform Strategy to Deliver Digital Experiences on Azure
Platform Strategy to Deliver Digital Experiences on AzurePlatform Strategy to Deliver Digital Experiences on Azure
Platform Strategy to Deliver Digital Experiences on AzureWSO2
 
GartnerITSymSessionSlides.pdf
GartnerITSymSessionSlides.pdfGartnerITSymSessionSlides.pdf
GartnerITSymSessionSlides.pdfWSO2
 
[Webinar] How to Create an API in Minutes
[Webinar] How to Create an API in Minutes[Webinar] How to Create an API in Minutes
[Webinar] How to Create an API in MinutesWSO2
 
Modernizing the Student Journey with Ethos Identity
Modernizing the Student Journey with Ethos IdentityModernizing the Student Journey with Ethos Identity
Modernizing the Student Journey with Ethos IdentityWSO2
 
Choreo - Build unique digital experiences on WSO2's platform, secured by Etho...
Choreo - Build unique digital experiences on WSO2's platform, secured by Etho...Choreo - Build unique digital experiences on WSO2's platform, secured by Etho...
Choreo - Build unique digital experiences on WSO2's platform, secured by Etho...WSO2
 
CIO Summit Berlin 2022.pptx.pdf
CIO Summit Berlin 2022.pptx.pdfCIO Summit Berlin 2022.pptx.pdf
CIO Summit Berlin 2022.pptx.pdfWSO2
 
Delivering New Digital Experiences Fast - Introducing Choreo
Delivering New Digital Experiences Fast - Introducing ChoreoDelivering New Digital Experiences Fast - Introducing Choreo
Delivering New Digital Experiences Fast - Introducing ChoreoWSO2
 
Fueling the Digital Experience Economy with Connected Products
Fueling the Digital Experience Economy with Connected ProductsFueling the Digital Experience Economy with Connected Products
Fueling the Digital Experience Economy with Connected ProductsWSO2
 
A Reference Methodology for Agile Digital Businesses
 A Reference Methodology for Agile Digital Businesses A Reference Methodology for Agile Digital Businesses
A Reference Methodology for Agile Digital BusinessesWSO2
 
Workflows in WSO2 API Manager - WSO2 API Manager Community Call (12/15/2021)
Workflows in WSO2 API Manager - WSO2 API Manager Community Call (12/15/2021)Workflows in WSO2 API Manager - WSO2 API Manager Community Call (12/15/2021)
Workflows in WSO2 API Manager - WSO2 API Manager Community Call (12/15/2021)WSO2
 
Lessons from the pandemic - From a single use case to true transformation
 Lessons from the pandemic - From a single use case to true transformation Lessons from the pandemic - From a single use case to true transformation
Lessons from the pandemic - From a single use case to true transformationWSO2
 
Adding Liveliness to Banking Experiences
Adding Liveliness to Banking ExperiencesAdding Liveliness to Banking Experiences
Adding Liveliness to Banking ExperiencesWSO2
 
Building a Future-ready Bank
Building a Future-ready BankBuilding a Future-ready Bank
Building a Future-ready BankWSO2
 
WSO2 API Manager Community Call - November 2021
WSO2 API Manager Community Call - November 2021WSO2 API Manager Community Call - November 2021
WSO2 API Manager Community Call - November 2021WSO2
 
[API World ] - Managing Asynchronous APIs
[API World ] - Managing Asynchronous APIs[API World ] - Managing Asynchronous APIs
[API World ] - Managing Asynchronous APIsWSO2
 
[API World 2021 ] - Understanding Cloud Native Deployment
[API World 2021 ] - Understanding Cloud Native Deployment[API World 2021 ] - Understanding Cloud Native Deployment
[API World 2021 ] - Understanding Cloud Native DeploymentWSO2
 
[API Word 2021] - Quantum Duality of “API as a Business and a Technology”
[API Word 2021] - Quantum Duality of “API as a Business and a Technology”[API Word 2021] - Quantum Duality of “API as a Business and a Technology”
[API Word 2021] - Quantum Duality of “API as a Business and a Technology”WSO2
 
API Revisions - WSO2 API Manager Community Call (10/27/2021)
API Revisions - WSO2 API Manager Community Call (10/27/2021)API Revisions - WSO2 API Manager Community Call (10/27/2021)
API Revisions - WSO2 API Manager Community Call (10/27/2021)WSO2
 

More from WSO2 (20)

How to Create a Service in Choreo
How to Create a Service in ChoreoHow to Create a Service in Choreo
How to Create a Service in Choreo
 
Ballerina Tech Talk - May 2023
Ballerina Tech Talk - May 2023Ballerina Tech Talk - May 2023
Ballerina Tech Talk - May 2023
 
Platform Strategy to Deliver Digital Experiences on Azure
Platform Strategy to Deliver Digital Experiences on AzurePlatform Strategy to Deliver Digital Experiences on Azure
Platform Strategy to Deliver Digital Experiences on Azure
 
GartnerITSymSessionSlides.pdf
GartnerITSymSessionSlides.pdfGartnerITSymSessionSlides.pdf
GartnerITSymSessionSlides.pdf
 
[Webinar] How to Create an API in Minutes
[Webinar] How to Create an API in Minutes[Webinar] How to Create an API in Minutes
[Webinar] How to Create an API in Minutes
 
Modernizing the Student Journey with Ethos Identity
Modernizing the Student Journey with Ethos IdentityModernizing the Student Journey with Ethos Identity
Modernizing the Student Journey with Ethos Identity
 
Choreo - Build unique digital experiences on WSO2's platform, secured by Etho...
Choreo - Build unique digital experiences on WSO2's platform, secured by Etho...Choreo - Build unique digital experiences on WSO2's platform, secured by Etho...
Choreo - Build unique digital experiences on WSO2's platform, secured by Etho...
 
CIO Summit Berlin 2022.pptx.pdf
CIO Summit Berlin 2022.pptx.pdfCIO Summit Berlin 2022.pptx.pdf
CIO Summit Berlin 2022.pptx.pdf
 
Delivering New Digital Experiences Fast - Introducing Choreo
Delivering New Digital Experiences Fast - Introducing ChoreoDelivering New Digital Experiences Fast - Introducing Choreo
Delivering New Digital Experiences Fast - Introducing Choreo
 
Fueling the Digital Experience Economy with Connected Products
Fueling the Digital Experience Economy with Connected ProductsFueling the Digital Experience Economy with Connected Products
Fueling the Digital Experience Economy with Connected Products
 
A Reference Methodology for Agile Digital Businesses
 A Reference Methodology for Agile Digital Businesses A Reference Methodology for Agile Digital Businesses
A Reference Methodology for Agile Digital Businesses
 
Workflows in WSO2 API Manager - WSO2 API Manager Community Call (12/15/2021)
Workflows in WSO2 API Manager - WSO2 API Manager Community Call (12/15/2021)Workflows in WSO2 API Manager - WSO2 API Manager Community Call (12/15/2021)
Workflows in WSO2 API Manager - WSO2 API Manager Community Call (12/15/2021)
 
Lessons from the pandemic - From a single use case to true transformation
 Lessons from the pandemic - From a single use case to true transformation Lessons from the pandemic - From a single use case to true transformation
Lessons from the pandemic - From a single use case to true transformation
 
Adding Liveliness to Banking Experiences
Adding Liveliness to Banking ExperiencesAdding Liveliness to Banking Experiences
Adding Liveliness to Banking Experiences
 
Building a Future-ready Bank
Building a Future-ready BankBuilding a Future-ready Bank
Building a Future-ready Bank
 
WSO2 API Manager Community Call - November 2021
WSO2 API Manager Community Call - November 2021WSO2 API Manager Community Call - November 2021
WSO2 API Manager Community Call - November 2021
 
[API World ] - Managing Asynchronous APIs
[API World ] - Managing Asynchronous APIs[API World ] - Managing Asynchronous APIs
[API World ] - Managing Asynchronous APIs
 
[API World 2021 ] - Understanding Cloud Native Deployment
[API World 2021 ] - Understanding Cloud Native Deployment[API World 2021 ] - Understanding Cloud Native Deployment
[API World 2021 ] - Understanding Cloud Native Deployment
 
[API Word 2021] - Quantum Duality of “API as a Business and a Technology”
[API Word 2021] - Quantum Duality of “API as a Business and a Technology”[API Word 2021] - Quantum Duality of “API as a Business and a Technology”
[API Word 2021] - Quantum Duality of “API as a Business and a Technology”
 
API Revisions - WSO2 API Manager Community Call (10/27/2021)
API Revisions - WSO2 API Manager Community Call (10/27/2021)API Revisions - WSO2 API Manager Community Call (10/27/2021)
API Revisions - WSO2 API Manager Community Call (10/27/2021)
 

Achieve Cloud Scale by Implementing Elastic Load Balancing, Asset Deployment, and Synchronization

  • 1. Achieve Cloud-Scale by implementing Elastic Load Balancing, Asset Deployment, and Synchronization Chris Haddad Vice President Technology Evangelism Follow me on Twitter @cobiacomm December 2012
  • 2. Achieve Cloud-Scale Agenda • Scale Objectives • Architecting for Scale • Elastic Load Balancing • Asset Deployment Synchronization and Optimization • Getting started
  • 3. Share Business Capabilities at Scale Business Functional Proces Presentation and Business Mashups Role Process Presentation Functional Business Role Role Process Business Presentation and Functional Role Process and Mashups Functional Business Rules Presentation and Mashups code Client Tier Resource Integration Services Tier Resource Services Resource Services Integration Services Public Cloud Services Private Applications
  • 4. Scale across Clouds Composite Mobile Infrastructure as a Application Application Service (IaaS) SaaS Application Cloud API Web Endpoint application Endpoint Integration Services Business Service Portfolio Application Portfolio Hybrid Presentation Services Platform Business Process and Functional Services Services Rules Services Resources Services Integration Services
  • 5. Maintain Availability by Scaling across Regions and Zones Multiple IaaS (hybrid) Deployment HIGHEST Zone 1 Private cloud (data center) Zone 2 Zone 1 Zone 2 Amazon EC2 Zone 1 Availability Cost Zone 2 LOWEST Rackspace Cloud 5
  • 6. Scale Challenges (a subset) • Tenant and service partitioning – Traffic Routing • Dynamically registering service instances – Right-sizing service instances to match demand • Code deployment into multiple Cloud instances – Minimizing Cloud instance footprint
  • 7. Architecting for Scale Cloud Scale On-demand Consumption Elastic Scalability Resource Pooling Self-service based Funding Create tenant Match capacity Asset deployment Meter usage environment with demand Asset Deploy Service Load balancing Bill per scale unit Synchronization Dynamic Configure Service Clustering
  • 8. Mission-critical Cloud Scale requires new architecture components Availability Scalability Management State replication Tenant partitioning Management nodes Private jet mode Session replication Ghost deployment Logging infrastructure Multiple load balancers BAM 2.0 architecture Deployment with synchronization keepalived or DNS RR Auto-scaling Elastic Load Balancer
  • 9. Cloud-aware Reference Architecture Cloud Platform Platform as a Service Run-time Framework (i.e. WSO2 Stratos, Cloud Cloud Foundry, RedHat OpenShift) Management Service-aware, tenant-aware Elastic Load Balancer PaaS Manager Stratos Controller Cloud Native Container(s) Cloud Asset/Code Deployer Tenant 1 Tenant (n) Governance Identity Asset/Code Synchronizer Management Application Platform Services (web server, database, ESB) Metering and Billing Asset Repositories and Registries(tenant code, service Infrastructure as a Service endpoints, meta-data, (AWS, Eucalyptus, OpenStack, configuration, policies) CloudStack)
  • 10. Platform as a Service Reference Architecture aPaaS iPaaS Carbon Any Carbon ESB Other Carbon PHP App Server Pluggable Cartridge Cartridges Cartridge Cartridge Cartridge Relational Column File Task Message Logging Security Registry Billing Data Storage Storage Mgmt Service Service Service Service Service Foundation Service Service Service Service PaaS Stratos Controller Elastic Cloud Artifact Deployment Management Load Load Controller/ Distribution Synchronizer Auto-scaler Controller Console Monitor Balancer IaaS Infrastructure Cloud (EC2, vmWare, Rackspace, OpenStack, Eucalyptus, etc)
  • 11. Dynamic Instance Clustering Hybrid group Dynamic members Static members M6 M5 WK1 N WK2 Notify Join (IP, Port) M7 WK3 WK4
  • 15. Deployment Synchronization • Allows you to synchronize deployment artifacts across nodes in a cluster • Also includes meta data synchronization
  • 16. Deployment Synchronization • Allows you to synchronize deployment artifacts across nodes in a cluster • Also includes meta data synchronization
  • 17. Management Node Config – carbon.xml • <DeploymentSynchronizer> AutoCommit/Checkout = RW • <Enabled>true</Enabled> • <AutoCommit>true</AutoCommit> • <AutoCheckout>true</AutoCheckout> • <RepositoryType>svn</RepositoryType> • <SvnUrl>http://10.100.3.115/svn/repos/wsas</SvnUrl> • <SvnUser>wso2</SvnUser> • <SvnPassword>wso2123</SvnPassword> • <SvnUrlAppendTenantId>true</SvnUrlAppendTenantId> • </DeploymentSynchronizer>
  • 18. Deployment Optimization • Four variants • Lazy initialization • Virtual proxy • Value holder • Ghost • Two aspect of lazy loading in Carbon • Lazy loading global configuration • Lazy loading artifacts
  • 19. Ghost deployment for services carbon.xml - <EnableGhostDeployer>true</EnableGhostDeployer>
  • 20. Lazy loading with Ghost Deployment
  • 21. What is your scale value baseline?
  • 22. Scaling a Cloud Business • Measuring Revenue versus Cost Source: http://giffconstable.com/2009/11/freemium-business-model-template/
  • 23. Tenant Scaling Method Impacts Value Proposition • Single Application Tenant per Multiple Application Tenants per Shared Application Platform Service • Dedicated Application Server Container Container
  • 24. Cloud Topology and Value Five (5) Container Instances, Three Tenants Tenant Application Solution Traffic Tenant Partition Tenant-1 Tenant-2 Tenant-3 Container AS-1 ESB-1 AS-2 ESB-2 ESB-3 Tenant Context Tenant-1 Tenant-1 Tenant-2 Tenant-2 Tenant-3
  • 25. Cloud Topology and Value Three (3) Container Instances, Three Tenants Tenant Application Solution Traffic Web Service Partition ESB Application Container ESB-1 ESB-2 AS-1 Tenant Context Tenant-1 Tenant-3 Tenant-2 Tenant-1 Tenant-2
  • 26. Single Node Primary-Secondary, single LB Primary-Secondary, with multiple LBs at a cost Multi-node active cluster - Single zone Multi-zone Multi-region Cloud Scale = High Availability Multi-IaaS 26
  • 27. Key Metrics • Foundation • Time to create new application environment • Time to redeploy application • Optimize • Minimum and maximum scale • Scale frequency (i.e. time to scale up/down) • Transformation • Time and effort required integrating business process, event processor – creating a complex app. • Time and effort required to apply policy across tenant(s) • Cost to operate application per user or transaction
  • 28. Quick Start Use Cases Service level management and elastic scale • Use cases • Ensure application satisfies consumer demand while maximizing resource utilization • Scale workload processing and increase performance while minimizing infrastructure spend • Load test application service • Demonstrate multi-tenant web application • Key Metrics • Minimum and maximum scale • Scale frequency (i.e. time to scale up/down)
  • 29. Quick Start Use Cases Consumption based pricing and billing • Use cases • View service logs • View bill by business value • Key Metric • Cost to operate application per user or transaction
  • 30. Resources • Try Stratos right now: – https://stratoslive.wso2.com/ • Read about Stratos: – http://wso2.com/cloud/stratos/ – Source Download available • Contact us: – bizdev@wso2.com
  • 31. Resources • Information on tenant-aware load balancing • http://sanjeewamalalgoda.blogspot.com/2012/03/tenant-aware-load-balancer-is-upcoming.html • http://sanjeewamalalgoda.blogspot.com/2012/05/tenant-aware-load-balancer.html • Information on long running performance • http://kishanthan.wordpress.com/2012/06/27/lazy-loading-pattern-in-wso2-stratos • Lazy loading deployment artifacts • http://blog.afkham.org/2011/11/lazy-loading-deployment-artifacts-in.html • Scaling Stratos • http://srinathsview.blogspot.com/2012/06/scaling-wso2-stratos.html • http://blog.afkham.org/2011/09/how-to-setup-wso2-elastic-load-balancer.html • http://blog.afkham.org/2011/09/wso2-load-balancer-how-it-works.html
  • 32. Resources • Auto-scaler service deployment • http://nirmalfdo.blogspot.com/2012/07/autoscaler-service-deployment.html • Auto-scaler service • http://nirmalfdo.blogspot.com/2012/07/wso2-autoscaler-service-part-i.html • Pass-through transport – performance comparison • http://wso2.org/library/articles/2012/03/wso2-esb-message-transfer-mechanisms-comparative-benchmarks/ • Automatic failover for WSO2 ELB • http://gonesimple.org/2012/09/24/automatic-fail-over-for-wso2-elb/