A Journey Into the Emotions of Software Developers
Windows Azure Pack : How to bring windows azure benefits to your DC
1. http://www.systemcenteruniverse.
ch
How to bring Windows Azure benefits to your own
datacenter
Christopher Keyaert
Senior Tech. Consultant |
MVP
Infront Consulting Group
chris@infrontconsulting.com
Alexandre Verkinderen
Managing Consultant | MVP
SCCS
Alexandre@Verkinderen.co
m
8. http://www.systemcenteruniverse.
ch
Zero to IaaS Cloud in… 6 steps
1. Configure Fabric
2. Create &
Configure Cloud
3. Configure
Accounts in SPF
4. Connect Service
Management API to
SPF & Register
VMM server
5. Offer Plan with
Cloud to Tenant
User
6. Tenant
Subscribes to Plan
and Creates VM
11. http://www.systemcenteruniverse.
ch
Tenant Virtual Machine Features
Cloud OS Virtual Machine Role
Scale-out and Scale-In of a Virtual Machine
Role
Update settings
Upgrade to new version
Change networks
Start/Stop/Shutdown VMs
Add/Remove Devices
Support for VM Templates
Active Directory Authentication
Co-admins can share subscription
13. http://www.systemcenteruniverse.
ch
VM Cloud Administration
Register SPF Endpoint
Basic Auth - add local user into local
groups on SPF server
Add VMM Servers
Support for up to 5 VMM servers
Monitor Cloud Capacity
Ensure adequate capacity is available
for tenants
Manage Tenant resources
Virtual Machines, Networks
15. http://www.systemcenteruniverse.
ch
Tenant Networks
Tenants create their own networks
Site to Site VPN
Network Address Translation
(NAT)
Configuration of topology and
border gateway protocol (BGP)
Tenant IP addresses with
network virtualization
Consistent user experience with
Azure
16. http://www.systemcenteruniverse.
ch
Multi-tenant cloud infrastructure:
virtual networks
Open, extensible and standards-
based solution that delivers
flexibility, automation and control
At-scale management of virtual networks on shared
physical networks
Provision and configure multi-tenant edge gateway
for seamless physical & virtual network connectivity
Enable easy remote access into virtualized service
provider network for tenants
OMI-based plug-in for automated TOR
switch configuration
Partner ecosystem support
http://contosoweb.red.com
14.1.1.100
http://contosoweb.blue.com
14.1.1.100
NVGRE
Service provider cloud
Multi-tenant VPN gateway
Site-to-site
connectivity
192.168.0.0/24192.168.0.0/24
Site-to-site
connectivity
17. http://www.systemcenteruniverse.
ch
Virtual Machines Service in Plans
Plan
Enables Tenant subscription access to a
single VMM cloud
Quota
Aligned with VMM Tenant Admin user roles
VMs, CPUs, Memory, Storage
Networks
Allowed Actions
Resources
VM templates, VM Networks, HW profiles
Gallery Items
20. http://www.systemcenteruniverse.
ch
Service Admin IaaS Gallery
Offer Virtual Machine Role
templates to Tenants
Import and Manage Gallery Items
Publish / Unpublish Gallery Items
to Tenants
Add Gallery Items to Plans
Scope access based on plan
and subscription
Gallery Item authorization from
SPF
Resource extension from VMM
23. http://www.systemcenteruniverse.
ch
1Shared
Shared instances
Shared & reserved instances
• When a website is first created it runs in shared
mode.
• It shares available compute resources with other
subscribers that are also running websites in
shared mode.
Deploy web sites into a shared/multi-tenant
hosting environment running on a shared set of
server resources.
24. http://www.systemcenteruniverse.
ch
Shared instances Reserved instance
Shared and reserved instances
1Reserved
• Websites can be upgraded optionally to run in
reserved mode. This isolates them to run within
a dedicated virtual machine.
• When you change the mode from shared to
reserved, the website is scaled up.
25. http://www.systemcenteruniverse.
ch
Reserved instance Reserved instance
Shared and reserved instances
2Reserved
• Elastically scale the resources sites use to
increase reserved instance capacity as traffic
increases.
• Increasing the value for Reserved Instance
Count will provide fault tolerance and
improved performance through scale out.
• A website in Reserved mode will provide more
consistent performance than a website in
Shared mode because it is not sharing
resources with other tenants.
• If Reserved Instance size is changed from Small
to Medium or Large, the website will run in a
compute instance of corresponding size with
access to associated resources for each size.
29. http://www.systemcenteruniverse.
ch
Continuous usage metering per
tenant subscription
IaaS usage (CPU, Memory, Storage, Network)
IaaS data comes from the Operations Manager DW
Usage metering endpoint added to SPF
Per-subscription Billing APIs
IaaS Data Warehouse
Analytics on Tenant Subscription usage
Built on Microsoft BI stack
Server Inventory Reports
Supports SPLA compliance
IaaS Service Reporting & Usage Metering
30. http://www.systemcenteruniverse.
ch
Usage and Service Reporting Architecture
Usage
Front
End
REST API
-
-
SPF
REST API
Usage
Collector
Metering &
Subscription
Data
SCOM Usage AnalyticsUsage DW
Excel
Performance
Point
ETL
Process
SCVMM
Provider Billing
System
Usage Data
Cache
Metering &
Subscription
Data
Fabric
Capacity
Data
VM Cloud
Fabric
Capacity
Data
Metering &
Subscription Data
Metering &
Subscription
Data
Subscription
Usage
31. http://www.systemcenteruniverse.
ch
SPF Usage Metering Metrics with Per Hour
GranularityMetric Metric Identifier Unit Description
VM memory allocated MemoryAllocated MB Allocated memory size for a VM within an hour
VM memory consumed MemoryConsumed MB Consumed memory size for a VM within an hour
VM CPU allocation count CPUAllocationCount Integer CPU core allocated for a VM within an hour
VM CPU % utilization CPUPercentUtilization Integer Percentage of CPU consumption for a VM within an hour
Disk IOPS across all disks
attached to VM
CrossDiskIOPerSecond Bytes I/O per sec (IOPS) across attached disk for VM within an hour
Disk size allocated across
all disks attached to VM
CrossDiskSizeAllocated Bytes Allocated disk size across aattached disk for a VM within an hour
VM network adapter bytes
sent per sec
NICKBSentPerSecond KB KBs sent per sec on a network adapter attached to a VM within an
hour
VM network adapter bytes
received per sec
NICKKBReceivedPerSecond KB KBs received per sec on a network adapter attached to a VM within
an hour
Network gateway bytes
sent
GatewayKBSent KB KBs sent through virtual network gateway within an hour
Network gateway bytes
received
GatewayKBReceived KB KBs received through virtual network gateway within an hour
VM running uptime RuntimeSeconds Seconds Cumulative time in seconds a virtual machine is in a run state
33. http://www.systemcenteruniverse.
ch
Process automation that simplifies cloud
management
Integration
Integrate into existing systems with
PowerShell integration modules
Build additional PS modules to enable
integrating into other systems
Orchestration
Accelerate time to value with
flexible process workflows
Improve service reliability across
multiple tools, systems, and
department silos
Automation
Enable Cloud providers to focus on
work that adds business value
Reduce error-prone manual
activities while lowering costs
Optimize and extend existing
investments
Deliver flexible and reliable
services
Lower costs and
improve predictability
34. http://www.systemcenteruniverse.
ch
Web Service
• Standard interface for all of SMA
• Security group controls access
• HTTPS support to secure connection to clients
Runbook Worker
• All runbook jobs are picked up by one or more
runbook workers
• Runs under a service account
PowerShell Module
• SMA PowerShell module to enable management of
SMA through cmdlets
Service Admin Portal integration
• Connect the Service Admin portal to the SMA web
service
SMA Installation
37. http://www.systemcenteruniverse.
ch
ODATA REST Web
Service
Runbooks
Jobs
Modules & Activies
Submit requests
Return results
Http RequestHttp Response
Persist State
Pick up Jobs
SQL DatabaseRunbook Workers
Service Management Portal
• Authoring
• Debugging
• Operating
Service Management Portal
• Runbook service
• PowerShell Modules
Runbook Workers
•REST oData web service
•Authorizes users
Web Service
•Runbooks
•Runbook Resources
•Tracks runbook job state
SMA Database
Orchestrator SMA Architecture
40. http://www.systemcenteruniverse.
ch
Messaging service for cloud apps
Guaranteed message delivery
Publish-subscribe messaging patterns
Standard protocols (REST, AMQP, WS*)
Interoperability (.NET, Java/JMS, C/C++)
Now integrated with management portal
Service Bus
45. http://www.systemcenteruniverse.
ch
Built to Differentiate
Web
Sites
VMs
Private Service Provider
SQL
Web
SitesApp
sVM
s
Self-Service
Portal
Service
Plans
Users
Admin Web Sites
Databases
VMs
Subscriber Self-ServiceWeb Sites
Databases
Contoso Hosting
VMs Custom
login,logos,banner,colors,exten
sions,etc…
Apprenda
a a pprenda
Add on Services
CustomPortals
SP1w/ServiceProviderFoundation
Usage
Integratewith
Billing and
Chargeback
Solutions
46. http://www.systemcenteruniverse.
ch
Samples and Documentation Available
Custom Theming
Management APIs for Custom Portals
Custom Resource Providers
Usage Adaptor for Billing Systems
Now available for immediate download
http://bit.ly/ASWS-Samples
48. http://www.systemcenteruniverse.
ch
Why choose the Windows Azure Pack?
Enterprise-class Easy and cost-effective Open and interoperable
• Builds on a familiar foundation of
Windows Server and System Center
• Isolated virtual networks for
multi-tenant workloads
• Extensibility and integration
• Windows Azure code running in
your datacenter
• Highly scalable virtualization and
management platform
• Simple service delivery for multi-tenant
cloud infrastructure
• Out-of-box laaS and Paas
service offerings
• Standardized service provisioning using
service templates
• Automation platform
• Advanced Windows Server 2012
features on standard hardware
• Easy VM and Web application
portability
• Private, hosted and public cloud
• Broad application platform support
including .NET, node.js, PHP
• OData REST API for portal level
integration
• Service Bus for asynchronous
distributed application integration
51. http://www.systemcenteruniverse.
ch
We need your feedback! Thank you!
Session Feedback
https://de.surveymonkey.com/s/SCU2013DACHSessionFeedback
Overall Conference
Feedback
https://de.surveymonkey.com/s/SCU2013DACHOverallFeedb
ack
Editor's Notes
The services we just reviewed are running in Microsoft’s datacenters on the Windows Azure platform. How does this help enterprise and service providers meet their goals?Core to delivering on the Cloud OS promise is enabling parity of application owner experiences irrespective of where the underlying infrastructure may reside: on premises, in a hosted environment, or on Windows Azure. To do that, we need to ensure that tenant end-users have uniform self-service and management experiences to consume the infrastructure needed by their application services for both Windows Azure and Windows Server environments. Enterprises and service providers are already running a sophisticated operating system, virtualization and management platform in Windows Server with System center on their own compute/storage/network infrastructure in their own datacenters.As we’ve already seen, our cloudOS vision drives consistency across Windows Azure, enterprise and service provider environments. The Windows Azure Pack takes Windows Azure technology developed for Microsoft’s datacenters and <click> repurposes it to provide the same capabilities running on System Center, Windows Server on customers’ infrastructure. CloudOS becomes reality. We have found Azure to be a great environment for developing and testing highly distributed cloud services and now we’re bringing all the technology to hosting service providers as part of the technology found in Windows Server and System Center. As you can see, we now have consistency in portal, API and select services across Microsoft, Service Provider and Enterprise. Why is this useful? Well if you reflect back to our discussion on the wants and needs of service providers and enterprise looking to act as internal service providers, this technology meets these needs:Attract enterprise customer workloads to service providers through familiar experienceSelf service IaaSBilling, usage based pricingAutomationIntegration and customizationEtcNow, with the Preview of Windows Azure Pack, you as enterprise or service provider can have Azure technology running in your datacenter – today. It’s important to note that these services are deployed on your existing infrastructure, meaning you do not need to make new infrastructure investments to make this vision a reality, but can leverage what you already own.
Once created, the administrator can monitor resource usage in the cloud.
Talking pointsNetworking is fundamental to the datacenter and customers are generally familiar with how it’s done – so networking is just taken as a “given”. We believe there’s lot of upside in helping customers rethink how they approach networking (through a combination of software and hardware) in a private or hybrid cloud computing environment. To transform networking, customers need to think about networking in the same way that they think about compute – i.e. as a shared, automated pool of capacity. They also need to think about how to reduce operational complexity in networking. Finally, they need a solution that can seamlessly bridge on-premises and off-premises networks. To address the above, Microsoft is committed to delivering on an open, extensible & standards-based solution that has its origin in how we deliver networking for global hi-scale online services like Windows Azure or Bing. It turns out that our key learning is centered around the promises of flexibility, automation and control. Specific bulletsIsolated virtual networks running on shared network infrastructure (delivered in System Center 2012 SP1) – Hyper-V Network Virtualization in Windows Server 2012 is key to abstracting the physical network intricacies from apps/workloads. This is key to meeting the multi-tenancy and isolation requirements that exist in service provider or large enterprise IT organizations (that serve multiple LOB constituents or dev/test/production environments). This needs to be reiterated as it is the foundation of our software-defined promise and solves a key customer need today. Many customers have asked us for the ability to deeply integrate Hyper-V networking into their existing network infrastructure, their existing monitoring and security tools, or with other types of specialized functionality – to meet that need, Windows Server 2012 also introduced the Hyper-V Extensible Switch that enables easy extensions of our hypervisor platform. In-box multitenant edge gateway for seamless connectivity between physical & virtual networks – This software-based (i.e. VM based) gateway will help customers easily extend their datacenter into a service provider environment by providing a termination point for site to site connectivity and enabling end-users access company resources that might be hosted at the service provider. Simultaneously, the gateway will be multitenant aware and hence enables the service provider to drive operational efficiency by enabling multiple customer connections terminate on it. More importantly, the gateway enables seamless bridging between the customers’ physical and virtual networks (NVGRE based) by offering the necessary translation, thereby enabling broader adoption of hybrid networking with bring-your-own-IP (BYOIP) enablement. The gateway is expected to be production ready from a scale and performance perspective (for metrics like number of tenants per gateway VM and throughput). We expect high availability configuration to become available closer to when System Center 2012 R2 will be commercially available. System Center 2012 R2 Virtual Machine Manager is needed to provision and configure remote access and Hyper-V Network Virtualization in this context. Tenants can configure and manage connectivity (from their site to the service provider) through the Windows Azure Pack. Enable easy end-user access into virtualized network infrastructure - System Center 2012 R2 enables configuration of tenant end user access into the virtualized networks hosted at the service provider datacenter. This is done in conjunction with the Windows Server RRAS role. OMI-based plug-in for automated TOR switch configuration - Transforming the datacenter involves abstracting storage, compute and network resources from their underlying physical hardware and manage them in a standardized manner. To support this thinking, Microsoft will enable a plugin for System Center 2012 R2 Virtual Machine Manager to manage top-of-rack network switches that support OMI. We’re working with our networking OEM partners to assure availability of compatible network gear. Partner ecosystem support – A variety of partners have extended their support to offer solutions like merchant silicon, Hyper-V Extensible Switch extensions and network virtualization gateways. We will continue to work with these partners to offer customers the choice of networking solutions to best meet their needs.
The Management Portal can be used to scale websites, and to specify whether if they can run in Shared website mode or Reserved website mode.Shared modeWhen a website is first created it runs in Shared mode, meaning that it shares available compute resources with other subscribers that are also running websites in Shared mode.A single instance of a website configured to run in Shared mode will provide somewhat limited performance when compared to other configurations but should still provide sufficient performance to complete development tasks or proof of concept work. If a website that is configured to run in a single instance using Shared mode is put into production, the resources available to the website may prove to be inadequate as the average number of client requests increases over time. Before putting a website into production, estimate the load that the website will be expected to handle and consider scaling up or scaling out the website by changing configuration options available on the website's Scale management page.References:http://www.windowsazure.com/en-us/manage/services/web-sites/how-to-scale-websites/#reservedmode
When a website’s mode is changed from Shared to Reserved the website is scaled up to run on a single dedicated core with access to additional memory, disk space and bandwidth.
When creating a new Web site, tenants can choose from a gallery of popular, pre-configured web applications.Where needed, the application can automatically provision and configure database (SQL or MySQL) Administrators can tailor the list of web applications available in the gallery
For a custom website where the gallery doesn’t provide a suitable application, tenants can provision a blank website and upload their web application to the empty folder.Developer tools, including Visual Studio and WebMatrix, are deeply integrated into the Web Sites on Windows Server user experience, decreasing onboarding costs and increasing customer satisfaction.Integration with source control allows developers to rapidly iterate and deploy changes. Built in rollback functionality allows customers to revert web site changes with a few clicks of the mouse.Source control repositories such as GitHub, Team Foundation Server and others can be configured to automatically push updates to the running web site which will pick up the latest changes and deploy them to the live website.
Service Bus Queues support a brokered messaging communication model. When using queues, components of a distributed application do not communicate directly with each other, they instead exchange messages via a queue, which acts as an intermediary. A message producer (sender) hands off a message to the queue and then continues its processing. Asynchronously, a message consumer (receiver) pulls the message from the queue and processes it. The producer does not have to wait for a reply from the consumer in order to continue to process and send further messages. Queues offer First In, First Out (FIFO) message delivery to one or more competing consumers. That is, messages are typically received and processed by the receivers in the order in which they were added to the queue, and each message is received and processed by only one message consumer. Using queues can enable you to scale out your applications better, and enable more resiliency to your architecture.Between web and worker roles in a multi-tier application.Between existingdatacenter apps and Windows Azure Pack hosted apps for a hybrid solution.Between components of a distributed application running on-premises in different organizations or departments of an organization.
Service Bus topics and subscriptions support a publish/subscribe messaging communication model. When using topics and subscriptions, components of a distributed application do not communicate directly with each other, they instead exchange messages via a topic, which acts as an intermediary.In contrast to Service Bus queues, where each message is processed by a single consumer, topics and subscriptions provide a one-to-many form of communication, using a publish/subscribe pattern. It is possible to register multiple subscriptions to a topic. When a message is sent to a topic, it is then made available to each subscription to handle/process independently.A topic subscription resembles a virtual queue that receives copies of the messages that were sent to the topic. You can optionally register filter rules for a topic on a per-subscription basis, which allows you to filter/restrict which messages to a topic are received by which topic subscriptions.Service Bus topics and subscriptions support a publish/subscribe messaging communication model. Components of a distributed application do not communicate directly with each other, they instead exchange messages via a topic, which acts as an intermediary.Subscriptions provide a one-to-many form of communication, using a publish/subscribe pattern. subscriptions enable you to scale to process a very large number of messages across a very large number of users and applications.