(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
Esri Application on AWS Cloud Webinar
1. Esri Applications in the
AWS Cloud
Mark Ryland, AWS
Marwa Mabrouk, Esri
Shawn Kingsberry, RATB
2. Geographical Information Systems (GIS) help organizations learn and communicate
GIS allows us to
view, understand, question, interpret, and visualize
data in many ways that reveal
relationships, patterns, and trends in the form of
maps, globes, reports, and charts.
3. Esri is the GIS global leader
Esri - world leader in GIS
2011 revenues nearly $1 Billion
350,000 customer organizations in >100 countries
Customers in virtually all industries from insurance and retail to
forestry, petroleum, and public sector
Headquartered in Redlands, California, USA
5. Esri users on Amazon Web Services get
Access to unlimited Support for high
computing power volume sites
Ideal environment for Cost effectiveness
developers
6. Currently, these are Esri’s offerings for running ArcGIS Server on AWS
ArcGIS for Server on Amazon Esri Managed Services: Custom
Web Services launched in 2010 solutions for hosted web mapping
applications and services built and
managed by Esri Professional
Services.
7. On-Premise Infrastructure is Costly & Complex
Large Capital Expenditures
Underutilized IT Assets
Patching Software
Out of Datacenter Space
Scaling down as needed
Slow IT Deployments
Contract negotiation
Scaling up quickly
Prices too high for IT products
Managing physical growth
“IT spends 80% of its time and resources keeping the lights on”
Gartner (*)
(*) Gartner Press Release, 2006
8. The AWS Cloud reduces this cost and complexity
No Up-Front Low Cost Pay Only for
Capital Expense What You Use
Self-Service Easily Scale Up Improve Agility &
Infrastructure and Down Time-to-Market
Deploy
9. Gartner’s 2011 Magic Quadrant for Public Cloud Infrastructure as a Service
Gartner “Magic Quadrant for Public Cloud Infrastructure a Service,” Lydia Leong, Ted Chamberlin, December 8, 2011. This Magic Quadrant graphic was published by Gartner, Inc. as part of a
larger research note and should be evaluated in the context of the entire report.. The Gartner report is available upon request from Steven Armstrong (asteven@amazon.com). Gartner does not
endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings. Gartner research
publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to
this research, including any warranties of merchantability or fitness for a particular purpose.
11. Global Infrastructure for Global Enterprises
GovCloud US West 1 US West 2 US East South EU Asia Asia
(US ITAR (Northern (Oregon) (Northern America (Ireland) Pacific 1 Pacific 2
Region) California) Virginia) (Sao Paulo) (Singapore) (Tokyo)
AWS Regions
AWS Edge Locations (CloudFront and Route 53)
12. Security is our top priority
Certifications Physical Security HW, SW, Network
FISMA Moderate Datacenters in Systematic change
Compliant Controls nondescript facilities management
ITAR compliant Physical access Phased updates
infrastructure (AWS strictly controlled deployment
GovCloud)
Must pass two-factor Safe storage
HIPAA Certified Apps authentication at decommission
least twice for floor
PCI DSS Level 1 for Automated
access
EC2, S3, EBS, VPC, monitoring and self-
RDS, ELB, IAM Physical access audit
logged and audited
SOC 1 Report Advanced network
(formerly SAS-70) protection
ISO 27001
13. Customers are running a variety of applications including Esri Apps
Enterprise Esri, Oracle, SAP, Microsoft, IBM
Applications , Custom Applications
Public Facing Esri Applications
Web Digital Media Distribution
Applications Social Media
Big Data & Analytics for Consumer Web
High Performance Genome Sequencing
Computing Large Scale Batch Processing
Backup & Recovery
Disaster Recovery Disaster Recovery
& Archive Archive
14. Recovery.gov is how RATB engages with its constituents
• Launched February 2009
• Redeployed on September 2009
• “The result is the current incarnation of
Recovery.gov—which, as anyone who has
spent significant amounts of time
scouring government Web sites for
information will tell you, is perhaps the
clearest, richest interactive database ever
produced by the American bureaucracy”
– Andre Romano, Newsweek
15. RATB performed a Cloud Feasibility Assessment for Recovery.gov
Analysis Feasible
Performance Analysis – Web, Database, Geospatial, Bandwidth, I/O
Cost Analysis – Elastic Compute, Storage, Bandwidth, Content Distribution
Timeframe / Scope / Resource Analysis – Level of effort, impact on existing
mission
Risk Analysis – Time, Security, High Availability, Complexity
Gap Analysis – Storage, Backup
Security Analysis – Access Control, Boundary Protection, Data at Rest
Protection, Audit ability
16. Recovery.gov has been a successful cloud deployment
Recovery.gov was officially launched in
a public cloud on April 26 at 9:48 PM
Our migration to the cloud took only 22
days from feasibility study to production
“Recovery.gov is the first government-wide system to move to the cloud... The
Board expects savings of about $750,000 during its current budget cycle and
significantly more savings in the long-term.”
Vivek Kundra, Chief Information Officer – United States
May 13, 2010
17. Recovery.gov Technologies
Social Media
Web Infrastructure
Visualization, Analysis, an
d Reporting
Data Layer
Infrastructure
Disclaimer of Endorsement:
17
Reference herein to any specific commercial products, process, or service by trade name, trademark, manufacturer, or otherwise, does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States
Government. The views and opinions of authors expressed herein do not necessarily state or reflect those of the United States Government, and shall not be used for advertising or product endorsement purposes.
18. Unprecedented results
• Millions of users access Recovery.gov
• One of the largest federal public SharePoint sites ever created
• Was one of the first federal customers to integrate SharePoint and
ArcGIS for a federal public website
• Several Accolades: 14 Nationally Recognized Awards since 2009
19. The BP Gulf Oil Spill Response improved coordination and communication with Esri
Problem:
Need to quickly launch an application to
improve internal and external communication
Solution:
www.Gulfofmexicoresponsemap.com was built
using ArcGIS for Server in AWS, ArcGIS
Online, Microsoft Bing, and Response Content
Benefits:
Incident Commands had a unified view into
the response, improving the coordination of
the response
20. BP gulf Spill Response using Esri GIS and Amazon Web Services
Planners
IT Operations
Field Operatives
Central Updates
Cloud
Database Database
On-Premises
Amazon Cloud
21. The AWS Cloud delivers three main benefits to GIS customers
Deploy Applications Lower Operating Costs Process Faster
Quickly
22. It is hard for organizations to accomplish their mission when deploying on-premises
Needs Survey Assess
Plan Design Engineer
Procure Construct Commission
Deploy
Source: PTS Data Center Solutions
23. With AWS, customers can launch Esri environments with a few clicks
New Development Environment
New Test Environment
New Environment in Japan
New Production Environment
24. The relief effort in Haiti had their applications running in a matter of hours
Problem:
Immediate need to get a map viewer up online
to facilitate emergency response efforts
Solution:
With ArcGIS in the AWS Cloud Esri was able to
deploy the application is less than 2 hours
Built application for up to the minute satellite
images of the affected area
Benefits:
Relief workers were able identify evacuation
routes and get aid to the hardest hit areas
25. Running applications On-Premise is expensive and risky
Wasted Wasted
Demand Capacity Capacity
600k Users
Capacity of Resources
Actual Demand
Wasted
Capacity
300k Users
Unable to meet
mission
Wasted
Capacity
200k Users
Q1 Q2 Q3 Q4 Q1 Time
26. With AWS, organizations lower costs by matching IT resources to demand
AWS
Demand Demand
600k Users
300k Users
200k Users
Q1 Q2 Q3 Q4 Q1 Time
27. The USDA used Esri’s Managed Services to launch their cloud application in three
weeks, and they saved 90% versus hosting on-premises
28. Speed up your processing jobs with Amazon EC2
1 Day 12 Hours 6 Hours 3 Hours
What is it? Amazon Elastic Compute Cloud (Amazon EC2) delivers on-demand,
scalable, and pay-as-you go virtualized server infrastructure.
Customer Impact •Scale to add 1000s of machines in minutes, with no additional cost
of speeding up jobs that scale linearly
•Choice of instance type, payment model, operating system, and
programming language
•Annual uptime of 99.95% SLA during the year
29. Scenario: First, Lets get the data to AWS, you can use the AWS Console, or…
Internet
AWS Import/Export Amazon Direct Connect Up to 700 Mb/s direct to
offer 1Gb and 10Gb Amazon S3 and Amazon EBS
Connections
Up to 900Mb/s with a 1Gb
Direct Connect connection
30. Next, lets make sure we get the right type of data to the right AWS storage service
Amazon Simple Storage Amazon Elastic Block
Service (S3) Storage (EBS)
Static mapping datasets such as Dynamic mapping datasets
Tiled Base Maps such as on-demand map
caching, Vector layers, and
Imagery
31. Since we will want to deliver the base maps fast, lets use Amazon CloudFront
Global content delivery network
26 edge locations across the globe
Self-service sign up, easy administration
Built using Amazon.com’s highly reliable
infrastructure
Key Features
RTMP Streaming
HTTPS Delivery
Private Content for HTTP & Streaming
Programmatic Invalidation
Detailed Logs for HTTP & Streaming
Default Root Object
32. Now lets bring in ArcGIS Server on Amazon Web Services to process and publish content
On-Demand Tiled
Maps Data Set
Imagery Vector
Data Set Data Set
ArcGIS for Server on
Amazon Web Services
33. Here is how a larger deployment would look
Vector
Data Set
Enterprise
Geo-DataBase
Imagery Data
Set
Auto Scaled ArcGIS
for Server
Elastic Load
Balancer
34. We can bring it all together to publish content efficiently at scale
Vector
Data Set
Amazon S3 with Static
Tiled maps Enterprise
Geo-DataBase
Imagery Data
Set
Auto Scaled ArcGIS
Amazon
for Server
CloudFront Elastic Load
Balancer
Amazon
Route 53
35. Contact an account manager at Amazon Web Services at aws.amazon.com/federal
Presented by MarkBusinesses of all sizes need business applications to implement new ideas, streamline existing businesses, drive sales, and increase productivity. But behind each business application there is a sea of complexity and cost. Business applications need servers, storage, datacenter space, power, bandwidth, networking, cooling, etc. They also need development, testing, quality assurance, production and fail-over environments. It’s easy to see why even the largest companies with the best IT departments face significant challenges to get the business applications they need. The reality is that buying and managing on-premise infrastructure to run business applications is costly and complexIt’s very common for business users to wait months for new physical servers to be ordered and delivered. Meanwhile IT is busy managing the purchase process, negotiating contracts, discussing support options, etc. When the servers arrive, IT still has a lot of heavy lifting to do before they are ready to run business applications: find datacenter space, install the software stack, optimize settings, etc. And when the applications are finally deployed, IT has to maintain the new environment, manage uptime, apply patches, scale up or down, etc. It’s no surprise that most organizations spend a large portion of their IT budgets keeping the lights on. In fact, Gartner estimates that the average IT department spends 80% of its time and resources just maintaining existing systems.This means that very little is left for IT to drive innovation and respond quickly to business needs.
Presented by MarkCloud computing is a better way to run your business. The cloud helps companies of all sizesbecome moreagile. Instead of running your applications yourself you can run them on the cloud where IT infrastructure is offered as a service like a utility. With the cloud, your company saves money: there are no up-front capital expenses as you don’t have to buy hardware for your projects. The massive scale and fast pace of innovation of the cloud drive the costs down for you. In the cloud, you pay only for what you use just like electricity.The cloud can also help your company save time and improve agility – it’s faster to get started: you can build new environments in minutes as you don’t need to wait for new servers to arrive. The elastic nature of the cloud makes it easy to scale up and down as needed. At the end of the day you have more resources left for innovation which allows you to focus on projects that can really impact your businesses like building and deploying more applications. “With the high growth nature of our business, we were looking for a cloud solution to enable us to scale fast. Think twice before buying your next server. Cloud computing is the way forward.” - Sami Lababidi, CTO, Playfish
Presented by MarkNo changes permitted.
Presented by MarkAmazon Web Services serves hundreds of thousands of customers in more than 190 countries from startups to Fortune 500s.
Presented by MarkAmazon Web Services is steadily expanding its global infrastructure to help customers achieve lower latency and higher throughput. As our customers grow their businesses, AWS will continue to provide infrastructure that meets their global requirements.
Presented by MarkExamining AWS, you’ll see that the same security isolations are employed as would be found in a traditional datacenter. These include physical datacentre security, separation of the network, isolation of the server hardware, and isolation of storage. AWS customers have control over their data: they own the data, not us; they can encrypt their data at rest and in motion, just as they would in their own datacenter. Amazon Web Services provides the same, familiar approaches to security that companies have been using for decades. Importantly, it does this while also allowing the flexibility and low cost of cloud computing. There is nothing inherently at odds about providing on-demand infrastructure while also providing the security isolation companies have become accustomed to in their existing, privately-owned environments.AWS is a secure, durable technology platform with industry-recognized certifications and audits: PCI DSS Level 1, ISO 27001, FISMA Moderate, HIPAA, SAS 70 Type II. Our services and data centers have multiple layers of operational and physical security designed to protect the integrity and safety of your data. Visit our Security Center to learn more http://aws.amazon.com/security/.Certifications and Accreditations: AWS has successfully completed a SAS70 Type II Audit, and will continue to obtain the appropriate security certifications and accreditations to demonstrate the security of our infrastructure and services. PCI DSS: We finalized our 2011 PCI compliance audit, publishing our extensive Report on Controls (ROC) with an expanded scope. Our new November 30, 2011 PCI Attestation of Compliance, a document from our auditor stating we are compliant with all 12 PCI security standard domains, is available now for customers considering or working on moving PCI systems to AWS. The new Attestation of Compliance document includes some key changes this year: This year we’ve added RDS, ELB, and IAM as in-scope services. The addition of these services is fantastic news for PCI customers since they can now leverage RDS to store cardholder and transaction data, use ELB to manage card transaction traffic, and rely on IAM features as validated control mechanisms that satisfy PCI security standard requirements. Consistent with last year, EC2, S3, EBS, and VPC continue to be in scope. Physical Security: Amazon has many years of experience in designing, constructing, and operating large scale data centers. AWS infrastructure is housed in Amazon-controlled data centers throughout the world. Only those within Amazon who have a legitimate business need to have such information know the actual location of these data centers, and the data centers themselves are secured with a variety of physical barriers to prevent unauthorized access.Secure Services: Each of the services within the AWS cloud is architected to be secure and contains a number of capabilities that restrict unauthorized access or usage without sacrificing the flexibility that customers demand. Data Privacy: AWS enables users to encrypt their personal or business data within the AWS cloud and publishes backup and redundancy procedures for services so that customers can gain greater understanding of how their data flows throughout AWS.“In essence, the security system of AWS’s platform has been added to our existing security systems. We now have a security posture consistent with that of a multi-billion dollar company.” - Jim Warren, CIO, Recovery Accountability and Transparency Board (RATB)
Presented by MarkThe AWS Cloud powers hundreds of thousands of businesses in 190 countries around the world. Large enterprises are using AWS for the following use cases:Running enterprise applications such as Oracle, SAP and Microsoft Applications (Windows Server, Sharepoint Server and SQL Server).Creating custom business applications to support the needs of internal functions such as HR, finance and sales.Developing customer-facing web applications that power ecommerce, mobile, gaming, social media and marketing websites.Processing Big Data and High Performance Computing workloads in the medical, imaging, genome sequencing, web analytics and business intelligence fields. Disaster Recovery, Backup or Archive of business critical data to the Amazon Web Services cloud.
Presented by Marwa
Presented by Marwa
Mark to present
Presented by Mark
Presented by Mark
Haiti Earthquake occurred on Jan 12th. 2010First satellite images were available Jan 13thUrgent need to get viewer up to facilitate emergency response effortsEsri built an application that allowed for up to the minute satellite images of the affected area for hundreds of government and non-government organizations to utilize to immediately deploy aid to HaitiWe were able to provision ArcGIS Server of AWS in less than 2 hours
Mark to presentThis scenario may occur throughout the day as well
Mark to present
Mark to presentProject Manager asked by CIO to deliver app in 3 weeks to align to a marketing initiativeInvestigated options and learned about Esri manager services.Esri took the application requirements and was able to launch in 3 weeks.Since launch over 18 months ago, 100% reliableWhen analyzing costs, saved 90% versus on-prem.Autoscaling.Went so well that when another Esri application needed to be launch they used the exact same model.
Before, taking advantage of AWS’s massive scale was limited by transfer speeds in to Amazon S3 and file size limitations.At Amazon we really focus on listening to our customers and innovating on their behalf, so we launched large object support , up-to 5TB, and Multi-part uploadAspera has created technology that takes advantage of multi-part uploads to transfer data to S3 at up-to 700 Mb/s (you will likely get a chance to see this live later today).We also launched Amazon Direct Connect, so companies can connect directly to AWS with 1Gb and 10Gb ports, bypassing the internet.
Amazon CloudFront is a web service for content delivery. It integrates with other Amazon Web Services to give developers and businesses an easy way to distribute content to end users with low latency, high data transfer speeds, and no required minimum commitments. Amazon CloudFront delivers your static and streaming content using a global network of edge locations. Requests for your objects are automatically routed to the nearest edge location. Amazon CloudFront is optimized to work with other Amazon Web Services, like Amazon Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2). Amazon CloudFront also works seamlessly with any origin server, which stores the original, definitive versions of your files. Like other Amazon Web Services, there are no long-term contracts or monthly commitments for using Amazon CloudFront – you pay only for as much or as little content as you actually deliver through the service. http://aws.amazon.com/cloudfront/
