SlideShare a Scribd company logo
1 of 44
Download to read offline
STG301 - Amazon Web Services Storage Tiers
Headline goes here
Enterprise Workloads - Best Practices
Sub headline goes here

Tom Laszewski
Solution Architect, AWS
November 15, 2013

Thiru Sadagopan
Cloud Services, Apps Associates
© Copyright 2013. Apps Associates LLC.

Chris Gattoni
IT Director, RISO
1
Agenda
•
•
•
•
•

AWS storage options
Enterprise storage challenges
AWS storage solutions – Best practices, performance
A storage configuration for Oracle Database
Case study - RISO

© Copyright 2013. Apps Associates LLC.

2
AWS Storage Options

© Copyright 2013. Apps Associates LLC.

3
Storage Services on AWS
• AWS provides multiple storage options for enterprise workloads
Traditional workloads

Storage migration
techniques

Application-specific
storage options

•
•
•

•
•
•
•
•

•
•
•
•
•

•

Ephemeral storage
Amazon Elastic Block Store
Amazon Simple Storage
Service (S3)
Amazon Glacier

Amazon Direct Connect
Amazon Export/Import
Amazon Storage Gateway
3rd party storage gateways
Tsunami, BitTorrent, 3rd
party solutions

Amazon ElastiCache
Amazon DynamoDB
Amazon RDS
Amazon Redshift
Amazon CloudFront

© Copyright 2013. Apps Associates LLC.

4
Performance Is Critical
•
•
•
•

What storage option has a transfer rate of 10s of MB/sec?
What storage option has up to 32 MB/sec bursting to 40 MB/sec?
12 PIOPS volumes at 500 IOPS will saturate this type of instance
This storage device has single-threaded performance that is limited to
~17MB/sec

• What is the storage option that produces ~120,000 random read IOPS (4 KB blocks)?

• A NoSQL database executing 4K random reads has performance of 3 MB/sec on
this type of storage and ~200 to 260 MB/sec on this type of storage
• Transfer ~3 TB a day using this storage option
• What storage option produces ~100-145 MB/s read and write?
© Copyright 2013. Apps Associates LLC.

5
Enterprise Storage Challenges

© Copyright 2013. Apps Associates LLC.

6
Enterprise Storage Challenges
Performance

• Requires consistent performance, each application has
unique requirements
• Addressed by storage layers like SSD, SAN, NAS etc..
NAS, etc.

Durability and availability

Disk Backups, Tape Backups
• Addressed by using RAID, disk backups, tape backups

Cost

Elasticity and scalability

• Requires high CAPEX

• Often addressed by over provisioning
overprovisioning

© Copyright 2013. Apps Associates LLC.

7
Enterprise Storage on AWS
Performance

Durability and availability

Cost

Elasticity and scalability

•
•
•

Requires consistent performance, each application has
unique requirements EBS optimized instances
Provisioned IOPS, SSD,
Addressed by storage layers like SSD, SAN, NAS etc..

• Built-in replication across AZs; snapshots can be replicated
• Addressed by using RAID, Disk Backups, Tape Backups
across regions

• Requires highyou use, buy vs. build
Pay for what CAPEX

• Often addressed by over provisioning need
Use as little or as much as you want or

© Copyright 2013. Apps Associates LLC.

8
Enterprise Use Cases – Storage Requirements
Databases

Application
software

File Server

Archival
storage (longterm backups)

Latency
(performance)

Low

Moderate

Moderate

Moderate

Durability and
Availability

High

High

High –
moderate

High durability
– Low

Cost ($/GB)

High

Moderate

Low

Very low

Elasticity and
scalability

High –
predictable

Low – stable

High – spiky

Medium –
predictable

© Copyright 2013. Apps Associates LLC.

9
AWS Storage Solutions

© Copyright 2013. Apps Associates LLC.

10
Ephemeral Store – Best Practices
• Use with caution
• Not all instance types have instance store storage
– Second-generation high-memory instances, micro instances

• Use rsync to copy data from instance store volumes to EBS volumes as
applicable to ensure protection
• Initialize the volume before using for high-performance applications
– dd if=/dev/zero of=/dev/sdb bs=1M

• Add to AMIs explicitly if required, when creating images
• Enable “termination protection” at instance level as an additional measure

© Copyright 2013. Apps Associates LLC.

11
Ephemeral Store – Anti-patterns
• Persistent storage – use Amazon ELB/Amazon S3 instead
• Database storage – use Amazon ELB/PIOPS – Amazon ELB volumes
– With proper bootstrapping, ephemeral store can be used for temporary table spaces
– cr2.8xlarge/ hi1.4xlarge provide SSD backed instance-store volumes, which may be
used for temporary database storage using specific database features

• Shared storage – use Amazon ELB/Amazon S3 instead
• Snapshots— use Amazon ELB instead
– Optionally rsync the contents of instance store volumes to Amazon ELB volumes,
depending on the use case

© Copyright 2013. Apps Associates LLC.

12
Amazon EBS – Best Practices
• Use striping for multiple volumes to increase IOPS
– RAID 0 and RAID 1+0
RAID 0 ( Stripe )

RAID 1+0 ( Stripe and mirror )

Usage drivers

I/O performance is more important than fault
tolerance

Fault tolerance is more important than I/O
performance

Advantages

I/O is distributed across the volumes in a stripe,
resulting in better performance

Data is replicated and striped across volumes for
better durability

Disadvantages Overall performance of the stripe is limited to
the worst-performing volume in the set

Doubles the amount of I/O required from the
instance to Amazon ELB

Recoverability

Amazon ELB snapshots are complex to manage,
must depend on third-party backup methods

Fault tolerant due to replication; however, Amazon
ELB snapshots may be complex to manage and
perform complete disk group recovery

Cost

Very little to no overhead; utilization ratio can
be high

Doubles storage cost. May also have impact on
network performance at instance level during highvolume data transfers

© Copyright 2013. Apps Associates LLC.

13
Amazon EBS – Best Practices
• Use Amazon EBS-optimized instance types
– Uses an optimized configuration stack that provides additional dedicated capacity for
Amazon EBS I/O
– Provides the best performance for Amazon EBS volumes by minimizing contention
between Amazon EBS I/O and other traffic
– Delivers dedicated throughput to Amazon EBS, with options between 500 Mbps and
1000 Mbps
– Costs an additional low, hourly fee for the dedicated capacity
– Cannot be enabled for a running instance; requires start and stop of instance
– Not available for all instance types
– Not required for cluster instance types
© Copyright 2013. Apps Associates LLC.

14
Amazon EBS – Best Practices
• Availability of Amazon EBS–optimized instance types
Network
performance

EBS
optimization

Instance types

Comments

Very low /
Low

Not available

m1.small, t1.micro

Not recommended for I/O-intensive workloads; application scaleout is recommended.

No

m1.medium, c1.medium,
m2.xlarge,

Not recommended for I/O intensive workloads.

Yes

m1.large, m3.xlarge,
m2.2xlarge

Can provide up to 500 Mbps of dedicated Amazon EBS
throughput. Can be used for moderate to high I/O workloads.

High

Yes

m1.xlarge, m3.2xlarge,
c1.xlarge, m2.4xlarge

Can provide up to 1000 Mbps of dedicated Amazon EBS
throughput. Can be used for high I/O workloads.

10 gigabit

Not available

cc2.8xlarge, cr1.8xlarge ,
hi1.4xlarge, hs1.8xlarge ,
cg1.4xlarge

Amazon EBS optimization is not required, as these instances
provide better network throughput and can deliver better I/O
performance.

Moderate

© Copyright 2013. Apps Associates LLC.

15
Provisioned IOPS – Best Practices
• Provisioned IOPS volumes are designed to deliver within 10% of the provisioned
IOPS performance 99.9% of the time
– When attached to Amazon EBS–optimized instances
– Enough I/O requests to maintain its optimal average queue length
– The read and write operations have a block size of 16 KB or less

• Prepare new PIOPS volumes by touching all blocks to ensure consistent
performance
• Avoid taking Amazon EBS snapshots (for both PIOPS and Standard EBS volumes)
during peak load
• Avoid throttling overall network pipe/Amazon EBS optimization by attaching too
many PIOPS volumes
© Copyright 2013. Apps Associates LLC.

16
Amazon EBS – Performance
• Queue length
– Maintaining the optimal average queue length is crucial for delivering
provisioned throughput
– If the workload maintains an average queue length that is higher than your
optimal value, then your per-request I/O latency will increase, and in this case
you should provision more IOPS for your volume
– Maintain average queue length of 1 for every 200 Provisioned IOPS and tune
that value according to your application requirements
– VolumeQueueLength Amazon CloudWatch metric can be used for each volume
to identify potential performance issues

© Copyright 2013. Apps Associates LLC.

17
Amazon EBS - Performance
• Amazon CloudWatch metrics to monitor for Amazon EBS volumes
–
–
–
–
–
–

VolumeQueueLength
VolumeIdleTime
VolumeReadOps
VolumeWriteOps
VolumeThroughputPercentage (for PIOPS volumes)
VolumeConsumedReadWriteOps (for PIOPS volumes)

• VolumeWriteOps/VolumeReadOps needs to be monitored for standard Amazon
EBS volumes to find potential need to convert them to PIOPS

© Copyright 2013. Apps Associates LLC.

18
Amazon EBS – Anti-patterns
• EBS storage is not recommended for these use cases
– Temporary storage
• Must never use this for SWAP disks

– Highly durable storage
• Amazon EBS is designed to provide 99.5% – 99.9% annual durability. For better durability,
use Amazon S3

– Static data or web content
• Use Amazon S3 or Amazon CloudFront instead

– Key-Value pair information
• Use an AWS database service

– Data that required very low access latency (like session data)
• Use in-memory options such as Amazon ElastiCache or Amazon DynamoDB

© Copyright 2013. Apps Associates LLC.

19
Amazon S3 – Best Practices
• Amazon S3 performance considerations
–
–
–
–

Amazon S3 can support 100 requests per second without much tuning effort
If higher performance is required, optimization is required
For GET-intensive workloads, use Amazon CloudFront
For a mix of request types, optimize the object keys for better performance

• For enterprise workloads
– To optimize backup processes
• Use multiple backup threads

– If Amazon S3 backup is performed from within a VPC, make sure that Amazon S3 can
be accessed directly from a private subnet
• Usage of NAT instance may become a bottleneck
© Copyright 2013. Apps Associates LLC.

20
Amazon S3 – Anti-patterns
• Use cases where Amazon S3 is not recommended
– File system
• Even though it can emulate file system formats using keys, Amazon S3 is not recommended
as an alternative to a file system. Using tools that can mount an Amazon S3 bucket as a file
system may have severe performance/cost impacts

– Structured data with query
• Use Amazon Relational Database Service instead

– Rapidly changing data
• Use Amazon EBS volumes instead

– Data that is rarely accessed
• Use Amazon Glacier instead

© Copyright 2013. Apps Associates LLC.

21
AWS Storage Options Summary
Storage option

General

Database

Applications

Speed

Instance Store

Swap

Temporary files

Reports cache,
web server cache

Very low latency Very low; volatile

Amazon EBS –
PIOPS

Data files, redo
logs

Durability

Low latency

Moderate; needs to be
backed up regularly

Amazon EBS

Boot volume

Binaries, archive
logs

Binaries

Moderate
latency

Moderate; needs to be
backed up regularly

Amazon S3

Backups

Backups

Backups

Longer latency

Very high durability

Amazon Glacier

Long-term
backups

Long-term
backups

Long-term
backups

Restore times of Very high durability
3–5 hr

© Copyright 2013. Apps Associates LLC.

22
A Storage Configuration for Oracle Database

© Copyright 2013. Apps Associates LLC.

23
Database I/O Patterns
• Cache data in memory from disk to achieve fast query response
• For OLTP/DSS workloads, memory should be big enough to hold as much as
possible

SGA
Buffer Cache

100% cache hit ratio is ideal
for OLTP workloads

© Copyright 2013. Apps Associates LLC.

24
Database I/O Patterns
• CPU time is consumed mainly by I/O wait

Disk I/O Time
CPU Time

Select

Update

Cache miss

Select

Update

Cache hit
© Copyright 2013. Apps Associates LLC.

25
Database Cache Has Limits
1. Data size is increasing...

1. Huge amounts of data
2. Not possible to cache all
data

SGA

2. User volume is increasing...

Buffer Cache

3. Many I/O operations

Source: oracle corporation
© Copyright 2013. Apps Associates LLC.

26
Impact of I/O on CPU Response Times
I/O bottleneck
Low throughput and slow response
Low CPU usage

700

16.00
14.00

600

12.00
TPS

500

RES

10.00

400

8.00

300

6.00

200

4.00

100

2.00

0

Response Time(Normal100Thread=>1.00)

TPS(Normal-100Thread=>100)

800

0.00

Thread

100

200

300

400

500

600

700

800

Source: oracle corporation
© Copyright 2013. Apps Associates LLC.

27
Storage Best Practices for Oracle
• Oracle Automatic Storage Management feature is recommended option to
optimize storage performance on AWS
• SAME (Stripe and Mirror Everything) feature of Oracle ASM will help distributing
entire data across multiple Amazon EBS volumes
• ASM along with PIOPS Amazon EBS volumes can provide robust storage
performance on AWS
• Oracle Secure Backup for Cloud Module will enable backups directly from Oracle
Database/ASM to Amazon S3 using RMAN
• RMAN channels can be optimized for optimal system throughput and storage
performance

© Copyright 2013. Apps Associates LLC.

28
Typical Storage Configuration for Oracle
Storage Type

Comments

Binaries

Amazon EBS volume

Standard volume;
Amazon EBS snapshots enabled

Data files

PIOPS – Amazon EBS
volumes

Striped across multiple volumes using ASM or any other
technology
PIOPS of 1000 or above

Redo log files

PIOPS – Amazon EBS
volumes

Use separate Amazon EBS Volumes for each group;
preferable to use ASM disk groups

Archive log files

Amazon EBS volumes

Standard volumes for normal database workloads;
PIOPS for highly transactional environments

Backup files

Amazon EBS volumes /
Amazon S3

Standard Amazon EBS volumes for local backups;
use OSB/other technology to push to Amazon S3
© Copyright 2013. Apps Associates LLC.

29
Storage Options for Oracle
• Sample disk layout for Oracle database using ASM

DEV

PROD
+PROD_DATA
Striping

+PROD_FRA
Striping

4 EBS Volumes
4 EBS Volumes
1000 PIOPS
4000 PIOPS
ASM instance with 16,000+ IOPS

TEST

+DEV_DATA

S3

Bucket
Lifecycle
policies

Striping

4 EBS Volumes
500 PIOPS
Amazon Glacier
© Copyright 2013. Apps Associates LLC.

30
Database Backup Best practices

PROD

+PROD_DATA

+PROD_FRA

Striping

4 EBS Volumes
1000 PIOPS

/backupfs

OSB cloud module
using RMAN

EBS snapshot

S3 Bucket

Striping

4 EBS Volumes
4000 PIOPS

RMAN local backup

© Copyright 2013. Apps Associates LLC.

31
SSD Storage with Oracle
• AWS provides 2 instances types with SSD storage
– cr1.8xlarge – 240 GB of SSD
– hi1.4xlarge – 2048 GB of SSD

• This SSD storage is ‘ephemeral’ and CANNOT be used for data files
• However, this SSD can be leveraged by using “Oracle Flash Cache”
– Available at no additional cost, Database Smart Flash Cache on Oracle Solaris and
Oracle Enterprise Linux

• Oracle Flash Cache simply extends the buffer cache to leverage SSD
• Recommended use case for environments with huge working datasets
– ETL processes for data warehouses
– Reporting work load
© Copyright 2013. Apps Associates LLC.

32
Case Study - RISO
Chris Gattoni, IT Director

© Copyright 2013. Apps Associates LLC.

33
About RISO, Inc.
Who RISO Is
Mission
RISO means “ideal.” RISO strives to create fundamentally unique new
technologies in paper-based communication. Every product we
manufacture offers the ideal solution to our customers. At the same
time, RISO carries on a tradition of caring for the world at large through
our environmental and community support programs. Just as we are
committed to delivering the ideal products and service, we strive to be
an ideal corporate citizen in every country in which we conduct
business.
Company Overview
RISO, Inc. is a world leader in digital printing solutions, with award
winning printing technologies that are at the forefront of the printing
equipment industry. RISO printers help improve productivity, increase
versatility, and reduce costs.
About RISO, Inc.
What RISO Does
RISO sells high speed inkjet printers and
digital duplicators. They're low-cost,
durable, & reliable production printers.

RISO strives to create
fundamentally unique new
technologies in paper-based
communication through an
approach that emphasizes
productivity, cost containment, and
versatility. Every product we
manufacture delivers these benefits
in a balance that offers the ideal
solution to our customers.

Speed up your color communications!
Key Business Drivers
• Key challenges
–
–
–
–

End-of-life hardware
CAPEX vs. OPEX
Upcoming datacenter migration
IT not spending enough time on core functions

• AWS solution
–
–
–
–

Migrate from existing hardware to Amazon EC2 platform
Lower TCO
No datacenter to maintain , resulting in more flexibility for infrastructure team
Scalable and elastic platform

© Copyright 2013. Apps Associates LLC.

36
On-Premises Environment
• Infrastructure spread across multiple locations
– Connectivity required from multiple locations
– Multiple servers, SAN Storage, network equipment
– Printers, tape libraries, file servers

• Applications include
–
–
–
–
–

Oracle ERP
Oracle Business Intelligence
LACROSSE applications on Microsoft SQL Server
Domain controllers, PING identity, monitoring servers
Ticketing Systems

© Copyright 2013. Apps Associates LLC.

37
Target AWS Environment
• Virtual Private Cloud with multiple VPN tunnels for redundancy
– Separate VPN tunnels to each remote location
– Access restricted only via VPN tunnel for better security

• EC2 servers with Amazon EBS storage
– Amazon EBS – PIOPS for database storage

• Tape library replaced with Amazon S3
• DR setup for core infrastructure components like domain controller
• DR build for enterprise applications in separate region

© Copyright 2013. Apps Associates LLC.

38
Storage Options on AWS
• Leveraged all storage options to ensure optimal performance in AWS
–
–
–
–

Ephemeral – Swap space/Temp storage
Amazon EBS volumes – OS boot volumes / Software binaries / Application storage
Amazon EBS - PIOPS Volumes – Oracle data files, redo logs on striped volumes
Amazon S3 (RRS) – For storing non-production backups using third-party backup
appliance
– Amazon S3 – For storing production backups
– Amazon Glacier – Long-term archival of backups
– AWS Export/Import – To transfer 2+ TB data to Amazon Glacier using USB disks

© Copyright 2013. Apps Associates LLC.

39
Key Challenges
• 32-bit vs. 64-bit instance types
–
–
–
–
–

AWS provides limited options to run 32-bit applications
Legacy applications were not certified to run on 64-bit instances
Upgrade to latest versions was not feasible
32-bit instance types were unable to provide enough throughput
Network performance/Amazon EBS performance was insufficient to meet user load

• Solution: Amazon EBS PIOPS with scale out
– Implemented multiple Amazon EBS PIOPS volumes with Amazon EBS optimization for
better I/O
– Scaled out application middle tier to use multiple servers for better throughput
– Used custom-built AMIs to run legacy applications to avoid AWS dependency
© Copyright 2013. Apps Associates LLC.

40
Key Takeaways
•
•
•
•

AWS provides multiple storage options for enterprise workloads
No single option fits all workloads
Proper planning and validation of I/O performance is the key for success
Phased approach for AWS migration
–
–
–
–

Start with a POC
Migrate test/dev environments
Build DR in cloud
Migrate production workloads

• Continuous monitoring of key performance metrics is crucial for success

© Copyright 2013. Apps Associates LLC.

41
Resources
• AWS Architecture Center
http://aws.amazon.com/architecture/

• Storage Options in the AWS Cloud
http://media.amazonwebservices.com/AWS_Storage_Options.pdf

• AWS: Overview of Security Process
http://media.amazonwebservices.com/pdf/AWS_Security_Whitepaper.pdf

• Roadmap to Moving Your Applications to the Cloud
http:// www.appsassociates.com/white-papers/moving-applications-to-cloud

• AWS Test Drive Labs – Try your application in the Cloud
http://www.appsassociates.com/awslabs/
© Copyright 2013. Apps Associates LLC.

42
Connect With Us
• Web: www.appsassociates.com
• Email: Thiru.Sadagopan@appsassociates.com
tomlasz@amazon.com
cgattoni@riso.com
• YouTube: www.youtube.com/user/AppsAssociates
• LinkedIn: www.us.linkedin.com/company/apps-associates
• Twitter: @AppsAssociates
• Facebook: www.facebook.com/AppsAssociatesGlobal

© Copyright 2013. Apps Associates LLC.

43
Thank You!

More Related Content

What's hot

BDA 302 Deep Dive on Migrating Big Data Workloads to Amazon EMR
BDA 302 Deep Dive on Migrating Big Data Workloads to Amazon EMRBDA 302 Deep Dive on Migrating Big Data Workloads to Amazon EMR
BDA 302 Deep Dive on Migrating Big Data Workloads to Amazon EMRAmazon Web Services
 
Design, Deploy, and Optimize Microsoft SQL Server on AWS
Design, Deploy, and Optimize Microsoft SQL Server on AWSDesign, Deploy, and Optimize Microsoft SQL Server on AWS
Design, Deploy, and Optimize Microsoft SQL Server on AWSAmazon Web Services
 
AWS Summit London 2014 | Maximising EC2 and EBC Performance (400)
AWS Summit London 2014 | Maximising EC2 and EBC Performance (400)AWS Summit London 2014 | Maximising EC2 and EBC Performance (400)
AWS Summit London 2014 | Maximising EC2 and EBC Performance (400)Amazon Web Services
 
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...Amazon Web Services
 
PASS 17 SQL Server on AWS Best Practices
PASS 17 SQL Server on AWS Best PracticesPASS 17 SQL Server on AWS Best Practices
PASS 17 SQL Server on AWS Best PracticesAmazon Web Services
 
Best Practices running SQL Server on AWS
Best Practices running SQL Server on AWSBest Practices running SQL Server on AWS
Best Practices running SQL Server on AWSAmazon Web Services
 
Best Practices for Running Amazon EC2 Spot Instances with Amazon EMR - AWS On...
Best Practices for Running Amazon EC2 Spot Instances with Amazon EMR - AWS On...Best Practices for Running Amazon EC2 Spot Instances with Amazon EMR - AWS On...
Best Practices for Running Amazon EC2 Spot Instances with Amazon EMR - AWS On...Amazon Web Services
 
Introduction to Database Services
Introduction to Database ServicesIntroduction to Database Services
Introduction to Database ServicesAmazon Web Services
 
Deep Dive: Scaling Up to Your First 10 Million Users
Deep Dive: Scaling Up to Your First 10 Million UsersDeep Dive: Scaling Up to Your First 10 Million Users
Deep Dive: Scaling Up to Your First 10 Million UsersAmazon Web Services
 
How to Scale to Millions of Users with AWS
How to Scale to Millions of Users with AWSHow to Scale to Millions of Users with AWS
How to Scale to Millions of Users with AWSAmazon Web Services
 
Strategic Uses for Cost Efficient Long-Term Cloud Storage
Strategic Uses for Cost Efficient Long-Term Cloud StorageStrategic Uses for Cost Efficient Long-Term Cloud Storage
Strategic Uses for Cost Efficient Long-Term Cloud StorageAmazon Web Services
 
AWS re:Invent 2016: Case Study: How Monsanto Uses Amazon EFS with Their Large...
AWS re:Invent 2016: Case Study: How Monsanto Uses Amazon EFS with Their Large...AWS re:Invent 2016: Case Study: How Monsanto Uses Amazon EFS with Their Large...
AWS re:Invent 2016: Case Study: How Monsanto Uses Amazon EFS with Their Large...Amazon Web Services
 
Amazon RDS for Microsoft SQL: Performance, Security, Best Practices (DAT303) ...
Amazon RDS for Microsoft SQL: Performance, Security, Best Practices (DAT303) ...Amazon RDS for Microsoft SQL: Performance, Security, Best Practices (DAT303) ...
Amazon RDS for Microsoft SQL: Performance, Security, Best Practices (DAT303) ...Amazon Web Services
 
Design, Deploy, and Optimize Microsoft SQL Server on AWS - WIN306 - re:Invent...
Design, Deploy, and Optimize Microsoft SQL Server on AWS - WIN306 - re:Invent...Design, Deploy, and Optimize Microsoft SQL Server on AWS - WIN306 - re:Invent...
Design, Deploy, and Optimize Microsoft SQL Server on AWS - WIN306 - re:Invent...Amazon Web Services
 
Day 2 - Amazon RDS - Letting AWS run your Low Admin, High Performance Database
Day 2 - Amazon RDS - Letting AWS run your Low Admin, High Performance DatabaseDay 2 - Amazon RDS - Letting AWS run your Low Admin, High Performance Database
Day 2 - Amazon RDS - Letting AWS run your Low Admin, High Performance DatabaseAmazon Web Services
 
Amazon Elastic Block Store for Application Storage
Amazon Elastic Block Store for Application StorageAmazon Elastic Block Store for Application Storage
Amazon Elastic Block Store for Application StorageAmazon Web Services
 

What's hot (20)

BDA 302 Deep Dive on Migrating Big Data Workloads to Amazon EMR
BDA 302 Deep Dive on Migrating Big Data Workloads to Amazon EMRBDA 302 Deep Dive on Migrating Big Data Workloads to Amazon EMR
BDA 302 Deep Dive on Migrating Big Data Workloads to Amazon EMR
 
Design, Deploy, and Optimize Microsoft SQL Server on AWS
Design, Deploy, and Optimize Microsoft SQL Server on AWSDesign, Deploy, and Optimize Microsoft SQL Server on AWS
Design, Deploy, and Optimize Microsoft SQL Server on AWS
 
AWS Summit London 2014 | Maximising EC2 and EBC Performance (400)
AWS Summit London 2014 | Maximising EC2 and EBC Performance (400)AWS Summit London 2014 | Maximising EC2 and EBC Performance (400)
AWS Summit London 2014 | Maximising EC2 and EBC Performance (400)
 
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
 
Intro to AWS: Database Services
Intro to AWS: Database ServicesIntro to AWS: Database Services
Intro to AWS: Database Services
 
PASS 17 SQL Server on AWS Best Practices
PASS 17 SQL Server on AWS Best PracticesPASS 17 SQL Server on AWS Best Practices
PASS 17 SQL Server on AWS Best Practices
 
Best Practices running SQL Server on AWS
Best Practices running SQL Server on AWSBest Practices running SQL Server on AWS
Best Practices running SQL Server on AWS
 
Best Practices for Running Amazon EC2 Spot Instances with Amazon EMR - AWS On...
Best Practices for Running Amazon EC2 Spot Instances with Amazon EMR - AWS On...Best Practices for Running Amazon EC2 Spot Instances with Amazon EMR - AWS On...
Best Practices for Running Amazon EC2 Spot Instances with Amazon EMR - AWS On...
 
Intro to AWS: Database Services
Intro to AWS: Database ServicesIntro to AWS: Database Services
Intro to AWS: Database Services
 
Introduction to Database Services
Introduction to Database ServicesIntroduction to Database Services
Introduction to Database Services
 
Deep Dive: Scaling Up to Your First 10 Million Users
Deep Dive: Scaling Up to Your First 10 Million UsersDeep Dive: Scaling Up to Your First 10 Million Users
Deep Dive: Scaling Up to Your First 10 Million Users
 
How to Scale to Millions of Users with AWS
How to Scale to Millions of Users with AWSHow to Scale to Millions of Users with AWS
How to Scale to Millions of Users with AWS
 
Strategic Uses for Cost Efficient Long-Term Cloud Storage
Strategic Uses for Cost Efficient Long-Term Cloud StorageStrategic Uses for Cost Efficient Long-Term Cloud Storage
Strategic Uses for Cost Efficient Long-Term Cloud Storage
 
Masterclass Live: Amazon EMR
Masterclass Live: Amazon EMRMasterclass Live: Amazon EMR
Masterclass Live: Amazon EMR
 
AWS re:Invent 2016: Case Study: How Monsanto Uses Amazon EFS with Their Large...
AWS re:Invent 2016: Case Study: How Monsanto Uses Amazon EFS with Their Large...AWS re:Invent 2016: Case Study: How Monsanto Uses Amazon EFS with Their Large...
AWS re:Invent 2016: Case Study: How Monsanto Uses Amazon EFS with Their Large...
 
Amazon RDS for Microsoft SQL: Performance, Security, Best Practices (DAT303) ...
Amazon RDS for Microsoft SQL: Performance, Security, Best Practices (DAT303) ...Amazon RDS for Microsoft SQL: Performance, Security, Best Practices (DAT303) ...
Amazon RDS for Microsoft SQL: Performance, Security, Best Practices (DAT303) ...
 
Design, Deploy, and Optimize Microsoft SQL Server on AWS - WIN306 - re:Invent...
Design, Deploy, and Optimize Microsoft SQL Server on AWS - WIN306 - re:Invent...Design, Deploy, and Optimize Microsoft SQL Server on AWS - WIN306 - re:Invent...
Design, Deploy, and Optimize Microsoft SQL Server on AWS - WIN306 - re:Invent...
 
AWS Storage State of the Union
AWS Storage State of the UnionAWS Storage State of the Union
AWS Storage State of the Union
 
Day 2 - Amazon RDS - Letting AWS run your Low Admin, High Performance Database
Day 2 - Amazon RDS - Letting AWS run your Low Admin, High Performance DatabaseDay 2 - Amazon RDS - Letting AWS run your Low Admin, High Performance Database
Day 2 - Amazon RDS - Letting AWS run your Low Admin, High Performance Database
 
Amazon Elastic Block Store for Application Storage
Amazon Elastic Block Store for Application StorageAmazon Elastic Block Store for Application Storage
Amazon Elastic Block Store for Application Storage
 

Viewers also liked

Introduction to Block and File storage on AWS
Introduction to Block and File storage on AWSIntroduction to Block and File storage on AWS
Introduction to Block and File storage on AWSAmazon Web Services
 
Case Study: Manheim Implements Test Data Management to Reduce Testing Time an...
Case Study: Manheim Implements Test Data Management to Reduce Testing Time an...Case Study: Manheim Implements Test Data Management to Reduce Testing Time an...
Case Study: Manheim Implements Test Data Management to Reduce Testing Time an...CA Technologies
 
Enterprise Security Considerations
Enterprise Security ConsiderationsEnterprise Security Considerations
Enterprise Security ConsiderationsAmazon Web Services
 
Cassandra Java APIs Old and New – A Comparison
Cassandra Java APIs Old and New – A ComparisonCassandra Java APIs Old and New – A Comparison
Cassandra Java APIs Old and New – A Comparisonshsedghi
 
AWSome Day Cork | Technical Track
AWSome Day Cork | Technical TrackAWSome Day Cork | Technical Track
AWSome Day Cork | Technical TrackAmazon Web Services
 
AWS Summit Sydney 2014 | Reduce Risk in eCommerce Projects through Outcome Ba...
AWS Summit Sydney 2014 | Reduce Risk in eCommerce Projects through Outcome Ba...AWS Summit Sydney 2014 | Reduce Risk in eCommerce Projects through Outcome Ba...
AWS Summit Sydney 2014 | Reduce Risk in eCommerce Projects through Outcome Ba...Amazon Web Services
 
Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...
Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...
Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...Amazon Web Services
 
AWS Summit Auckland 2014 | Continuous Integration and Deployment Best Practic...
AWS Summit Auckland 2014 | Continuous Integration and Deployment Best Practic...AWS Summit Auckland 2014 | Continuous Integration and Deployment Best Practic...
AWS Summit Auckland 2014 | Continuous Integration and Deployment Best Practic...Amazon Web Services
 
Customer Sharing: HTC - What is in AWS Cloud for me?
Customer Sharing: HTC - What is in AWS Cloud for me?Customer Sharing: HTC - What is in AWS Cloud for me?
Customer Sharing: HTC - What is in AWS Cloud for me?Amazon Web Services
 
AWS Webcast - AWS Webinar Series for Education #2 - Getting Started with AWS
AWS Webcast - AWS Webinar Series for Education #2 - Getting Started with AWSAWS Webcast - AWS Webinar Series for Education #2 - Getting Started with AWS
AWS Webcast - AWS Webinar Series for Education #2 - Getting Started with AWSAmazon Web Services
 
AWS Enterprise Summit London | AWS as an Agile Enabler at The Co-operative
AWS Enterprise Summit London | AWS as an Agile Enabler at The Co-operativeAWS Enterprise Summit London | AWS as an Agile Enabler at The Co-operative
AWS Enterprise Summit London | AWS as an Agile Enabler at The Co-operativeAmazon Web Services
 
Argus media & amazon cloud search
Argus media & amazon cloud searchArgus media & amazon cloud search
Argus media & amazon cloud searchAmazon Web Services
 
Getting Started with Amazon Aurora
Getting Started with Amazon AuroraGetting Started with Amazon Aurora
Getting Started with Amazon AuroraAmazon Web Services
 
Customer Sharing: Weather Risk - Weather on the Cloud
Customer Sharing: Weather Risk - Weather on the CloudCustomer Sharing: Weather Risk - Weather on the Cloud
Customer Sharing: Weather Risk - Weather on the CloudAmazon Web Services
 
AWS Summit Auckland 2014 | Managing the Pace of Innovation: Behind the Scenes...
AWS Summit Auckland 2014 | Managing the Pace of Innovation: Behind the Scenes...AWS Summit Auckland 2014 | Managing the Pace of Innovation: Behind the Scenes...
AWS Summit Auckland 2014 | Managing the Pace of Innovation: Behind the Scenes...Amazon Web Services
 
AWS Big Data Analytics IP Expo 2013
AWS Big Data Analytics IP Expo 2013AWS Big Data Analytics IP Expo 2013
AWS Big Data Analytics IP Expo 2013Amazon Web Services
 
AWS Summit Sydney 2014 | Running your First Application on AWS
AWS Summit Sydney 2014 | Running your First Application on AWSAWS Summit Sydney 2014 | Running your First Application on AWS
AWS Summit Sydney 2014 | Running your First Application on AWSAmazon Web Services
 

Viewers also liked (20)

Introduction to Block and File storage on AWS
Introduction to Block and File storage on AWSIntroduction to Block and File storage on AWS
Introduction to Block and File storage on AWS
 
Soa And Web Services Security
Soa And Web Services SecuritySoa And Web Services Security
Soa And Web Services Security
 
Case Study: Manheim Implements Test Data Management to Reduce Testing Time an...
Case Study: Manheim Implements Test Data Management to Reduce Testing Time an...Case Study: Manheim Implements Test Data Management to Reduce Testing Time an...
Case Study: Manheim Implements Test Data Management to Reduce Testing Time an...
 
Enterprise Security Considerations
Enterprise Security ConsiderationsEnterprise Security Considerations
Enterprise Security Considerations
 
Cassandra Java APIs Old and New – A Comparison
Cassandra Java APIs Old and New – A ComparisonCassandra Java APIs Old and New – A Comparison
Cassandra Java APIs Old and New – A Comparison
 
AWSome Day Cork | Technical Track
AWSome Day Cork | Technical TrackAWSome Day Cork | Technical Track
AWSome Day Cork | Technical Track
 
AWS Summit Sydney 2014 | Reduce Risk in eCommerce Projects through Outcome Ba...
AWS Summit Sydney 2014 | Reduce Risk in eCommerce Projects through Outcome Ba...AWS Summit Sydney 2014 | Reduce Risk in eCommerce Projects through Outcome Ba...
AWS Summit Sydney 2014 | Reduce Risk in eCommerce Projects through Outcome Ba...
 
Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...
Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...
Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...
 
AWS Summit Auckland 2014 | Continuous Integration and Deployment Best Practic...
AWS Summit Auckland 2014 | Continuous Integration and Deployment Best Practic...AWS Summit Auckland 2014 | Continuous Integration and Deployment Best Practic...
AWS Summit Auckland 2014 | Continuous Integration and Deployment Best Practic...
 
Customer Sharing: HTC - What is in AWS Cloud for me?
Customer Sharing: HTC - What is in AWS Cloud for me?Customer Sharing: HTC - What is in AWS Cloud for me?
Customer Sharing: HTC - What is in AWS Cloud for me?
 
AWS Webcast - AWS Webinar Series for Education #2 - Getting Started with AWS
AWS Webcast - AWS Webinar Series for Education #2 - Getting Started with AWSAWS Webcast - AWS Webinar Series for Education #2 - Getting Started with AWS
AWS Webcast - AWS Webinar Series for Education #2 - Getting Started with AWS
 
AWS Enterprise Summit London | AWS as an Agile Enabler at The Co-operative
AWS Enterprise Summit London | AWS as an Agile Enabler at The Co-operativeAWS Enterprise Summit London | AWS as an Agile Enabler at The Co-operative
AWS Enterprise Summit London | AWS as an Agile Enabler at The Co-operative
 
Argus media & amazon cloud search
Argus media & amazon cloud searchArgus media & amazon cloud search
Argus media & amazon cloud search
 
Getting Started with Amazon Aurora
Getting Started with Amazon AuroraGetting Started with Amazon Aurora
Getting Started with Amazon Aurora
 
Customer Sharing: Weather Risk - Weather on the Cloud
Customer Sharing: Weather Risk - Weather on the CloudCustomer Sharing: Weather Risk - Weather on the Cloud
Customer Sharing: Weather Risk - Weather on the Cloud
 
AWS Summit Auckland 2014 | Managing the Pace of Innovation: Behind the Scenes...
AWS Summit Auckland 2014 | Managing the Pace of Innovation: Behind the Scenes...AWS Summit Auckland 2014 | Managing the Pace of Innovation: Behind the Scenes...
AWS Summit Auckland 2014 | Managing the Pace of Innovation: Behind the Scenes...
 
AWS Big Data Analytics IP Expo 2013
AWS Big Data Analytics IP Expo 2013AWS Big Data Analytics IP Expo 2013
AWS Big Data Analytics IP Expo 2013
 
Cost Optimization at Scale
Cost Optimization at ScaleCost Optimization at Scale
Cost Optimization at Scale
 
Scmp aws digitalmedia_2013
Scmp aws digitalmedia_2013Scmp aws digitalmedia_2013
Scmp aws digitalmedia_2013
 
AWS Summit Sydney 2014 | Running your First Application on AWS
AWS Summit Sydney 2014 | Running your First Application on AWSAWS Summit Sydney 2014 | Running your First Application on AWS
AWS Summit Sydney 2014 | Running your First Application on AWS
 

Similar to AWS Storage Tiers for Enterprise Workloads - Best Practices (STG301) | AWS re:Invent 2013

AWS Storage Tiering for Enterprise Workloads
AWS Storage Tiering for Enterprise WorkloadsAWS Storage Tiering for Enterprise Workloads
AWS Storage Tiering for Enterprise WorkloadsTom Laszewski
 
Storage tiering for Oracle Database on AWS and Oracle EBusiness Suite on AWS ...
Storage tiering for Oracle Database on AWS and Oracle EBusiness Suite on AWS ...Storage tiering for Oracle Database on AWS and Oracle EBusiness Suite on AWS ...
Storage tiering for Oracle Database on AWS and Oracle EBusiness Suite on AWS ...Tom Laszewski
 
Relational Database Services on AWS
Relational Database Services on AWSRelational Database Services on AWS
Relational Database Services on AWSAmazon Web Services
 
Understanding Elastic Block Store Availability and Performance
Understanding Elastic Block Store Availability and PerformanceUnderstanding Elastic Block Store Availability and Performance
Understanding Elastic Block Store Availability and PerformanceAmazon Web Services
 
How Netflix Tunes Amazon EC2 Instances for Performance - CMP325 - re:Invent 2017
How Netflix Tunes Amazon EC2 Instances for Performance - CMP325 - re:Invent 2017How Netflix Tunes Amazon EC2 Instances for Performance - CMP325 - re:Invent 2017
How Netflix Tunes Amazon EC2 Instances for Performance - CMP325 - re:Invent 2017Amazon Web Services
 
Backing Up Amazon EC2 with Amazon EBS Snapshots (CMP301-R1) - AWS re:Invent 2018
Backing Up Amazon EC2 with Amazon EBS Snapshots (CMP301-R1) - AWS re:Invent 2018Backing Up Amazon EC2 with Amazon EBS Snapshots (CMP301-R1) - AWS re:Invent 2018
Backing Up Amazon EC2 with Amazon EBS Snapshots (CMP301-R1) - AWS re:Invent 2018Amazon Web Services
 
What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018
What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018
What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018Amazon Web Services
 
Running Microsoft and Oracle Stacks on Elastic Block Store (STG303) | AWS re:...
Running Microsoft and Oracle Stacks on Elastic Block Store (STG303) | AWS re:...Running Microsoft and Oracle Stacks on Elastic Block Store (STG303) | AWS re:...
Running Microsoft and Oracle Stacks on Elastic Block Store (STG303) | AWS re:...Amazon Web Services
 
SRV310 Optimizing Relational Databases on AWS: Deep Dive on Amazon RDS
 SRV310 Optimizing Relational Databases on AWS: Deep Dive on Amazon RDS SRV310 Optimizing Relational Databases on AWS: Deep Dive on Amazon RDS
SRV310 Optimizing Relational Databases on AWS: Deep Dive on Amazon RDSAmazon Web Services
 
Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...
Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...
Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...Amazon Web Services
 
Amazon RDS: Deep Dive - SRV310 - Chicago AWS Summit
Amazon RDS: Deep Dive - SRV310 - Chicago AWS SummitAmazon RDS: Deep Dive - SRV310 - Chicago AWS Summit
Amazon RDS: Deep Dive - SRV310 - Chicago AWS SummitAmazon Web Services
 
Building a Strong Foundation with AWS Storage Services
Building a Strong Foundation with AWS Storage ServicesBuilding a Strong Foundation with AWS Storage Services
Building a Strong Foundation with AWS Storage ServicesAmazon Web Services
 
STG330_Case Study How Experian Leverages Amazon EC2, EBS, and S3 with Clouder...
STG330_Case Study How Experian Leverages Amazon EC2, EBS, and S3 with Clouder...STG330_Case Study How Experian Leverages Amazon EC2, EBS, and S3 with Clouder...
STG330_Case Study How Experian Leverages Amazon EC2, EBS, and S3 with Clouder...Amazon Web Services
 
Relational Database Services on AWS
Relational Database Services on AWSRelational Database Services on AWS
Relational Database Services on AWSAmazon Web Services
 
Relational Database Services on AWS
Relational Database Services on AWSRelational Database Services on AWS
Relational Database Services on AWSAmazon Web Services
 
Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013
Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013
Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013Amazon Web Services
 
10 tips to improve the performance of your AWS application
10 tips to improve the performance of your AWS application10 tips to improve the performance of your AWS application
10 tips to improve the performance of your AWS applicationAmazon Web Services
 

Similar to AWS Storage Tiers for Enterprise Workloads - Best Practices (STG301) | AWS re:Invent 2013 (20)

AWS Storage Tiering for Enterprise Workloads
AWS Storage Tiering for Enterprise WorkloadsAWS Storage Tiering for Enterprise Workloads
AWS Storage Tiering for Enterprise Workloads
 
Storage tiering for Oracle Database on AWS and Oracle EBusiness Suite on AWS ...
Storage tiering for Oracle Database on AWS and Oracle EBusiness Suite on AWS ...Storage tiering for Oracle Database on AWS and Oracle EBusiness Suite on AWS ...
Storage tiering for Oracle Database on AWS and Oracle EBusiness Suite on AWS ...
 
Relational Database Services on AWS
Relational Database Services on AWSRelational Database Services on AWS
Relational Database Services on AWS
 
Understanding Elastic Block Store Availability and Performance
Understanding Elastic Block Store Availability and PerformanceUnderstanding Elastic Block Store Availability and Performance
Understanding Elastic Block Store Availability and Performance
 
How Netflix Tunes Amazon EC2 Instances for Performance - CMP325 - re:Invent 2017
How Netflix Tunes Amazon EC2 Instances for Performance - CMP325 - re:Invent 2017How Netflix Tunes Amazon EC2 Instances for Performance - CMP325 - re:Invent 2017
How Netflix Tunes Amazon EC2 Instances for Performance - CMP325 - re:Invent 2017
 
Backing Up Amazon EC2 with Amazon EBS Snapshots (CMP301-R1) - AWS re:Invent 2018
Backing Up Amazon EC2 with Amazon EBS Snapshots (CMP301-R1) - AWS re:Invent 2018Backing Up Amazon EC2 with Amazon EBS Snapshots (CMP301-R1) - AWS re:Invent 2018
Backing Up Amazon EC2 with Amazon EBS Snapshots (CMP301-R1) - AWS re:Invent 2018
 
SQL Server on AWS
SQL Server on AWSSQL Server on AWS
SQL Server on AWS
 
Amazon RDS_Deep Dive - SRV310
Amazon RDS_Deep Dive - SRV310 Amazon RDS_Deep Dive - SRV310
Amazon RDS_Deep Dive - SRV310
 
What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018
What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018
What's New in Amazon Relational Database Service (DAT203) - AWS re:Invent 2018
 
Running Microsoft and Oracle Stacks on Elastic Block Store (STG303) | AWS re:...
Running Microsoft and Oracle Stacks on Elastic Block Store (STG303) | AWS re:...Running Microsoft and Oracle Stacks on Elastic Block Store (STG303) | AWS re:...
Running Microsoft and Oracle Stacks on Elastic Block Store (STG303) | AWS re:...
 
SRV310 Optimizing Relational Databases on AWS: Deep Dive on Amazon RDS
 SRV310 Optimizing Relational Databases on AWS: Deep Dive on Amazon RDS SRV310 Optimizing Relational Databases on AWS: Deep Dive on Amazon RDS
SRV310 Optimizing Relational Databases on AWS: Deep Dive on Amazon RDS
 
Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...
Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...
Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...
 
SQL Server on AWS
SQL Server on AWSSQL Server on AWS
SQL Server on AWS
 
Amazon RDS: Deep Dive - SRV310 - Chicago AWS Summit
Amazon RDS: Deep Dive - SRV310 - Chicago AWS SummitAmazon RDS: Deep Dive - SRV310 - Chicago AWS Summit
Amazon RDS: Deep Dive - SRV310 - Chicago AWS Summit
 
Building a Strong Foundation with AWS Storage Services
Building a Strong Foundation with AWS Storage ServicesBuilding a Strong Foundation with AWS Storage Services
Building a Strong Foundation with AWS Storage Services
 
STG330_Case Study How Experian Leverages Amazon EC2, EBS, and S3 with Clouder...
STG330_Case Study How Experian Leverages Amazon EC2, EBS, and S3 with Clouder...STG330_Case Study How Experian Leverages Amazon EC2, EBS, and S3 with Clouder...
STG330_Case Study How Experian Leverages Amazon EC2, EBS, and S3 with Clouder...
 
Relational Database Services on AWS
Relational Database Services on AWSRelational Database Services on AWS
Relational Database Services on AWS
 
Relational Database Services on AWS
Relational Database Services on AWSRelational Database Services on AWS
Relational Database Services on AWS
 
Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013
Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013
Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013
 
10 tips to improve the performance of your AWS application
10 tips to improve the performance of your AWS application10 tips to improve the performance of your AWS application
10 tips to improve the performance of your AWS application
 

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Recently uploaded

Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...Aggregage
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 

Recently uploaded (20)

Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
20230104 - machine vision
20230104 - machine vision20230104 - machine vision
20230104 - machine vision
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
201610817 - edge part1
201610817 - edge part1201610817 - edge part1
201610817 - edge part1
 

AWS Storage Tiers for Enterprise Workloads - Best Practices (STG301) | AWS re:Invent 2013

  • 1. STG301 - Amazon Web Services Storage Tiers Headline goes here Enterprise Workloads - Best Practices Sub headline goes here Tom Laszewski Solution Architect, AWS November 15, 2013 Thiru Sadagopan Cloud Services, Apps Associates © Copyright 2013. Apps Associates LLC. Chris Gattoni IT Director, RISO 1
  • 2. Agenda • • • • • AWS storage options Enterprise storage challenges AWS storage solutions – Best practices, performance A storage configuration for Oracle Database Case study - RISO © Copyright 2013. Apps Associates LLC. 2
  • 3. AWS Storage Options © Copyright 2013. Apps Associates LLC. 3
  • 4. Storage Services on AWS • AWS provides multiple storage options for enterprise workloads Traditional workloads Storage migration techniques Application-specific storage options • • • • • • • • • • • • • • Ephemeral storage Amazon Elastic Block Store Amazon Simple Storage Service (S3) Amazon Glacier Amazon Direct Connect Amazon Export/Import Amazon Storage Gateway 3rd party storage gateways Tsunami, BitTorrent, 3rd party solutions Amazon ElastiCache Amazon DynamoDB Amazon RDS Amazon Redshift Amazon CloudFront © Copyright 2013. Apps Associates LLC. 4
  • 5. Performance Is Critical • • • • What storage option has a transfer rate of 10s of MB/sec? What storage option has up to 32 MB/sec bursting to 40 MB/sec? 12 PIOPS volumes at 500 IOPS will saturate this type of instance This storage device has single-threaded performance that is limited to ~17MB/sec • What is the storage option that produces ~120,000 random read IOPS (4 KB blocks)? • A NoSQL database executing 4K random reads has performance of 3 MB/sec on this type of storage and ~200 to 260 MB/sec on this type of storage • Transfer ~3 TB a day using this storage option • What storage option produces ~100-145 MB/s read and write? © Copyright 2013. Apps Associates LLC. 5
  • 6. Enterprise Storage Challenges © Copyright 2013. Apps Associates LLC. 6
  • 7. Enterprise Storage Challenges Performance • Requires consistent performance, each application has unique requirements • Addressed by storage layers like SSD, SAN, NAS etc.. NAS, etc. Durability and availability Disk Backups, Tape Backups • Addressed by using RAID, disk backups, tape backups Cost Elasticity and scalability • Requires high CAPEX • Often addressed by over provisioning overprovisioning © Copyright 2013. Apps Associates LLC. 7
  • 8. Enterprise Storage on AWS Performance Durability and availability Cost Elasticity and scalability • • • Requires consistent performance, each application has unique requirements EBS optimized instances Provisioned IOPS, SSD, Addressed by storage layers like SSD, SAN, NAS etc.. • Built-in replication across AZs; snapshots can be replicated • Addressed by using RAID, Disk Backups, Tape Backups across regions • Requires highyou use, buy vs. build Pay for what CAPEX • Often addressed by over provisioning need Use as little or as much as you want or © Copyright 2013. Apps Associates LLC. 8
  • 9. Enterprise Use Cases – Storage Requirements Databases Application software File Server Archival storage (longterm backups) Latency (performance) Low Moderate Moderate Moderate Durability and Availability High High High – moderate High durability – Low Cost ($/GB) High Moderate Low Very low Elasticity and scalability High – predictable Low – stable High – spiky Medium – predictable © Copyright 2013. Apps Associates LLC. 9
  • 10. AWS Storage Solutions © Copyright 2013. Apps Associates LLC. 10
  • 11. Ephemeral Store – Best Practices • Use with caution • Not all instance types have instance store storage – Second-generation high-memory instances, micro instances • Use rsync to copy data from instance store volumes to EBS volumes as applicable to ensure protection • Initialize the volume before using for high-performance applications – dd if=/dev/zero of=/dev/sdb bs=1M • Add to AMIs explicitly if required, when creating images • Enable “termination protection” at instance level as an additional measure © Copyright 2013. Apps Associates LLC. 11
  • 12. Ephemeral Store – Anti-patterns • Persistent storage – use Amazon ELB/Amazon S3 instead • Database storage – use Amazon ELB/PIOPS – Amazon ELB volumes – With proper bootstrapping, ephemeral store can be used for temporary table spaces – cr2.8xlarge/ hi1.4xlarge provide SSD backed instance-store volumes, which may be used for temporary database storage using specific database features • Shared storage – use Amazon ELB/Amazon S3 instead • Snapshots— use Amazon ELB instead – Optionally rsync the contents of instance store volumes to Amazon ELB volumes, depending on the use case © Copyright 2013. Apps Associates LLC. 12
  • 13. Amazon EBS – Best Practices • Use striping for multiple volumes to increase IOPS – RAID 0 and RAID 1+0 RAID 0 ( Stripe ) RAID 1+0 ( Stripe and mirror ) Usage drivers I/O performance is more important than fault tolerance Fault tolerance is more important than I/O performance Advantages I/O is distributed across the volumes in a stripe, resulting in better performance Data is replicated and striped across volumes for better durability Disadvantages Overall performance of the stripe is limited to the worst-performing volume in the set Doubles the amount of I/O required from the instance to Amazon ELB Recoverability Amazon ELB snapshots are complex to manage, must depend on third-party backup methods Fault tolerant due to replication; however, Amazon ELB snapshots may be complex to manage and perform complete disk group recovery Cost Very little to no overhead; utilization ratio can be high Doubles storage cost. May also have impact on network performance at instance level during highvolume data transfers © Copyright 2013. Apps Associates LLC. 13
  • 14. Amazon EBS – Best Practices • Use Amazon EBS-optimized instance types – Uses an optimized configuration stack that provides additional dedicated capacity for Amazon EBS I/O – Provides the best performance for Amazon EBS volumes by minimizing contention between Amazon EBS I/O and other traffic – Delivers dedicated throughput to Amazon EBS, with options between 500 Mbps and 1000 Mbps – Costs an additional low, hourly fee for the dedicated capacity – Cannot be enabled for a running instance; requires start and stop of instance – Not available for all instance types – Not required for cluster instance types © Copyright 2013. Apps Associates LLC. 14
  • 15. Amazon EBS – Best Practices • Availability of Amazon EBS–optimized instance types Network performance EBS optimization Instance types Comments Very low / Low Not available m1.small, t1.micro Not recommended for I/O-intensive workloads; application scaleout is recommended. No m1.medium, c1.medium, m2.xlarge, Not recommended for I/O intensive workloads. Yes m1.large, m3.xlarge, m2.2xlarge Can provide up to 500 Mbps of dedicated Amazon EBS throughput. Can be used for moderate to high I/O workloads. High Yes m1.xlarge, m3.2xlarge, c1.xlarge, m2.4xlarge Can provide up to 1000 Mbps of dedicated Amazon EBS throughput. Can be used for high I/O workloads. 10 gigabit Not available cc2.8xlarge, cr1.8xlarge , hi1.4xlarge, hs1.8xlarge , cg1.4xlarge Amazon EBS optimization is not required, as these instances provide better network throughput and can deliver better I/O performance. Moderate © Copyright 2013. Apps Associates LLC. 15
  • 16. Provisioned IOPS – Best Practices • Provisioned IOPS volumes are designed to deliver within 10% of the provisioned IOPS performance 99.9% of the time – When attached to Amazon EBS–optimized instances – Enough I/O requests to maintain its optimal average queue length – The read and write operations have a block size of 16 KB or less • Prepare new PIOPS volumes by touching all blocks to ensure consistent performance • Avoid taking Amazon EBS snapshots (for both PIOPS and Standard EBS volumes) during peak load • Avoid throttling overall network pipe/Amazon EBS optimization by attaching too many PIOPS volumes © Copyright 2013. Apps Associates LLC. 16
  • 17. Amazon EBS – Performance • Queue length – Maintaining the optimal average queue length is crucial for delivering provisioned throughput – If the workload maintains an average queue length that is higher than your optimal value, then your per-request I/O latency will increase, and in this case you should provision more IOPS for your volume – Maintain average queue length of 1 for every 200 Provisioned IOPS and tune that value according to your application requirements – VolumeQueueLength Amazon CloudWatch metric can be used for each volume to identify potential performance issues © Copyright 2013. Apps Associates LLC. 17
  • 18. Amazon EBS - Performance • Amazon CloudWatch metrics to monitor for Amazon EBS volumes – – – – – – VolumeQueueLength VolumeIdleTime VolumeReadOps VolumeWriteOps VolumeThroughputPercentage (for PIOPS volumes) VolumeConsumedReadWriteOps (for PIOPS volumes) • VolumeWriteOps/VolumeReadOps needs to be monitored for standard Amazon EBS volumes to find potential need to convert them to PIOPS © Copyright 2013. Apps Associates LLC. 18
  • 19. Amazon EBS – Anti-patterns • EBS storage is not recommended for these use cases – Temporary storage • Must never use this for SWAP disks – Highly durable storage • Amazon EBS is designed to provide 99.5% – 99.9% annual durability. For better durability, use Amazon S3 – Static data or web content • Use Amazon S3 or Amazon CloudFront instead – Key-Value pair information • Use an AWS database service – Data that required very low access latency (like session data) • Use in-memory options such as Amazon ElastiCache or Amazon DynamoDB © Copyright 2013. Apps Associates LLC. 19
  • 20. Amazon S3 – Best Practices • Amazon S3 performance considerations – – – – Amazon S3 can support 100 requests per second without much tuning effort If higher performance is required, optimization is required For GET-intensive workloads, use Amazon CloudFront For a mix of request types, optimize the object keys for better performance • For enterprise workloads – To optimize backup processes • Use multiple backup threads – If Amazon S3 backup is performed from within a VPC, make sure that Amazon S3 can be accessed directly from a private subnet • Usage of NAT instance may become a bottleneck © Copyright 2013. Apps Associates LLC. 20
  • 21. Amazon S3 – Anti-patterns • Use cases where Amazon S3 is not recommended – File system • Even though it can emulate file system formats using keys, Amazon S3 is not recommended as an alternative to a file system. Using tools that can mount an Amazon S3 bucket as a file system may have severe performance/cost impacts – Structured data with query • Use Amazon Relational Database Service instead – Rapidly changing data • Use Amazon EBS volumes instead – Data that is rarely accessed • Use Amazon Glacier instead © Copyright 2013. Apps Associates LLC. 21
  • 22. AWS Storage Options Summary Storage option General Database Applications Speed Instance Store Swap Temporary files Reports cache, web server cache Very low latency Very low; volatile Amazon EBS – PIOPS Data files, redo logs Durability Low latency Moderate; needs to be backed up regularly Amazon EBS Boot volume Binaries, archive logs Binaries Moderate latency Moderate; needs to be backed up regularly Amazon S3 Backups Backups Backups Longer latency Very high durability Amazon Glacier Long-term backups Long-term backups Long-term backups Restore times of Very high durability 3–5 hr © Copyright 2013. Apps Associates LLC. 22
  • 23. A Storage Configuration for Oracle Database © Copyright 2013. Apps Associates LLC. 23
  • 24. Database I/O Patterns • Cache data in memory from disk to achieve fast query response • For OLTP/DSS workloads, memory should be big enough to hold as much as possible SGA Buffer Cache 100% cache hit ratio is ideal for OLTP workloads © Copyright 2013. Apps Associates LLC. 24
  • 25. Database I/O Patterns • CPU time is consumed mainly by I/O wait Disk I/O Time CPU Time Select Update Cache miss Select Update Cache hit © Copyright 2013. Apps Associates LLC. 25
  • 26. Database Cache Has Limits 1. Data size is increasing... 1. Huge amounts of data 2. Not possible to cache all data SGA 2. User volume is increasing... Buffer Cache 3. Many I/O operations Source: oracle corporation © Copyright 2013. Apps Associates LLC. 26
  • 27. Impact of I/O on CPU Response Times I/O bottleneck Low throughput and slow response Low CPU usage 700 16.00 14.00 600 12.00 TPS 500 RES 10.00 400 8.00 300 6.00 200 4.00 100 2.00 0 Response Time(Normal100Thread=>1.00) TPS(Normal-100Thread=>100) 800 0.00 Thread 100 200 300 400 500 600 700 800 Source: oracle corporation © Copyright 2013. Apps Associates LLC. 27
  • 28. Storage Best Practices for Oracle • Oracle Automatic Storage Management feature is recommended option to optimize storage performance on AWS • SAME (Stripe and Mirror Everything) feature of Oracle ASM will help distributing entire data across multiple Amazon EBS volumes • ASM along with PIOPS Amazon EBS volumes can provide robust storage performance on AWS • Oracle Secure Backup for Cloud Module will enable backups directly from Oracle Database/ASM to Amazon S3 using RMAN • RMAN channels can be optimized for optimal system throughput and storage performance © Copyright 2013. Apps Associates LLC. 28
  • 29. Typical Storage Configuration for Oracle Storage Type Comments Binaries Amazon EBS volume Standard volume; Amazon EBS snapshots enabled Data files PIOPS – Amazon EBS volumes Striped across multiple volumes using ASM or any other technology PIOPS of 1000 or above Redo log files PIOPS – Amazon EBS volumes Use separate Amazon EBS Volumes for each group; preferable to use ASM disk groups Archive log files Amazon EBS volumes Standard volumes for normal database workloads; PIOPS for highly transactional environments Backup files Amazon EBS volumes / Amazon S3 Standard Amazon EBS volumes for local backups; use OSB/other technology to push to Amazon S3 © Copyright 2013. Apps Associates LLC. 29
  • 30. Storage Options for Oracle • Sample disk layout for Oracle database using ASM DEV PROD +PROD_DATA Striping +PROD_FRA Striping 4 EBS Volumes 4 EBS Volumes 1000 PIOPS 4000 PIOPS ASM instance with 16,000+ IOPS TEST +DEV_DATA S3 Bucket Lifecycle policies Striping 4 EBS Volumes 500 PIOPS Amazon Glacier © Copyright 2013. Apps Associates LLC. 30
  • 31. Database Backup Best practices PROD +PROD_DATA +PROD_FRA Striping 4 EBS Volumes 1000 PIOPS /backupfs OSB cloud module using RMAN EBS snapshot S3 Bucket Striping 4 EBS Volumes 4000 PIOPS RMAN local backup © Copyright 2013. Apps Associates LLC. 31
  • 32. SSD Storage with Oracle • AWS provides 2 instances types with SSD storage – cr1.8xlarge – 240 GB of SSD – hi1.4xlarge – 2048 GB of SSD • This SSD storage is ‘ephemeral’ and CANNOT be used for data files • However, this SSD can be leveraged by using “Oracle Flash Cache” – Available at no additional cost, Database Smart Flash Cache on Oracle Solaris and Oracle Enterprise Linux • Oracle Flash Cache simply extends the buffer cache to leverage SSD • Recommended use case for environments with huge working datasets – ETL processes for data warehouses – Reporting work load © Copyright 2013. Apps Associates LLC. 32
  • 33. Case Study - RISO Chris Gattoni, IT Director © Copyright 2013. Apps Associates LLC. 33
  • 34. About RISO, Inc. Who RISO Is Mission RISO means “ideal.” RISO strives to create fundamentally unique new technologies in paper-based communication. Every product we manufacture offers the ideal solution to our customers. At the same time, RISO carries on a tradition of caring for the world at large through our environmental and community support programs. Just as we are committed to delivering the ideal products and service, we strive to be an ideal corporate citizen in every country in which we conduct business. Company Overview RISO, Inc. is a world leader in digital printing solutions, with award winning printing technologies that are at the forefront of the printing equipment industry. RISO printers help improve productivity, increase versatility, and reduce costs.
  • 35. About RISO, Inc. What RISO Does RISO sells high speed inkjet printers and digital duplicators. They're low-cost, durable, & reliable production printers. RISO strives to create fundamentally unique new technologies in paper-based communication through an approach that emphasizes productivity, cost containment, and versatility. Every product we manufacture delivers these benefits in a balance that offers the ideal solution to our customers. Speed up your color communications!
  • 36. Key Business Drivers • Key challenges – – – – End-of-life hardware CAPEX vs. OPEX Upcoming datacenter migration IT not spending enough time on core functions • AWS solution – – – – Migrate from existing hardware to Amazon EC2 platform Lower TCO No datacenter to maintain , resulting in more flexibility for infrastructure team Scalable and elastic platform © Copyright 2013. Apps Associates LLC. 36
  • 37. On-Premises Environment • Infrastructure spread across multiple locations – Connectivity required from multiple locations – Multiple servers, SAN Storage, network equipment – Printers, tape libraries, file servers • Applications include – – – – – Oracle ERP Oracle Business Intelligence LACROSSE applications on Microsoft SQL Server Domain controllers, PING identity, monitoring servers Ticketing Systems © Copyright 2013. Apps Associates LLC. 37
  • 38. Target AWS Environment • Virtual Private Cloud with multiple VPN tunnels for redundancy – Separate VPN tunnels to each remote location – Access restricted only via VPN tunnel for better security • EC2 servers with Amazon EBS storage – Amazon EBS – PIOPS for database storage • Tape library replaced with Amazon S3 • DR setup for core infrastructure components like domain controller • DR build for enterprise applications in separate region © Copyright 2013. Apps Associates LLC. 38
  • 39. Storage Options on AWS • Leveraged all storage options to ensure optimal performance in AWS – – – – Ephemeral – Swap space/Temp storage Amazon EBS volumes – OS boot volumes / Software binaries / Application storage Amazon EBS - PIOPS Volumes – Oracle data files, redo logs on striped volumes Amazon S3 (RRS) – For storing non-production backups using third-party backup appliance – Amazon S3 – For storing production backups – Amazon Glacier – Long-term archival of backups – AWS Export/Import – To transfer 2+ TB data to Amazon Glacier using USB disks © Copyright 2013. Apps Associates LLC. 39
  • 40. Key Challenges • 32-bit vs. 64-bit instance types – – – – – AWS provides limited options to run 32-bit applications Legacy applications were not certified to run on 64-bit instances Upgrade to latest versions was not feasible 32-bit instance types were unable to provide enough throughput Network performance/Amazon EBS performance was insufficient to meet user load • Solution: Amazon EBS PIOPS with scale out – Implemented multiple Amazon EBS PIOPS volumes with Amazon EBS optimization for better I/O – Scaled out application middle tier to use multiple servers for better throughput – Used custom-built AMIs to run legacy applications to avoid AWS dependency © Copyright 2013. Apps Associates LLC. 40
  • 41. Key Takeaways • • • • AWS provides multiple storage options for enterprise workloads No single option fits all workloads Proper planning and validation of I/O performance is the key for success Phased approach for AWS migration – – – – Start with a POC Migrate test/dev environments Build DR in cloud Migrate production workloads • Continuous monitoring of key performance metrics is crucial for success © Copyright 2013. Apps Associates LLC. 41
  • 42. Resources • AWS Architecture Center http://aws.amazon.com/architecture/ • Storage Options in the AWS Cloud http://media.amazonwebservices.com/AWS_Storage_Options.pdf • AWS: Overview of Security Process http://media.amazonwebservices.com/pdf/AWS_Security_Whitepaper.pdf • Roadmap to Moving Your Applications to the Cloud http:// www.appsassociates.com/white-papers/moving-applications-to-cloud • AWS Test Drive Labs – Try your application in the Cloud http://www.appsassociates.com/awslabs/ © Copyright 2013. Apps Associates LLC. 42
  • 43. Connect With Us • Web: www.appsassociates.com • Email: Thiru.Sadagopan@appsassociates.com tomlasz@amazon.com cgattoni@riso.com • YouTube: www.youtube.com/user/AppsAssociates • LinkedIn: www.us.linkedin.com/company/apps-associates • Twitter: @AppsAssociates • Facebook: www.facebook.com/AppsAssociatesGlobal © Copyright 2013. Apps Associates LLC. 43