In this session, you learn about the use cases for Network File Systems (NFS) and Common Internet File Systems (CIFS), and when NFS and CIFS are appropriate on AWS. We cover the use cases for ephemeral, Amazon EBS, Amazon EBS P-IOPS, and Amazon S3 as the persistent stores for NFS and CIFS shares. We share AWS CloudFormation templates that build multiple solutions—a single instance with Amazon EBS, clustered instances with Amazon EBS, and Gluster cluster—as well as introduce AWS partner solutions.
2. What are NFS and CIFS?
• Protocols used to implement shared access to
files
• Different from block and object storage
• Current versions –
– NFS v4
– SMB v3
3. Do I really need a POSIX file system?
• Legacy applications
• Shared/clustered databases
• Multi-instance read and write access to the
same data set
4. Important considerations
• Availability
–
–
Single AZ = no durability commitments
Dual AZ = 99.95% available
• Durability
–
Backing store
• Performance
–
–
–
Network interface
EBS interface
EBS performance
• Consistency
–
Pay attention to replication types
5. Backing stores
• EBS
– between 0.1% – 0.5% AFR per volume
• Ephemeral
– hs1.8xlarge
• 48 terabytes of storage across 24 hard disk drives
– i2.8xlarge
• ~5.7 terabytes of storage across 8 SSDs
• S3
– designed for 99.999999999% durability
10. Ephemeral backed instance with DRBD to EBS
NFS
SAMBA
This is asynchronous replication
DRBD
protocol A
replication
MDADM
RAID 0
array
Monitoring the latency of this
replication is critical!
Snapshot the EBS array
MDADM
RAID 0
array
# cat /proc/drbd
#look for ‘oos’
11. Ephemeral backed instance with DRBD to EBS
global {
usage-count yes;
}
common {
net {
protocol A;
}
}
# /etc/drbd.d/global_common.conf
12. Ephemeral backed instance with DRBD to EBS
resource r0 {
on az-a{
device
/dev/drbd0;
disk
/dev/md0;
address
10.1.1.1:7789;
meta-disk internal;
}
on az-a{
device
/dev/drbd1;
disk
/dev/md1;
address
10.1.1.1:7789;
meta-disk internal;
}
}
#/etc/drbd.d/r0.res
22. Red Hat Storage
• A supported version of Gluster
• Try it now
– https://testdrive.redhat.com/
23. Elastic File System for the Cloud
•
•
•
•
•
Strongly consistent cross-OS distributed file system
Migrate unmodified applications to AWS
Multi-AZ HA and cross-region DR
Inline deduplication and end-to-end security
Clients access S3 directly for scale and performance
• TestDrive now at testdrive.maginatics.com
23
24. •
•
•
•
Multi-AZ redundant
Exports NFS, CIFS and iSCSI
Supports ZFS to tier between ephemeral and EBS
Supports S3 as a backing store
• Available now in AWS Marketplace
26. Virtual Private Storage Array (VPSA™) Service
•
•
•
•
•
•
•
Private Storage-as-a-Service for AWS customers
Billed hourly, with no AMIs needed
Low-latency (1~2ms) attach to AWS instances
Global footprint: US East/West, Europe, Japan
File (NFS and CIFS) and Block (iSCSI)
Ridiculously high QoS
True HA (no single point of failure, 100% SLA)
27. Zadara via AWS Direct Connect
Availability Zone X
Availability Zone Y
Availability Zone X
AWS Region A
AWS Region N
AWS
Direct
Connect
AWS
Direct
Connect
San Jose
& N. Va.
Availability Zone Y
Tokyo
Secure remote replication
Dublin
Zadara Cloud A
L.A.*
*coming soon
Zadara Cloud N
30. Why Zadara VPSA?
High random write performance
Write cache assisted
Data-at-Rest Encryption
Zero-capacity instant cloning, e.g. for test/dev
100s of volumes
31. Business Continuity & Disaster Recovery
Protect
• Low-impact snapshots, available immediately
• Snapshot based, latency-tolerant Remote
Replication for multi-region Disaster Recovery
Recover
• Instant, zero-capacity cloning of snapshots
• RPO: 5 minutes
32. iG
• The largest Internet
portal in Brazil
• 5 TB NFS Volumes
shared by 170
instances connected
to a single VPSA