Migrating Data with AWS Snow Family
Snowcone, Snowball Edge, Snowmobile
Its a sack of hard drives that amazon ships to you. Some have built in computing. Ship the data physically to AWS.
Snowcone – 8TB of storage, 4 GB of memory, 2 vCPUs. Easily migrate data to AWS after you’ve processed it. IoT sensor integration, perfect for edge computing requirements where power and space are constrained.
Snowball Edge – Between 48 TB and 81 TB of storage. Storage, Compute, and GPU flavors. Varying amount of CPU and RAM. Perfect for off-the-grid computing or a migration to AWS. Perfect for a boat or a 1-time migration.
Snowmobile – 100 PB of storage. Designed for exabyte-scale data center migrations. Designed for exabyte-scale data center migration. You probably don’t need this.
If the data needs to be encrypted at rest and in transit – Snowball enclosure. Use cases – know the general use cases for each Snow Family member.
Snow family works both ways – can also leave the cloud. Timing – about a week.
Storage Gateway, File Gateway, Volume Gateway, Tape Gateway
Storage Gateway is a hybrid cloud storage service that helps you merge on-premises resources with the cloud. IT can help with a one-time migration or a long-term pairing of your architecture with AWS.
File Gateway – Network Fileshare. Mount the fileshare locally, and it backs up the data to S3. Can either back up all of your data to the cloud, or you can keep a cache copy of the most recently used files. Could keep latest copies of data on prem, and move the rest of the files to S3. Set up a cached copy – extend on prem storage to S3. Helps with migrations to AWS.
All storage gateway VMs are run on premises.
Volume Gateway – iSCSI mount that backs up VMs on premises to S3, can create EBS snapshots from S3. Great for backing up content, and can help bridge.
Tape Gateway – skip having to physically deal with tapes. Replace physical tapes, by having S3 Glacier or Glacier Deep Archive. Don’t have to change settings or backup workflows. Tricks those backup services to think they’re backing up to a tape.
Use Cases – know the general use cases for each Storage Gateway. Out of space on premises? Which storage gateway solution solves this issue (File Gateway).
What is Datasync? What does it look like to actually use? Its an agent-based solution for migrating on-premises storage to AWS. Allows you to use NFS and SMB shares to AWS storage solutions. Designed for a one-time migration. DataSync is encrypted using TLS. Do you want data in an S3, EFS, or Amazon FSx for windows file server? If you want a more continuous migration, think Storage Gateway.
AWS Transfer Family
Allows you to easily move files out of S3 and EFS, using SFTP, FTPS, or FTP. Allows you to keep the same endpoints for the SFTP/FTPS family outside of the AWS environment, and only supports FTP internally inside your VPC.
Legacy Users <—> AWS Transfer for SFTP, AWS Transfer for FTPS <—> Amazon S3 (transferred files are stored as objects) / Amazon EFS (transferred files are stored natively)
DNS Entry stays the same, but the location for the storage becomes S3.
Moving to the Cloud with Migration Hub
Server migration service / database migration service. AWS Migration hub is a single pane of glass that allows you to track the progress of your application migration to AWS. It integrates with Server Migration Service and Database Migration Service (SMS and DMS). Allows you to migrate from VMWare to an EBS volume into an AMI.
DMS – allows you to migrate an oracle database or SQL server databases and migrate them using AWS Schema Conversion tool to Amazon Aurora.
Migration Exam Tips
Where are we going? What does the architecture look like? How do we get there? Do we want to do it all at once (simpler, but downtime probable)? Is it a partial migration?
Snowball choices are often based on how much data you are moving. It’s good to know snowballs are perfect for moving many terabytes of data.
Snowcone and Snowmobile won’t be on the exam as much as Snowball, so it’s enough to just know a general overview.
When to we use Snowball – in situations where we have slow internet or it must be secure. It will be faster and more secure in these situations.
Exam tips for Storage Gateway
- Hybrid – which storage gateway could complement this
- out of space? File gateway to the rescue
- Storage Gateway – its a VM. Its run locally as a VM on premises
Data Sync is an agent-based solution that excels at one-time migrations of fileshares into AWS. Smaller use case. EFS and FSx are both viable locations for DataSync to transfer content into.
Transfer Family allows you to use legacy file transfer protocols to give older applications the ability to read and write from S3.
Migrational Hub is an organizational tool that gives you a way to organize all your steps. You’ll need other tools to complete the migration though. Database Migration service – is your go to tool for any sort of database migration. It works for on-premises to cloud, or moving data between different RDS databases. Do you have VMs? Server Migration Service is the tool you’ll want to use to migrate out of the data center and into AWS.