At AWS re:Invent, Amazon Web Services (AWS), has announced two new capabilities to help customers ‘more quickly and cost-effectively’ transfer data of all types and sizes to the AWS Cloud. AWS Snowball is a petabyte-scale data transport appliance, while Amazon Kinesis Firehose is a fully managed service for loading streaming data into AWS cloud.
While AWS Direct Connect provides customers with a dedicated, fast connection to the AWS network, AWS Snowball and Amazon Kinesis Firehose would be ideal for customers that need to transfer data in large batches, have data located in distributed locations, or require continuous loading of streaming data. With AWS Snowball and Amazon Kinesis Firehose, AWS customers now have two new ways to ‘more easily and cost-effectively’ get large data sets and streaming data into the AWS Cloud.
“It has never been easier or more cost-effective for companies to collect, store, analyze, and share data than it is today with the AWS Cloud,” said Bill Vass, Vice President, AWS Storage Services. “As customers have realized that their data contains key insights that can lead to competitive advantage, they’re looking to get as much data into AWS as quickly as possible. AWS Snowball and Amazon Kinesis Firehose give customers two more important tools to get their data into AWS.”
Customers who need to transfer large amounts of data to AWS usually face a challenge. Now, AWS provides a solution to this problem with AWS Snowball – a ‘durable and tamper-resistant, encrypted, and portable’ storage appliance that customers can use to move large amounts of data to AWS Cloud – ‘fast and cost-efficient.’
Customers create a job using the AWS Management Console, AWS ships the appliance directly to the customer, and the customer, upon receiving the appliance, simply plugs it into their local network. AWS Snowball would provide a simple data transfer client which customers use to encrypt and transfer 50TB of data to each appliance. Customers can use multiple AWS Snowball appliances in parallel to transfer larger data sets within the same time frame.
Once a customer’s data is completely loaded onto an AWS Snowball, its E Ink shipping label is automatically updated with the AWS shipping address, and customers can track the status of the transfer job using Amazon Simple Notification Service (SNS), text messages, or the AWS Management Console.
Amazon Kinesis Streams
In 2013, AWS introduced Amazon Kinesis Streams to allow customers to build applications that collect, process, and analyze this streaming data with very high throughput. Customers are using Amazon Kinesis Streams to capture streaming data and load it into Amazon S3 or Amazon Redshift. Until now, this required customers to manage the Amazon Kinesis data streams and write custom code to load the data. Now, Amazon Kinesis Firehose would make this as easy as an API call. Amazon Kinesis Firehose captures data from hundreds of thousands of different sources and loads it directly into AWS, in real-time.
AWS Snowball and Amazon Kinesis Firehose are both available today. Customers can request an AWS Snowball appliance by visiting aws.amazon.com/importexport/request-access. Customers can access Amazon Kinesis Firehose using the AWS Management Console, AWS Command Line Interface (CLI), or AWS SDKs. Amazon Kinesis Firehose is initially available in the US East (N. Virginia), US West (Oregon), and EU (Ireland) Regions, and will expand to additional regions in the coming months.