Learn more about This Is My Architecture at http://amzn.to/2lbOaCY.
Bryan Coon, Head of Enterprise Services at Human Longevity Inc., explains how they process up to 12TB per day of raw data in Amazon S3 with custom analytics tools running in Docker containers. HLI has automated the deployment of reusable pipelines of containerized tasks with Amazon SWF, the Ruby Flow framework, AWS OpsWorks, Amazon SQS and AWS Lambda. They also keep costs low by leveraging Amazon EC2 Spot Fleet to power their Amazon ECS clusters.
Publisher: Amazon Web Services
You can watch this video also at the source.