Serverless File Transfer Workload – Part 3 – CSV-To-DynamoDB

Introduction The last piece of our overall solution is the processing of a CSV file into a data store. Design We will use Amazon DynamoDB as our data store and AWS Lambda to perform the CSV processing. This design was influenced by the AWS blog post at Implementing bulk CSV ingestion to Amazon DynamoDB |Continue reading “Serverless File Transfer Workload – Part 3 – CSV-To-DynamoDB”

Serverless File Transfer Workload – Part 2 – AntiVirus

Introduction We require uploaded files to be scanned for viruses before they can be processed further. Design Our design for this solution can be represented in the following diagram. There is a lot in this so let’s describe all that is happening here. We use ClamAV to perform the anti-virus scans. ClamAV definitions are storedContinue reading “Serverless File Transfer Workload – Part 2 – AntiVirus”

Serverless File Transfer Workload – Part 1 – SFTP

Introduction Suppose a file transfer workload exists between a business and their customers. A comma-separated values (CSV) file is transferred to the business and the records are loaded into a database. The business has regulatory requirements mandating that all external assets are virus scanned before being processed. Additionally, an intrusion prevention system (IPS) must operateContinue reading “Serverless File Transfer Workload – Part 1 – SFTP”

Automated UI Testing With AWS Machine Learning

This article will be a little bit different to previous posts. Having only just recently started to check out AWS Machine Learning I am still in the early stages of my study of these services. So for this article, I wanted to post what I have learned so far in the form of a possibleContinue reading “Automated UI Testing With AWS Machine Learning”

AWS Fargate Application Configuration With S3 Environment Files

A recent AWS Fargate feature update has added support for S3 hosted environment files. In this article I will show how you could use this to manage your application’s configuration. I will also demonstrate how changes to the configuration can be released in a blue-green deployment. Design The solution we will build will follow theContinue reading “AWS Fargate Application Configuration With S3 Environment Files”