Serverless File Transfer Workload – Part 3 – CSV-To-DynamoDB

Introduction The last piece of our overall solution is the processing of a CSV file into a data store. Design We will use Amazon DynamoDB as our data store and AWS Lambda to perform the CSV processing. This design was influenced by the AWS blog post at Implementing bulk CSV ingestion to Amazon DynamoDB |Continue reading “Serverless File Transfer Workload – Part 3 – CSV-To-DynamoDB”

Serverless File Transfer Workload – Part 2 – AntiVirus

Introduction We require uploaded files to be scanned for viruses before they can be processed further. Design Our design for this solution can be represented in the following diagram. There is a lot in this so let’s describe all that is happening here. We use ClamAV to perform the anti-virus scans. ClamAV definitions are storedContinue reading “Serverless File Transfer Workload – Part 2 – AntiVirus”

Serverless File Transfer Workload – Part 1 – SFTP

Introduction Suppose a file transfer workload exists between a business and their customers. A comma-separated values (CSV) file is transferred to the business and the records are loaded into a database. The business has regulatory requirements mandating that all external assets are virus scanned before being processed. Additionally, an intrusion prevention system (IPS) must operateContinue reading “Serverless File Transfer Workload – Part 1 – SFTP”