Serverless File Transfer Workload – Part 3 – CSV-To-DynamoDB

Introduction The last piece of our overall solution is the processing of a CSV file into a data store. Design We will use Amazon DynamoDB as our data store and AWS Lambda to perform the CSV processing. This design was influenced by the AWS blog post at Implementing bulk CSV ingestion to Amazon DynamoDB |Continue reading “Serverless File Transfer Workload – Part 3 – CSV-To-DynamoDB”

Serverless File Transfer Workload – Part 2 – AntiVirus

Introduction We require uploaded files to be scanned for viruses before they can be processed further. Design Our design for this solution can be represented in the following diagram. There is a lot in this so let’s describe all that is happening here. We use ClamAV to perform the anti-virus scans. ClamAV definitions are storedContinue reading “Serverless File Transfer Workload – Part 2 – AntiVirus”

Serverless File Transfer Workload – Part 1 – SFTP

Introduction Suppose a file transfer workload exists between a business and their customers. A comma-separated values (CSV) file is transferred to the business and the records are loaded into a database. The business has regulatory requirements mandating that all external assets are virus scanned before being processed. Additionally, an intrusion prevention system (IPS) must operateContinue reading “Serverless File Transfer Workload – Part 1 – SFTP”

Automated UI Testing With AWS Machine Learning

This article will be a little bit different to previous posts. Having only just recently started to check out AWS Machine Learning I am still in the early stages of my study of these services. So for this article, I wanted to post what I have learned so far in the form of a possibleContinue reading “Automated UI Testing With AWS Machine Learning”

AWS Fargate Application Configuration With S3 Environment Files

A recent AWS Fargate feature update has added support for S3 hosted environment files. In this article I will show how you could use this to manage your application’s configuration. I will also demonstrate how changes to the configuration can be released in a blue-green deployment. Design The solution we will build will follow theContinue reading “AWS Fargate Application Configuration With S3 Environment Files”

AWS CodeBuild Local

In this article I will show how you can run your AWS CodeBuild projects locally. AWS CodeBuild is a “fully managed continuous integration service that compiles source code, runs tests, and produces software packages that are ready to deploy”. By running your CodeBuild projects locally you can test code changes before committing, allowing you toContinue reading “AWS CodeBuild Local”

Amazon RDS Proxy – Improved Application Security, Resilience and Scalability

Amazon RDS Proxy is a fully managed, highly available database proxy for Amazon Relational Database Service (RDS) that makes applications more scalable, more resilient to database failures, and more secure. https://aws.amazon.com/rds/proxy/ In this article I will demonstrate how you can configure an Amazon RDS Proxy for an Amazon Aurora database. With the provided Terraform code,Continue reading “Amazon RDS Proxy – Improved Application Security, Resilience and Scalability”

Configure a Desktop Environment For an Amazon Linux EC2 Jumpbox

In this article I will show how you can launch an Amazon Linux EC2 instance with a desktop environment that will serve as a jumpbox. Connections to this jumpbox will be made through RDP via a session manager port tunneling session. By using session manager, our EC2 instance’s security group does not require ingress rulesContinue reading “Configure a Desktop Environment For an Amazon Linux EC2 Jumpbox”

Access Private EC2 Instances With AWS Systems Manager Session Manager

In this article I will demonstrate how you can connect to EC2 instances located in private subnets by using AWS Systems Manager Session Manager. Session Manager is a fully managed AWS Systems Manager capability that lets you manage your EC2 instances, on-premises instances, and virtual machines (VMs) through an interactive one-click browser-based shell or throughContinue reading “Access Private EC2 Instances With AWS Systems Manager Session Manager”

Amazon Elastic File System (EFS) Integration With AWS Lambda

AWS has recently announced support for Amazon Elastic File System (EFS) within AWS Lambda. This change creates new possibilities for serverless applications. In this article I will demonstrate one such possibility — centralising the storage and updating of the ClamAV virus database. ClamAV ClamAV® is an open source antivirus engine for detecting trojans, viruses, malwareContinue reading “Amazon Elastic File System (EFS) Integration With AWS Lambda”