Skip to content

AWS Migration and Automation

Delivering a scalable, secure, and fully automated cloud environment to improve deployment efficiency, enhance security, and streamline infrastructure management. By leveraging AWS-native solutions, infrastructure as code, and CI/CD automation, we ensured a high-performance cloud ecosystem, reducing operational overhead, improving system reliability, and enabling continuous delivery.

AWS Migration and Automation

Client Overview

Merciv, Inc. is an AI and data analytics company that transforms strategic business intelligence workflows for the retail industry and consumer packaged goods (CPG) brands. At the core of their offering is the Evolving Virtual Analyst (EVA), an AI-driven platform that breaks down data silos by ingesting and unifying information from multiple sources. EVA enables users to simply ask business questions in plain language and receive data-driven answers with intelligent visualisations, empowering them to optimise workflows and discover new growth opportunities. Understanding their clients' need for the highest levels of reliability, Merciv maintains a comprehensive security program with detailed policies that protect both company and customer data. Merciv's robust security framework includes least-privilege access management with MFA, stringent change management and vulnerability remediation, and secure development practices integrated throughout the product lifecycle. Through Merciv's solutions, customer organisations can extract maximum value from their data and scale their operations like never before.

merciv_logo

Challenge

The client operated its infrastructure on Railway PaaS but required a migration to AWS to improve scalability, security, and deployment automation while maintaining system stability. The key challenges included:

Architectural Decisions on AWS

Designed a robust cloud infrastructure to ensure high availability, security, and scalability while optimising resource utilisation and maintainability for long-term operational efficiency.

Infrastructure Migration to AWS

Ensured a seamless migration of services, including databases, while transitioning CDN from Cloudflare to CloudFront for improved performance and lower latency. Additionally, consolidated DNS records into Route 53 for more efficient domain management.

CI/CD & Deployment Optimisation

Implemented an automated CI/CD pipeline to accelerate deployments, reduce manual effort, and improve overall development efficiency.

Monitoring and Observability

Integrated real-time monitoring and alerting to track performance, detect issues proactively, and maintain system stability.

Solution

To facilitate a seamless migration and build a scalable, secure, and efficient AWS infrastructure, we implemented the following solutions:

1) Infrastructure as Code with Terragrunt

Provisioned AWS resources using Terragrunt, ensuring modular, maintainable, and consistent infrastructure across multiple environments.

2) Compute and Application Hosting

Containerised and deployed the full application stack, comprising one frontend and four backend services, on Amazon EKS. Utilised EC2 instances as Kubernetes nodes to optimise resource allocation and workload management. Integrated Karpenter for automated node provisioning, enabling dynamic scaling and lifecycle management based on workload demands, improving resource efficiency and reducing operational costs.

3) AWS Managed Services for Security and Scalability

Networking and Security Enhancements

- Configured VPC, subnets, and NAT to establish a scalable and secure network architecture.
- Created a dedicated network account and implemented AWS Client VPN for secure remote access to internal resources.

Load Balancing and Logging

- Deployed Application Load Balancer (ALB) to distribute traffic efficiently across services.
- Enabled ALB access logging on Amazon S3, improving monitoring and traffic analysis.

Database and Storage Solutions

- Implemented Amazon RDS (PostgreSQL) to provide a scalable, reliable, and managed database service.
- Utilised Amazon S3 for storing image content, including PDFs and syntax files, ensuring cost-efficient storage and accessibility.

Messaging and Event-Driven Architecture

- Integrated Amazon MQ (RabbitMQ) to handle asynchronous messaging between backend services, ensuring efficient communication across microservices.

Secure Secrets Management

- Utilised AWS Secrets Manager to securely store and manage application configurations, credentials, and other sensitive information.

4) CI/CD Pipeline for Automated Deployments

- Implemented GitHub Actions for continuous integration (CI), automating build processes.
- Used Flux CD for GitOps-based continuous deployment (CD), enabling automated releases to EKS.

5) Monitoring and Observability

- Integrated New Relic for comprehensive application performance monitoring.
- Utilised CloudWatch for log analysis and real-time infrastructure observability.

Results

The AWS migration significantly improved the client’s infrastructure efficiency, security, and deployment automation.
054-timer

Enhanced System Reliability

Migration to AWS provided a more flexible and scalable infrastructure, supporting future growth.

001-cyber security

Improved Security

VPN access, IAM policies, and AWS Secrets Manager ensured a secure cloud environment.

017-deployment-1

Streamlined Deployments

Automated CI/CD pipelines reduced manual processes and increased deployment efficiency.

010-monitor

Optimised Monitoring

New Relic and CloudWatch enabled proactive monitoring, reducing downtime and improving system stability.

Technology Stack

 

To successfully enhance system scalability, security, and automation, the following technologies were utilised:

  • Cloud Computing: Amazon VPC, AWS Transit Gateway, IAM, EKS, EC2, ECR, Secrets Manager, RDS (PostgreSQL), MQ (RabbitMQ), Client VPN, CloudFront, S3
  • Infrastructure as Code: Terraform/Terragrunt
  • CI/CD: GitHub Actions (CI), Flux CD (CD)
  • Monitoring and Alerts: New Relic, CloudWatch

By leveraging this robust technology stack, the client achieved a resilient, scalable, and fully automated cloud environment, ensuring improved performance, security, and operational efficiency.

case study-new relic