Code360 powered by Coding Ninjas X Naukri.com. Code360 powered by Coding Ninjas X Naukri.com
Table of contents
1.
Introduction
2.
Working of AWS Data Migration Service work
3.
High-Level View of AWS DMS
4.
Components of AWS DMS
4.1.
Replication Instance
4.2.
Endpoints
4.3.
Replication Tasks
5.
Source for AWS DMS
6.
Targets for AWS DMS
7.
Security in AWS Data Migration Service
8.
Frequently Asked Questions
8.1.
What does AWS DMS stand for?
8.2.
What is AWS DMS?
8.3.
What are endpoints?
8.4.
What are the components of AWS Data Migration Service?
8.5.
List some third-party database services.
9.
Conclusion
Last Updated: Mar 27, 2024
Easy

AWS Data Migration Service

Author Ankit Kumar
0 upvote
Master Python: Predicting weather forecasts
Speaker
Ashwin Goyal
Product Manager @

Introduction

AWS Database Migration Service (AWS DMS) is a cloud service that helps migrate different data warehouses, Relational databases, NoSQL databases, and other data stores. And this article will discuss AWS Data Migration Service, how it works, its component, Source, Target, and Security. 

AWS data migration service (AWS DMS) helps us migrate databases to AWS securely. It supports a homogeneous migration, like Oracle to Oracle, and heterogeneous migration between different databases. It is a quick, low-cost, and reliable service as it monitors most of the instances like source and target databases, network connectivity, etc.

Working of AWS Data Migration Service work

AWS Data Migration Service (AWS DMS) is a web service that helps migrate data from the source data store to the target data store. These data stores are called endpoints. The only requirement is that one of the endpoints, either source or target, must be on AWS services.

Then we can migrate between source and target endpoints that use the same Database, such as from Microsoft SQL to Microsoft SQL. We can also migrate between source and target endpoints using different databases, like Oracle database to Microsoft SQL

Source: https://docs.aws.amazon.com/dms/latest/userguide/Welcome.html

 

Let us discuss a High-level view of AWS DMS and understand more about how it works.

Get the tech career you deserve, faster!
Connect with our expert counsellors to understand how to hack your way to success
User rating 4.7/5
1:1 doubt support
95% placement record
Akash Pal
Senior Software Engineer
326% Hike After Job Bootcamp
Himanshu Gusain
Programmer Analyst
32 LPA After Job Bootcamp
After Job
Bootcamp

High-Level View of AWS DMS

AWS DMS connects to the source data store to perform the data migration between two endpoints. Then it reads the source data, formats the data, and gets it ready for consumption by the target datastore after it loads the data into the target datastore. Most of this processing happens in the memory. 

At the high level, while using the AWS DMS, we create a replication server and create two endpoints, the source and the target, that have connection information about data stores. Then we generate one or more migration task that migrates the data between the source and target datastore.

These migration tasks can consist of three major phases:

  • Ongoing replication
  • A full load of existing data
  • The applications of changed cache

 

Let us now discuss the components of AWS DMS.

See more, Amazon Hirepro

Components of AWS DMS

Here we will discuss some internal components of AWS DMS and how they function together to carry off data migration. An AWS Data Migration Service consists of three components:

  1. Replication instance
  2. Endpoints
  3. Replication task

 

Let's discuss the components one by one.

Replication Instance

An AWS DMS creates the replication instance on an Amazon Elastic Compute Cloud (Amazon EC2). A replication instance can host one or more tasks depending on the characteristics of migration and the capacity of the replication server. Some smaller instances classes are sufficient for smaller migrations, but if the migration is large means it consists of a large number of tables, we should consider using large instances because AWS DMS can consume a significant amount of CPU and memory. AWS DMS provides a variety of replication instances to choose the suitable configuration for our use case.

Endpoints

An AWS DMS uses endpoints to access data stores. The specific connection information can be different but generally, we supply the following information when we create an endpoint:

  • Endpoint type – Source or target. 
  • Engine type – Type of database engines, such as Oracle, NO-SQL database or PostgreSQL.
  • Server name – IP address that AWS DMS can reach.
  • Port – Port number used for the database server connections. 
  • Encryption – Secure Socket Layer (SSL) mode, if SSL is used to encrypt the connection. 
  • Credentials – User name and password for an account with access rights.

Replication Tasks

AWS DMS replication task transfers a set of data from the source endpoint to the target endpoint. Creating a replication task is the last step before the migration starts. 

The task migrates the data from the source endpoint to the target endpoint, and the processing is done on replication instances. We specify what tables and schemas to migrate with any special processing, like table mapping, logging requirements, and error handling.

Now we will discuss Source for AWS DMS.

Source for AWS DMS

Various data stores present as source endpoints for data migration using AWS DMS. Some are:

On-premises and EC2 instance database

  • Oracle versions 10.2 and later
  • Microsoft SQL Server 
  • MySQL versions 5.6, 5.7, 5.8, and 8.0
  • MariaDB, MongoDB, PostgreSQL etc.

 

Amazon Simple Storage Service and Amazon RDS instance databases

  • Oracle version 11g
  • Microsoft SQL server
  • MySQL versions 5.6, 5.7, 5.8, and 8.0
  • PostgreSQL version 9.4 and later
  • Amazon Aurora with MySQL and PostgreSQL compatibility
  • Amazon S3

 

Third-party managed database service

  • Google cloud for MySQL
  • Microsft Azure SQL Database

 

Let's discuss Targets for AWS DMS.

Targets for AWS DMS

Using AWS DMS, we can use the following data stores as target endpoints for data migration.

On-premises and EC2 instance database

  • Oracle for Enterprise, Standard, Standard One, Standard Two Editions.
  • Microsoft SQL server
  • MySQL versions 5.6, 5.7, 5.8, and 8.0
  • Redis versions 6. x.
  • PostgreSQL version 9.4 and later

 

Amazon RDS instance databases, Amazon S3, Amazon OpenSearch Service, Amazon Neptune, Amazon ElastiCache for Redis, Amazon Redshift, Amazon Kinesis Data Streams, Amazon DocumentDB, Amazon DynamoDB

  • Oracle for Enterprise, Standard, Standard One, Standard Two Editions.
  • MySQL versions 5.6, 5.7, 5.8, and 8.0
  • Microsoft SQL server
  • Amazon Aurora MySQL-Compatible Edition 
  • Amazon OpenSearch Service 
  • Amazon Aurora PostgreSQL-Compatible Edition 
  • Amazon Aurora Serverless 
  • Amazon Redshift 
  • Amazon DynamoDB 
  • Amazon ElastiCache for Redis 
  • Amazon Kinesis Data Streams 
  • Amazon DocumentDB (with MongoDB compatibility) 
  • Amazon S3 
  • Amazon Neptune

 

Let us discuss the Security of AWS Data Migration Service.

Security in AWS Data Migration Service

Security is always the highest priority in AWS. It is the combined responsibility of the user and AWS itself. This combined responsibility describes it as security of the Cloud and security in the Cloud.

Security of the Cloud

AWS is responsible for the protection of the infrastructure that runs the services in AWS Cloud. It provides services that are purely secure to use. Also, third-party auditors keep verifying and testing the effectiveness of security of the Cloud at regular intervals.

Security in the Cloud

Security in the Cloud is our responsibility and is determined by the AWS service we are using. Also, we are responsible for some other factors, including the sensitivity of our data, the requirements of organizations, and applicable laws and regulations.

Let us discuss some Frequently Asked Questions related to the topic.

Frequently Asked Questions

What does AWS DMS stand for?

AWS DMS stands for AWS Data Migration Service.

What is AWS DMS?

AWS data migration service (AWS DMS) helps us migrate databases to AWS securely. It supports a homogeneous migration, like Oracle to Oracle, and heterogeneous migration between different databases.

What are endpoints?

Endpoints are the datastore from and to where data is transferred.

What are the components of AWS Data Migration Service?

Components of AWS DMS are Replication instances, Endpoints, and Replication tasks.

List some third-party database services.

Microsoft Azure SQL database and Google Cloud for MySQL are some third-party database services.

Conclusion

In this article, we have extensively discussed AWS Data Migration Service. We learned AWS data migration service and how it works and also some faqs related to this topic.

After reading about AWS Data Migration Service, are you not feeling excited to read/explore more articles on AWS? Don't worry; Coding Ninjas has you covered. To learn, see Introduction to AWSAWS FeaturesManaging Devices with AWS IoTAWS Amplify, and AWS Cost & Usage Report.

Refer to our Guided Path on Coding Ninjas Studio to upskill yourself in Data Structures and AlgorithmsCompetitive ProgrammingJavaScriptSystem Design, and many more! If you want to test your competency in coding, you may check out the mock test series and participate in the contests hosted on Coding Ninjas Studio! But if you have just started your learning process and are looking for questions asked by tech giants like Amazon, Microsoft, Uber, etc; you must look at the problems, interview experiences, and interview bundle for placement preparations.

Nevertheless, you may consider our paid courses to give your career an edge over others!

Do upvote our blogs if you find them helpful and engaging!

Happy Learning!

Previous article
AWS Disaster Recovery
Next article
AWS Server Migration Service
Live masterclass