Transferring data from a Microsoft SQL Server source endpoint
Yandex Data Transfer enables you to migrate data from a Microsoft SQL Server database to Yandex Cloud managed databases and implement various data processing and transformation scenarios. To implement a transfer:
- Explore possible data transfer scenarios.
- Prepare the Microsoft SQL Server database for the transfer.
- Set up an endpoint source in Yandex Data Transfer.
- Set up one of the supported data targets.
- Create a transfer and start it.
- In case of any issues, use ready-made solutions to resolve them.
Scenarios for transferring data from Microsoft SQL Server
You can implement scenarios for data migration and delivery from a Microsoft SQL Server database to managed databases for further storage in the cloud, processing and loading into data marts for further visualization.
For a detailed description of possible Yandex Data Transfer data transfer scenarios, see Tutorials.
Preparing the Microsoft SQL Server database
To work with a Microsoft SQL Server data source:
- Make sure your database can be accessed from the computer that Airbyte® is running on.
- Create a dedicated Airbyte® user with read-only permissions and access to any tables that require replication.
For more information, see the Airbyte® documentation
Configuring the Microsoft SQL Server source endpoint
When creating or updating an endpoint, configure access to SQL Server.
-
Host: IP address or FQDN of the host you want to connect to.
-
Port: Port number Data Transfer will use for connections to the host.
-
Database: Name of the DB to connect to.
-
Username, Password: DB user name and password.
-
Replication method: Replication method used to retrieve data from the database.
STANDARD
replication requires setup on the DB side, while it does not show data changes.CDC
replication allows identifying data inserts, updates, and deletes. -
SSL Method: Encryption method used when exchanging data with the database:
-
UNENCRYPTED
: Saving the password as plain text. -
ENCRYPTER (trust cert)
: Using a certificate from a trusted source. -
ENCRYPTER (verify cert)
: Using a self-signed certificate.
-
For more information about settings, see the Airbyte® documentation
Airbyte® is a registered trademark of Airbyte, Inc in the United States and/or other countries.
Configuring the data target
Configure one of the supported data targets:
- MySQL.
- MongoDB.
- ClickHouse®.
- Greenplum®.
- Yandex Managed Service for YDB.
- Apache Kafka®.
- YDS.
- PostgreSQL.
For a complete list of supported sources and targets in Yandex Data Transfer, see Available Transfers.
After configuring the data source and target, create and start the transfer.