I want to Migrate from Oracle RDBMS to AWS S3 using Kinesis

Question

Following are the itineraries

1. Is there way to  automate first full load so that it creates different streams for different tables.
2. In case if there is a new additional table, how do I create a new stream automatically. 3.How do I load to Kinesis incrementally

Please help

Answer 1

Try to understand AWS Schema Conversion Tool (AWS SCT) and its Database Migration Service (AWS DMS). DMS does not necessarily use Kinesis but it is specifically design for this use case.

Refer this to start: https://aws.amazon.com/blogs/database/how-to-migrate-your-oracle-data-warehouse-to-amazon-redshift-using-aws-sct-and-aws-dms/

Answer 2

AWS Database Migration Service (AWS DMS) helps you migrate databases to AWS easily and securely. The AWS Database Migration Service can migrate your data to and from most widely used commercial and open-source databases. The service supports homogenous migrations such as Oracle to Oracle. It also supports heterogeneous migrations between different database platforms, such as Oracle to Amazon Aurora or Microsoft SQL Server to MySQL. The source database remains fully operational during the migration, minimizing downtime to applications that rely on the database.
For more details you can view the following link:-

https://aws.amazon.com/blogs/database/migrating-oracle-database-from-on-premises-or-amazon-ec2-instances-to-amazon-redshift/​