Migrate Kafka workloads to an Amazon MSK cluster

Amazon MSK Replicator supports migrations between Amazon MSK clusters in the same AWS account. For migrations from non-MSK clusters, such as your Apache Kafka workloads, or between cross-account Amazon MSK clusters, you must use Apache MirrorMaker 2.0.

MSK Replicator is a fully managed, serverless solution that automates data migration to Amazon MSK. MSK Replicator handles scaling, monitoring, and maintenance tasks without requiring infrastructure management. It also maintains topic configurations and consumer group offsets during migration, and integrates with other AWS services.

Apache MirrorMaker 2.0 is an open-source tool that requires manual setup and management, but provides detailed control over the migration process. You can define custom replication rules and migrate between any Apache Kafka clusters regardless of the hosting platform or across different AWS accounts. For information about using MirrorMaker to migrate your clusters, see Geo-Replication (Cross-Cluster Data Mirroring). We recommend setting up MirrorMaker in a highly available configuration.

For more information about how to choose the right replication strategy for your workload, see Amazon MSK Replicator and MirrorMaker2: Choosing the right replication strategy for Apache Kafka disaster recovery and migrations.