ADVREL04-BP01 Through your CI/CD pipeline, employ end-to-end regression, performance, and canary testing
Integrate comprehensive testing methodologies into CI/CD pipelines for advertising workloads. Monitor key metrics like 5xx errors and latency, especially in RTB systems, and respond quickly to issues through immediate engagement and fast rollbacks.
Implementation guidance
For RTB at scale, the primary reliability metrics for availability are 5xx internal errors and elevated latency. If these metrics are breached, do not wait for impacts to ad effectiveness. Instead, fail fast and revert changes until the root cause of the issue can be identified and addressed.
Key AWS services
-
AWS CodePipeline
is a fully-managed continuous delivery service -
AWS Fault Injection Service
is a fully-managed service that simulates real-world failures