View a markdown version of this page

ADVOPS03-BP02 Automate runbooks to gain operational efficiency - Video Streaming Advertising Lens

ADVOPS03-BP02 Automate runbooks to gain operational efficiency

Document runbooks for failover procedures, capacity scaling, and incident response workflows using AWS Systems Manager documents for automation.

Implementation guidance

Consider the following example use case runbooks:

Scaling runbook

  • Design step-by-step workflows for manually scaling up and down Amazon EC2 instances and increasing or decreasing managed service capacities

  • Create automation scripts to initiate auto scaling actions based on predefined events

  • Perform validation checks for successful scaling operations

Third-party service disruptions

  • Implement multi-provider redundancy and failover mechanisms using AWS Lambda functions and Amazon API Gateway

  • Use AWS X-Ray for end-to-end tracing and troubleshooting of distributed applications and third-party integrations

  • Document playbooks for provider switching, data synchronization, and incident escalation using AWS Step Functions and AWS Lambda

Infrastructure capacity issues

  • Implement auto scaling and load balancing using Amazon EC2 Auto Scaling and Elastic Load Balancing (ELB)

  • Use AWS Auto Scaling for predictive scaling based on historical data and scheduled scaling for planned events

  • Document runbooks for capacity planning, scaling procedures, and cost optimization using AWS Systems Manager Documents

Cost optimization runbook

  • Procedures for reviewing resource utilization and identifying opportunities for optimization using AWS Cost Explorer

  • Guidelines for selecting the most cost-effective Amazon EC2 instance types and purchasing models (like On-Demand, Reserved, or Spot) based on workload patterns

  • Automation to right size Amazon EC2 instances, remove unused resources, and use AWS Savings Plans

  • Processes for periodic cost reviews and budget management

Data management runbook

  • Create runbooks for:

    • Data pipeline failures

    • Replication issues

    • Storage capacity management

    • Compliance violations

  • Include Regional considerations.

  • Document recovery procedures.