Airline Schedule Engine
Publication date: May 3, 2021 (Diagram history)
An airline schedule engine aggregates batch and real-time flight data to support fast flight and schedule lookups. With this architecture, you can create a scalable, configurable, and fault-tolerant tier-0 system. It uses purpose-built databases, serverless compute, and a data lake to reduce total cost of ownership.
This architecture uses the Airport Terminal Optimizer as a source for schedule data context. You can combine batch inputs with real-time data feeds to build complete flight schedules.
Airline schedule engine diagram
The following steps describe the architecture:
-
Load all batch inputs such as Standard Schedules Information Manual (SSIM) into a batch staging bucket in Amazon S3.
-
Load all real-time data feeds such as Standard Schedule Messages (SSM) and flight information (FLIFO) into a real-time staging bucket in Amazon S3.
-
Use AWS Glue and Amazon EMR processes to discover, catalog, and process inputs. Create processed data in Amazon S3. Combine batch and real-time data.
-
Create flight data by converting schedule files into individual flights. Load the data into DynamoDB for direct flight lookup.
-
Run flight lookups through Lambda and DynamoDB with in-memory caching from DynamoDB Accelerator (DAX). Ingest and serve FLIFO events with flight data.
-
Process routes with mileage, day of week, seasonality, and airline type. Load the data into Amazon Neptune graph database for route lookups by origin and destination.
-
Apply duration and mileage rules. Retrieve flights for each route and combine them with connection rules to create the full schedule. Use Amazon ElastiCache for Redis for performance.
-
Maintain connection rules in DynamoDB for fast retrieval. Manage these rules with a connection rules dashboard.
-
Use SageMaker AI to improve route building and schedule lookup performance.
Further reading
For additional information, see the following resources:
Diagram history
To receive updates about this reference architecture diagram, subscribe to the RSS feed.
| Change | Description | Date |
|---|---|---|
Initial publication | Reference architecture diagram first published. | May 3, 2021 |
RSS subscription requirement
To subscribe to RSS updates, you must have an RSS plugin enabled for the browser you are using.
