Flight Planning Using Data Lakes and AI/ML
Publication date: July 16, 2020 (Diagram history)
With this architecture, you can improve hold time prediction and departure clearance time estimation. Use published schedules, flight information, airport weather, historical hold times, and aircraft data. You combine batch and real-time feeds in a tiered data lake for predictive modeling.
Flight planning data lakes diagram
The following steps describe the architecture:
-
Use published schedules from OAG for a full picture of arriving flights by time of day.
-
Augment with actual flight data through real-time flight information feeds.
-
Use flight plans, surface movement, and on-route information from FAA System Wide Information Management (SWIM). This provides an airspace and taxiway picture.
-
Use Meteorological Aerodrome Report (METAR) weather observations and Terminal Aerodrome Forecast (TAF) data. Correlate hold time to weather conditions.
-
Use historical hold times to build predictive models. Train models by airport, time of day, and weather conditions.
-
Build a tiered data lake on Amazon S3. Ingest and process both batch and real-time feeds.
-
Use AWS Glue and Amazon EMR to discover, catalog, and process data into Apache Parquet format.
-
Use Amazon SageMaker AI to build, train, tune, and deploy predictive models. Use Debugger and Model Monitor for model quality.
-
Build an operational data store for real-time predictions. Integrate predictions into flight planning systems.
Further reading
For additional information, see the following resources:
Diagram history
To receive updates about this reference architecture diagram, subscribe to the RSS feed.
| Change | Description | Date |
|---|---|---|
Initial publication | Reference architecture diagram first published. | July 16, 2020 |
RSS subscription requirement
To subscribe to RSS updates, you must have an RSS plugin enabled for the browser you are using.