博客、示例笔记本和其他资源

以下各节包含示例和其他资源，供您详细了解 Amazon SageMaker AI。

博客和案例研究

有关 SageMaker AI Inference 中各种特征的博客和案例研究列表，请参阅下表。您可以使用博客来帮助整理适用于您的使用案例的解决方案。

功能	资源
实时推理	Getting started with deploying real-time models on Amazon SageMaker AI Deploy BLOOM-176B and OPT-30B on Amazon SageMaker AI with large model inference Deep Learning Containers and DeepSpeed Creating a machine learning-powered REST API with Amazon API Gateway mapping templates and Amazon SageMaker AI
自动扩缩	Configuring autoscaling inference endpoints in Amazon SageMaker AI
无服务器推理	Amazon SageMaker 无服务器推理 – 无需担心服务器即可进行机器学习推理使用 Amazon SageMaker 无服务器推理托管 Hugging Face 转换器模型 Amazon SageMaker 无服务器推理基准测试工具包简介
异步推理	Run computer vision inference on large videos with Amazon SageMaker AI asynchronous endpoints Build a predictive maintenance solution with Amazon Kinesis, AWS Glue, and Amazon SageMaker AI 使用 Hugging Face 和 Amazon SageMaker 异步推理端点改善高价值研究
批量转换	Associating prediction results with input data using Amazon SageMaker AI Batch Transform
多模型端点	Save on inference costs by using Amazon SageMaker AI multi-model endpoints Run multiple deep learning models on GPU with Amazon SageMaker AI multi-model endpoints 如何针对多租户 SaaS 使用案例扩展机器学习推理 Run and optimize multi-model inference with Amazon SageMaker AI multi-model endpoints
串行推理管线	Design patterns for serial inference on Amazon SageMaker AI
多容器端点	Cost efficient ML inference with multi-framework models on Amazon SageMaker AI
运行模型组合	Run ensemble ML models on Amazon SageMaker AI
Inference Recommender	SageMaker Inference Recommender 示例笔记本适用于 HuggingFace BERT 情绪分析的 SageMaker Inference Recommender 示例笔记本 Achieve hyperscale performance for model serving using NVIDIA Triton Inference Server on Amazon SageMaker AI
高级模型托管博客系列	Part 1: Common design patterns for building ML application on Amazon SageMaker AI Part 2: Getting started with deploying real time models on SageMaker AI Part 3: Run and optimize multi-model inference with Amazon SageMaker AI multi-model endpoints Part 4: Design patterns for serial inference on Amazon SageMaker AI Part 5: Cost efficient ML inference with multi-framework models on Amazon SageMaker AI Part 6: Best practices in testing and updating models on SageMaker AI Part 7: Run ensemble ML models on Amazon SageMaker AI

示例笔记本

有关可以帮助您详细了解 SageMaker AI Inference 的示例笔记本，请参阅下表。

功能	示例笔记本
Inference Recommender	SageMaker Inference Recommender 示例笔记本适用于 HuggingFace BERT 情绪分析的 SageMaker Inference Recommender 示例笔记本
针对 SageMaker AI 优化大型语言模型（LLM）	生成式人工智能 LLM 研讨会

其他资源

有关每个 SageMaker AI Inference 选项的详细信息，您可以观看以下视频。

Javascript 在您的浏览器中被禁用或不可用。

要使用 Amazon Web Services 文档，必须启用 Javascript。请参阅浏览器的帮助页面以了解相关说明。

文档惯例

资源

问题排除和参考资料