Spark 升級代理程式的提示範例 - Amazon EMR

本文為英文版的機器翻譯版本,如內容有任何歧義或不一致之處,概以英文版為準。

Spark 升級代理程式的提示範例

我們會列出幾個不同的提示範例,可用於升級程序。

1. 為升級 Spark 應用程式的代理程式提供現有的 EMR 步驟資訊

Upgrade my Spark application <local-project-path> from EMR version 6.0.0 to 7.12.0. Use EMR-EC2 Cluster <cluster-id> to run the validation and s3 paths s3://<please fill in your staging bucket path> to store updated application artifacts. The Spark application is already executed in the source EMR-EC2 Cluster <cluster-id> with step id <step-id>.

2. 列出分析 (用於升級) 並檢查特定分析的狀態

Can you list all the spark upgrade analysis.
Describe the analysis with analysis id <analysis id>.

3. 產生升級計畫後對其進行修改

Help me to update the generated upgrade plan to skip the local test step.

4. 覆寫升級驗證任務執行的預設組態

For submitting my EMR Severless validaiton job. I would like to use S3 logging instead of CW logging, and use this S3 path <S3 path prefix>.