Configure consistency notifications for CloudWatch and Amazon SQS

To view CloudWatch metrics for Amazon S3 eventual consistency issues

To view the Inconsistency metric in the CloudWatch console, select the EMRFS metrics and then select a JobFlowId/Metric Name pair. For example: j-162XXXXXXM2CU ListStatus, j-162XXXXXXM2CU GetFileStatus, and so on.

1. Open the CloudWatch console at https://console.aws.amazon.com/cloudwatch/.

2. In the Dashboard, in the Metrics section, choose EMRFS.

3. In the Job Flow Metrics pane, select one or more JobFlowId/Metric Name pairs. A graphical representation of the metrics appears in the window below.

To manage Amazon SQS messages for Amazon S3 eventual consistency issues

Amazon SQS messages for Amazon S3 eventual consistency issues can be read using the EMRFS CLI. To read messages from an EMRFS Amazon SQS queue, type the read-sqs command and specify an output location on the master node's local file system for the resulting output file.

You can also delete an EMRFS Amazon SQS queue using the delete-sqs command.

1. To read messages from an Amazon SQS queue, type the following command. Replace queuename with the name of the Amazon SQS queue that you configured and replace /path/filename with the path to the output file:

   emrfs read-sqs --queue-name queuename --output-file /path/filename

   For example, to read and output Amazon SQS messages from the default queue, type:

   emrfs read-sqs --queue-name EMRFS-Inconsistency-j-162XXXXXXM2CU --output-file /path/filename

   Note

   You can also use the -q and -o shortcuts instead of --queue-name and --output-file respectively.

2. To delete an Amazon SQS queue, type the following command:

   emrfs delete-sqs --queue-name queuename

   For example, to delete the default queue, type:

   emrfs delete-sqs --queue-name EMRFS-Inconsistency-j-162XXXXXXM2CU

   Note

   You can also use the -q shortcut instead of --queue-name.