AWS CLI Command Reference

Note:

You are viewing the documentation for an older major version of the AWS CLI (version 1).

AWS CLI version 2, the latest major version of AWS CLI, is now stable and recommended for general use. To view this page for the AWS CLI version 2, click here. For more information see the AWS CLI version 2 installation instructions and migration guide.

[ aws . entityresolution ]

create-matching-workflow

Description

Creates a matching workflow that defines the configuration for a data processing job. The workflow name must be unique. To modify an existing workflow, use UpdateMatchingWorkflow .

Warning

For workflows where resolutionType is ML_MATCHING or PROVIDER , incremental processing is not supported.

See also: AWS API Documentation

create-matching-workflow uses document type values. Document types follow the JSON data model where valid values are: strings, numbers, booleans, null, arrays, and objects. For command input, options and nested parameters that are labeled with the type document must be provided as JSON. Shorthand syntax does not support document types.

Synopsis

  create-matching-workflow
--workflow-name <value>
[--description <value>]
--input-source-config <value>
--output-source-config <value>
--resolution-techniques <value>
[--incremental-run-config <value>]
--role-arn <value>
[--tags <value>]
[--cli-input-json <value>]
[--generate-cli-skeleton <value>]
[--debug]
[--endpoint-url <value>]
[--no-verify-ssl]
[--no-paginate]
[--output <value>]
[--query <value>]
[--profile <value>]
[--region <value>]
[--version <value>]
[--color <value>]
[--no-sign-request]
[--ca-bundle <value>]
[--cli-read-timeout <value>]
[--cli-connect-timeout <value>]

Options

--workflow-name (string)

The name of the workflow. There can’t be multiple MatchingWorkflows with the same name.

--description (string)

A description of the workflow.

--input-source-config (list)

A list of InputSource objects, which have the fields InputSourceARN and SchemaName .

(structure)

An object containing inputSourceARN , schemaName , and applyNormalization .

inputSourceARN -> (string)

An Glue table Amazon Resource Name (ARN) for the input source table.

schemaName -> (string)

The name of the schema to be retrieved.

applyNormalization -> (boolean)

Normalizes the attributes defined in the schema in the input data. For example, if an attribute has an AttributeType of PHONE_NUMBER , and the data in the input table is in a format of 1234567890, Entity Resolution will normalize this field in the output to (123)-456-7890.

Shorthand Syntax:

inputSourceARN=string,schemaName=string,applyNormalization=boolean ...

JSON Syntax:

[
  {
    "inputSourceARN": "string",
    "schemaName": "string",
    "applyNormalization": true|false
  }
  ...
]

--output-source-config (list)

A list of OutputSource objects, each of which contains fields outputS3Path , applyNormalization , KMSArn , and output .

(structure)

A list of OutputAttribute objects, each of which have the fields Name and Hashed . Each of these objects selects a column to be included in the output table, and whether the values of the column should be hashed.

outputS3Path -> (string)

The S3 path to which Entity Resolution will write the output table.

KMSArn -> (string)

Customer KMS ARN for encryption at rest. If not provided, system will use an Entity Resolution managed KMS key.

output -> (list)

A list of OutputAttribute objects, each of which have the fields Name and Hashed . Each of these objects selects a column to be included in the output table, and whether the values of the column should be hashed.

(structure)

A list of OutputAttribute objects, each of which have the fields Name and Hashed . Each of these objects selects a column to be included in the output table, and whether the values of the column should be hashed.

name -> (string)

A name of a column to be written to the output. This must be an InputField name in the schema mapping.

hashed -> (boolean)

Enables the ability to hash the column values in the output.

applyNormalization -> (boolean)

Normalizes the attributes defined in the schema in the input data. For example, if an attribute has an AttributeType of PHONE_NUMBER , and the data in the input table is in a format of 1234567890, Entity Resolution will normalize this field in the output to (123)-456-7890.

Shorthand Syntax:

outputS3Path=string,KMSArn=string,output=[{name=string,hashed=boolean},{name=string,hashed=boolean}],applyNormalization=boolean ...

JSON Syntax:

[
  {
    "outputS3Path": "string",
    "KMSArn": "string",
    "output": [
      {
        "name": "string",
        "hashed": true|false
      }
      ...
    ],
    "applyNormalization": true|false
  }
  ...
]

--resolution-techniques (structure)

An object which defines the resolutionType and the ruleBasedProperties .

resolutionType -> (string)

The type of matching workflow to create. Specify one of the following types:

  • RULE_MATCHING : Match records using configurable rule-based criteria
  • ML_MATCHING : Match records using machine learning models
  • PROVIDER : Match records using a third-party matching provider

ruleBasedProperties -> (structure)

An object which defines the list of matching rules to run and has a field rules , which is a list of rule objects.

rules -> (list)

A list of Rule objects, each of which have fields RuleName and MatchingKeys .

(structure)

An object containing the ruleName and matchingKeys .

ruleName -> (string)

A name for the matching rule.

matchingKeys -> (list)

A list of MatchingKeys . The MatchingKeys must have been defined in the SchemaMapping . Two records are considered to match according to this rule if all of the MatchingKeys match.

(string)

attributeMatchingModel -> (string)

The comparison type. You can choose ONE_TO_ONE or MANY_TO_MANY as the attributeMatchingModel .

If you choose ONE_TO_ONE , the system can only match attributes if the sub-types are an exact match. For example, for the Email attribute type, the system will only consider it a match if the value of the Email field of Profile A matches the value of the Email field of Profile B.

If you choose MANY_TO_MANY , the system can match attributes across the sub-types of an attribute type. For example, if the value of the Email field of Profile A and the value of BusinessEmail field of Profile B matches, the two profiles are matched on the Email attribute type.

matchPurpose -> (string)

An indicator of whether to generate IDs and index the data or not.

If you choose IDENTIFIER_GENERATION , the process generates IDs and indexes the data.

If you choose INDEXING , the process indexes the data without generating IDs.

ruleConditionProperties -> (structure)

An object containing the rules for a matching workflow.

rules -> (list)

A list of rule objects, each of which have fields ruleName and condition .

(structure)

An object that defines the ruleCondition and the ruleName to use in a matching workflow.

ruleName -> (string)

A name for the matching rule.

For example: Rule1

condition -> (string)

A statement that specifies the conditions for a matching rule.

If your data is accurate, use an Exact matching function: Exact or ExactManyToMany .

If your data has variations in spelling or pronunciation, use a Fuzzy matching function: Cosine , Levenshtein , or Soundex .

Use operators if you want to combine (AND ), separate (OR ), or group matching functions (...) .

For example: (Cosine(a, 10) AND Exact(b, true)) OR ExactManyToMany(c, d)

providerProperties -> (structure)

The properties of the provider service.

providerServiceArn -> (string)

The ARN of the provider service.

providerConfiguration -> (document)

The required configuration fields to use with the provider service.

intermediateSourceConfiguration -> (structure)

The Amazon S3 location that temporarily stores your data while it processes. Your information won’t be saved permanently.

intermediateS3Path -> (string)

The Amazon S3 location (bucket and prefix). For example: s3://provider_bucket/DOC-EXAMPLE-BUCKET

JSON Syntax:

{
  "resolutionType": "RULE_MATCHING"|"ML_MATCHING"|"PROVIDER",
  "ruleBasedProperties": {
    "rules": [
      {
        "ruleName": "string",
        "matchingKeys": ["string", ...]
      }
      ...
    ],
    "attributeMatchingModel": "ONE_TO_ONE"|"MANY_TO_MANY",
    "matchPurpose": "IDENTIFIER_GENERATION"|"INDEXING"
  },
  "ruleConditionProperties": {
    "rules": [
      {
        "ruleName": "string",
        "condition": "string"
      }
      ...
    ]
  },
  "providerProperties": {
    "providerServiceArn": "string",
    "providerConfiguration": {...},
    "intermediateSourceConfiguration": {
      "intermediateS3Path": "string"
    }
  }
}

--incremental-run-config (structure)

Optional. An object that defines the incremental run type. This object contains only the incrementalRunType field, which appears as “Automatic” in the console.

Warning

For workflows where resolutionType is ML_MATCHING or PROVIDER , incremental processing is not supported.

incrementalRunType -> (string)

The type of incremental run. The only valid value is IMMEDIATE . This appears as “Automatic” in the console.

Warning

For workflows where resolutionType is ML_MATCHING or PROVIDER , incremental processing is not supported.

Shorthand Syntax:

incrementalRunType=string

JSON Syntax:

{
  "incrementalRunType": "IMMEDIATE"
}

--role-arn (string)

The Amazon Resource Name (ARN) of the IAM role. Entity Resolution assumes this role to create resources on your behalf as part of workflow execution.

--tags (map)

The tags used to organize, track, or control access for this resource.

key -> (string)

value -> (string)

Shorthand Syntax:

KeyName1=string,KeyName2=string

JSON Syntax:

{"string": "string"
  ...}

--cli-input-json (string) Performs service operation based on the JSON string provided. The JSON string follows the format provided by --generate-cli-skeleton. If other arguments are provided on the command line, the CLI values will override the JSON-provided values. It is not possible to pass arbitrary binary values using a JSON-provided value as the string will be taken literally.

--generate-cli-skeleton (string) Prints a JSON skeleton to standard output without sending an API request. If provided with no value or the value input, prints a sample input JSON that can be used as an argument for --cli-input-json. If provided with the value output, it validates the command inputs and returns a sample output JSON for that command.

Global Options

--debug (boolean)

Turn on debug logging.

--endpoint-url (string)

Override command’s default URL with the given URL.

--no-verify-ssl (boolean)

By default, the AWS CLI uses SSL when communicating with AWS services. For each SSL connection, the AWS CLI will verify SSL certificates. This option overrides the default behavior of verifying SSL certificates.

--no-paginate (boolean)

Disable automatic pagination. If automatic pagination is disabled, the AWS CLI will only make one call, for the first page of results.

--output (string)

The formatting style for command output.

  • json
  • text
  • table

--query (string)

A JMESPath query to use in filtering the response data.

--profile (string)

Use a specific profile from your credential file.

--region (string)

The region to use. Overrides config/env settings.

--version (string)

Display the version of this tool.

--color (string)

Turn on/off color output.

  • on
  • off
  • auto

--no-sign-request (boolean)

Do not sign requests. Credentials will not be loaded if this argument is provided.

--ca-bundle (string)

The CA certificate bundle to use when verifying SSL certificates. Overrides config/env settings.

--cli-read-timeout (int)

The maximum socket read time in seconds. If the value is set to 0, the socket read will be blocking and not timeout. The default value is 60 seconds.

--cli-connect-timeout (int)

The maximum socket connect time in seconds. If the value is set to 0, the socket connect will be blocking and not timeout. The default value is 60 seconds.

Output

workflowName -> (string)

The name of the workflow.

workflowArn -> (string)

The ARN (Amazon Resource Name) that Entity Resolution generated for the MatchingWorkflow .

description -> (string)

A description of the workflow.

inputSourceConfig -> (list)

A list of InputSource objects, which have the fields InputSourceARN and SchemaName .

(structure)

An object containing inputSourceARN , schemaName , and applyNormalization .

inputSourceARN -> (string)

An Glue table Amazon Resource Name (ARN) for the input source table.

schemaName -> (string)

The name of the schema to be retrieved.

applyNormalization -> (boolean)

Normalizes the attributes defined in the schema in the input data. For example, if an attribute has an AttributeType of PHONE_NUMBER , and the data in the input table is in a format of 1234567890, Entity Resolution will normalize this field in the output to (123)-456-7890.

outputSourceConfig -> (list)

A list of OutputSource objects, each of which contains fields outputS3Path , applyNormalization , KMSArn , and output .

(structure)

A list of OutputAttribute objects, each of which have the fields Name and Hashed . Each of these objects selects a column to be included in the output table, and whether the values of the column should be hashed.

outputS3Path -> (string)

The S3 path to which Entity Resolution will write the output table.

KMSArn -> (string)

Customer KMS ARN for encryption at rest. If not provided, system will use an Entity Resolution managed KMS key.

output -> (list)

A list of OutputAttribute objects, each of which have the fields Name and Hashed . Each of these objects selects a column to be included in the output table, and whether the values of the column should be hashed.

(structure)

A list of OutputAttribute objects, each of which have the fields Name and Hashed . Each of these objects selects a column to be included in the output table, and whether the values of the column should be hashed.

name -> (string)

A name of a column to be written to the output. This must be an InputField name in the schema mapping.

hashed -> (boolean)

Enables the ability to hash the column values in the output.

applyNormalization -> (boolean)

Normalizes the attributes defined in the schema in the input data. For example, if an attribute has an AttributeType of PHONE_NUMBER , and the data in the input table is in a format of 1234567890, Entity Resolution will normalize this field in the output to (123)-456-7890.

resolutionTechniques -> (structure)

An object which defines the resolutionType and the ruleBasedProperties .

resolutionType -> (string)

The type of matching workflow to create. Specify one of the following types:

  • RULE_MATCHING : Match records using configurable rule-based criteria
  • ML_MATCHING : Match records using machine learning models
  • PROVIDER : Match records using a third-party matching provider

ruleBasedProperties -> (structure)

An object which defines the list of matching rules to run and has a field rules , which is a list of rule objects.

rules -> (list)

A list of Rule objects, each of which have fields RuleName and MatchingKeys .

(structure)

An object containing the ruleName and matchingKeys .

ruleName -> (string)

A name for the matching rule.

matchingKeys -> (list)

A list of MatchingKeys . The MatchingKeys must have been defined in the SchemaMapping . Two records are considered to match according to this rule if all of the MatchingKeys match.

(string)

attributeMatchingModel -> (string)

The comparison type. You can choose ONE_TO_ONE or MANY_TO_MANY as the attributeMatchingModel .

If you choose ONE_TO_ONE , the system can only match attributes if the sub-types are an exact match. For example, for the Email attribute type, the system will only consider it a match if the value of the Email field of Profile A matches the value of the Email field of Profile B.

If you choose MANY_TO_MANY , the system can match attributes across the sub-types of an attribute type. For example, if the value of the Email field of Profile A and the value of BusinessEmail field of Profile B matches, the two profiles are matched on the Email attribute type.

matchPurpose -> (string)

An indicator of whether to generate IDs and index the data or not.

If you choose IDENTIFIER_GENERATION , the process generates IDs and indexes the data.

If you choose INDEXING , the process indexes the data without generating IDs.

ruleConditionProperties -> (structure)

An object containing the rules for a matching workflow.

rules -> (list)

A list of rule objects, each of which have fields ruleName and condition .

(structure)

An object that defines the ruleCondition and the ruleName to use in a matching workflow.

ruleName -> (string)

A name for the matching rule.

For example: Rule1

condition -> (string)

A statement that specifies the conditions for a matching rule.

If your data is accurate, use an Exact matching function: Exact or ExactManyToMany .

If your data has variations in spelling or pronunciation, use a Fuzzy matching function: Cosine , Levenshtein , or Soundex .

Use operators if you want to combine (AND ), separate (OR ), or group matching functions (...) .

For example: (Cosine(a, 10) AND Exact(b, true)) OR ExactManyToMany(c, d)

providerProperties -> (structure)

The properties of the provider service.

providerServiceArn -> (string)

The ARN of the provider service.

providerConfiguration -> (document)

The required configuration fields to use with the provider service.

intermediateSourceConfiguration -> (structure)

The Amazon S3 location that temporarily stores your data while it processes. Your information won’t be saved permanently.

intermediateS3Path -> (string)

The Amazon S3 location (bucket and prefix). For example: s3://provider_bucket/DOC-EXAMPLE-BUCKET

incrementalRunConfig -> (structure)

An object which defines an incremental run type and has only incrementalRunType as a field.

incrementalRunType -> (string)

The type of incremental run. The only valid value is IMMEDIATE . This appears as “Automatic” in the console.

Warning

For workflows where resolutionType is ML_MATCHING or PROVIDER , incremental processing is not supported.

roleArn -> (string)

The Amazon Resource Name (ARN) of the IAM role. Entity Resolution assumes this role to create resources on your behalf as part of workflow execution.