All self-managed Apache Kafka event source configuration parameters in Lambda
All Lambda event source types share the same CreateEventSourceMapping and UpdateEventSourceMapping API operations. However, only some of the parameters apply to self-managed Apache Kafka, as shown in the following table.
| Parameter | Required | Default | Notes |
|---|---|---|---|
|
BatchSize |
N |
100 |
Maximum: 10,000 |
|
DestinationConfig |
N |
N/A |
Capturing discarded batches for Amazon MSK and self-managed Apache Kafka event sources |
|
Enabled |
N |
True |
|
|
FilterCriteria |
N |
N/A |
|
|
FunctionName |
Y |
N/A |
|
|
KMSKeyArn |
N |
N/A |
|
|
MaximumBatchingWindowInSeconds |
N |
500 ms |
|
|
ProvisionedPollersConfig |
N |
|
|
|
SelfManagedEventSource |
Y |
N/A |
List of Kafka Brokers. Can set only on Create |
|
SelfManagedKafkaEventSourceConfig |
N |
Contains the ConsumerGroupId field which defaults to a unique value. |
Can set only on Create |
|
SourceAccessConfigurations |
N |
No credentials |
VPC information or authentication credentials for the cluster For SASL_PLAIN, set to BASIC_AUTH |
|
StartingPosition |
Y |
N/A |
AT_TIMESTAMP, TRIM_HORIZON, or LATEST Can set only on Create |
|
StartingPositionTimestamp |
N |
N/A |
Required if StartingPosition is set to AT_TIMESTAMP |
|
Tags |
N |
N/A |
|
|
Topics |
Y |
N/A |
Topic name Can set only on Create |
Note
When you specify a PollerGroupName, multiple ESMs within the same Amazon VPC can share Event Poller Unit (EPU) capacity.
You can use this option to optimize Provisioned mode costs for your ESMs. Requirements for ESM grouping:
ESMs must be within the same Amazon VPC
Maximum of 100 ESMs per poller group
Aggregate maximum pollers across all ESMs in a group cannot exceed 2000
You can update the PollerGroupName to move an ESM to a different group, or remove an ESM from a group by setting PollerGroupName to an empty string ("").