Skip to main content
Skip table of contents

KB - MSK notice of availability risk based on segment.bytes and segment.ms

If you have received the following notification from AWS relating to MSK please note that the default SIEMonster configuration for the relevant settings is left on default and as such MSK automatically applies segment.bytes=1GB and segment.ms=1 week

Hello,
As part of our routine monitoring of your MSK clusters, on [DAY], [DATE] [MONTY] [YEAR] 00:53:57 GMT, we detected an availability risk. One or more topics across multiple MSK clusters in your account have segment.bytes under 100MB or segment.ms under 1 day. This can lead to out of memory exceptions and requires your immediate action. These exceptions will result in the degradation of availability and performance of your MSK cluster.
We recommend that you review all the topics on your clusters where segment.ms or segment.bytes is set and ensure that segment.bytes is set to a minimum of 125MB and segment.ms to a minimum of 1 day. If the value is not set for a topic, no action is needed as it will use the Kafka defaults of segment.bytes=1GB and segment.ms=1 week.
To review your topic configurations, please run the following command on your cluster and audit the segment.ms and segment.bytes configurations where they exist:
$KAFKABIN/kafka-topics.sh --bootstrap-server $KAFKASTR --describe | grep ReplicationFactor
If you have any questions or concerns, please contact AWS Support [1].

The following part of the message applies.

If the value is not set for a topic, no action is needed as it will use the Kafka defaults of segment.bytes=1GB and segment.ms=1 week.

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.