Skip to content

How to turn on Tiered Storage for your Kafka topicΒΆ

This guide shows you how to enable tiered storage for your Kafka topic.

PrerequisitesΒΆ

You need to own an existing topic in nais. Check Create a Kafka topic for how to create a topic.

Enable tiered storage by specifying local retention on a topicΒΆ

Git diff showing how to enable tiered storage in a 'nai example_topic.yaml' file
diff --git a/example_topic.yaml b/example_topic.yaml
index 230ec001..cbc01774 100644
--- a/example_topic.yaml
+++ b/example_topic.yaml
@@ -8,3 +8,8 @@ labels:
 spec:
 kafka:
   # ... other configuration ...
+  config:
+    # Must be a value smaller than `retentionHours`
+    localRetentionHours: X
+    # Must be a value smaller than `retentionBytes`
+    localRetentionBytes: Y

Apply the new configurationΒΆ

Add the file to your application repository and deploy with NAIS github action.

kubectl apply -f ./example_topic.yaml --namespace=<MY-TEAM> --context=<MY-CLUSTER>