Using Kafka Streams with internal topics¶

Kafka Streams is only available in GCP

Kafka Streams is only available in GCP clusters, and will not work in on-prem clusters.

This guide will show you how to use Kafka Streams with internal topics.

Enable Kafka Streams in your application¶

.nais/app.yaml

  apiVersion: nais.io/v1alpha1
  kind: Application
  metadata:
    name: <MY-APP>
    namespace: <MY-TEAM>
    labels:
      team: <MY-TEAM>
  spec:
    kafka:
      pool: <MY-POOL>
      streams: true

Select a pool from one of the available pools.

Configure your application¶

When you do this you must configure Kafka Streams by setting the property application.id to a value that starts with the value of the env var KAFKA_STREAMS_APPLICATION_ID, which will be injected into your pod automatically.

Apply the application¶

AutomaticallyManually

Add the file to your application repository to deploy with NAIS github action.

kubectl apply -f ./nais/app.yaml --namespace=<MY-TEAM> --context=<MY-CLUSTER>