Kafka topics
The pipeline reads directly from a managed Kafka cluster and remembers the offset per task — the reading position in the stream. Upon restart, reading continues from the last confirmed offset, not from the beginning.
Kafka protocol, SASL/SCRAM



