Creating Kafka Clusters
Kafka clusters can be provisioned on any eligible fleet in Streamtime. Follow these steps to create a Kafka cluster:
Before You Begin
Make sure you understand the following:
- Tenancy: Choose the appropriate tenancy mode (shared, isolated, or dedicated) to control resource isolation.
- Kafka Units: Decide the required throughput and storage (1 Kafka unit = 20 MBps).
- Fleet Affinity: Select a fleet in the desired region and network for your workload.
Steps to Create a Kafka Cluster
- Select Cluster Platform
- Choose the Kafka platform that fits your use case: Apache Kafka, CFK, Warpstream, Redpanda, or AutoMQ.
- Configure Cluster Basics
- Set the cluster name, tenancy mode, and number of Kafka units.
- Select Fleet Placement
- Select the fleet where the cluster will be deployed.
- Ensure the fleet matches the tenancy mode and has sufficient Kafka units available.
- Advanced Configuration
- Configure authentication (identity provider), storage options, Kafka version, and enable/disable auto-upgrade as needed.
- Review and Deploy
- Review your configuration.
- Click “Deploy” to provision the Kafka cluster.
Kafka Platforms
| Platform | Use Case | Notes |
|---|---|---|
| Apache Kafka | OSS / Benchmarking | Full DIY control |
| CFK | Enterprise + full Confluent | Requires license key |
| Warpstream | Cost-optimized + remote logs | S3-based architecture |
| Redpanda | Low-latency, JVM-free | Preview feature |
| AutoMQ | Cloud-native Kafka engine | Experimental support |
