feat: support for Kubernetes-based deployment #1602
Conversation
There was a problem hiding this comment.
Thanks for the PR! Will let @keremsahin1 review the Kubernetes config files.
mars-lan
changed the title
contrib/kubernetes/README.md
Outdated
| ## Setup | ||
| This kubernetes deployment doesn't contain the below artifacts. The idea is to use the original helm charts for deploying each of these separately. | ||
|
|
||
| * Kafka and Schema Registry [Chart Link](https://hub.helm.sh/charts/incubator/kafka) |
There was a problem hiding this comment.
We depend on Confluent Kafka right now, changing dependency to Apache Kafka might need small refactoring in the codebase I suppose (expect minimal change on kafka producer & consumer). But, this is not a big deal, we can change it to Apache Kafka. The only reason we depended on Confluent Kafka was ease of use because they had their Docker images ready in Docker Hub. It was so easy to use.
There was a problem hiding this comment.
Confluent Helm charts are also available. Need to test it e2e. Will change the link to point to this https://github.com/confluentinc/cp-helm-charts/tree/master/charts/cp-kafka
There was a problem hiding this comment.
Sure, that'd be easier.
There was a problem hiding this comment.
Done! Changed the Chart Link
contrib/kubernetes/README.md
Outdated
| ``` | ||
| kubectl apply -f datahub-configmap.yaml | ||
| ``` | ||
| 3. Run the below kubectl commands |
contrib/kubernetes/README.md
Outdated
| ## Setup | ||
| This kubernetes deployment doesn't contain the below artifacts. The idea is to use the original helm charts for deploying each of these separately. | ||
|
|
||
| * Kafka and Schema Registry [Chart Link](https://hub.helm.sh/charts/incubator/kafka) |
There was a problem hiding this comment.
Sure, that'd be easier.
|
This PR contains the basic Kubernetes YAML files. In the next PR (currently working), I'll provide the helm charts and update the README accordingly. If everything is good, can this PR be merged? The WIP branch for helm charts is here |
This is the first version of Kubernetes based deployment. This PR contains kubernetes YAML configuration files. If this work is in alignment with the owners, I can go ahead and create Helm chart for easy installation of Datahub on Kubernetes. Open for feedback. Thank you.