Using python3.6 alpine base image adds java,pandas, numpy,pyspark and spark as rundeps. This image can be used as container image when you run spark-submit on k8.
kubernetes
kafka
spark
numpy
flatbuffers
pymongo
pandas
pyspark
java-8
alpine-image
spark-submit
container-image
spark-on-kubernetes
-
Updated
Nov 11, 2022 - Dockerfile