k8s部署spark history历史服务
apiVersion: apps/v1kind: Deploymentmetadata:name: spark-history-servernamespace: dmgeo-libspec:selector:matchLabels:run: spark-history-serverreplicas: 1template:metadata:labels:run: spark-history-serv
·
apiVersion: apps/v1
kind: Deployment
metadata:
name: spark-history-server
namespace: dmgeo-lib
spec:
selector:
matchLabels:
run: spark-history-server
replicas: 1
template:
metadata:
labels:
run: spark-history-server
spec:
containers:
- image: 192.168.145.28:1603/lego/spark/spark:3.0.0
name: spark-history-server
args: ["/opt/spark/bin/spark-class", "org.apache.spark.deploy.history.HistoryServer"]
ports:
- containerPort: 18080
name: http
env:
- name: SPARK_HISTORY_OPTS
value: "-Dspark.history.fs.logDirectory=hdfs://192.168.145.28:9000/sparkhistory"
---
apiVersion: v1
kind: Service
metadata:
name: spark-hs-svc
namespace: dmgeo-lib
spec:
ports:
- port: 18080
protocol: TCP
targetPort: 18080
nodePort: 10080
selector:
run: spark-history-server
type: NodePort
status:
loadBalancer: {}
运行结果:
spark-history-server-558fb7579-7lc5q 1/1 Running 0 19h
更多推荐
已为社区贡献20条内容
所有评论(0)