Kubernetes部署Logstash
集群均采用helm进行的安装部署,如果helm尚未部署,可参考helm安装获取Logstash包helm fetch stable/logstash --version 2.1.0配置文件在包同级目录下创建配置文件logstash-settings.yaml,内容如下persistence:enabled: false#storageClass: m...
·
集群均采用helm进行的安装部署,如果helm尚未部署,可参考helm安装
获取Logstash包
helm fetch stable/logstash --version 2.1.0
配置文件
在包同级目录下创建配置文件logstash-settings.yaml,内容如下
persistence:
enabled: false
#storageClass: managed-nfs-storage
#accessMode: ReadWriteOnce
#size: 2Gi
image:
repository: 10.16.200.119/base/logstash // 它自带的镜像有点难下,下载完后推送到harbor
tag: latest
pullPolicy: IfNotPresent
inputs:
main: |-
input {
kafka { // 输入来自kafka
bootstrap_servers => "kafka:9092"
codec => json { charset => "UTF-8" }
consumer_threads => 5
topics_pattern => "beat-.*" // topic名称
type => "example"
}
}
outputs:
main: |-
output {
#stdout { codec => rubydebug } // 开启debug模式,可在控制台输出
elasticsearch { // 输出到es
hosts => ["${ELASTICSEARCH_HOST}:${ELASTICSEARCH_PORT}"] // es主机配置
manage_template => false
index => "%{[@metadata][topic]}-%{+YYYY.MM.dd}" // 创建索引
}
}
elasticsearch: // es主机定义
host: elasticsearch-master.default.svc.cluster.local
port: 9200
启动
helm install --name logstash -f logstash-settings.yaml logstash
更新配置
helm upgrade logstash -f logstash-settings.yaml logstash
停止服务
helm delete logstash --purge
上一篇《Kubernetes部署Kafka》 下一篇《Kubernetes部署Kibana》
更多推荐
已为社区贡献8条内容
所有评论(0)